-- Logs begin at Wed 2022-06-22 08:00:27 UTC, end at Wed 2022-06-22 09:37:21 UTC. -- Jun 22 08:33:40.376522 dv-cinder-845178-8-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 22 08:33:40.384604 dv-cinder-845178-8-iscsi devstack@keystone.service[86693]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 22 08:33:40.387675 dv-cinder-845178-8-iscsi devstack@keystone.service[86693]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 22 08:33:40 2022] *** Jun 22 08:33:40.387675 dv-cinder-845178-8-iscsi devstack@keystone.service[86693]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 22 08:33:40.387675 dv-cinder-845178-8-iscsi devstack@keystone.service[86693]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 22 08:33:40.387675 dv-cinder-845178-8-iscsi devstack@keystone.service[86693]: nodename: dv-cinder-845178-8-iscsi Jun 22 08:33:40.387675 dv-cinder-845178-8-iscsi devstack@keystone.service[86693]: machine: x86_64 Jun 22 08:33:40.387675 dv-cinder-845178-8-iscsi devstack@keystone.service[86693]: clock source: unix Jun 22 08:33:40.387675 dv-cinder-845178-8-iscsi devstack@keystone.service[86693]: pcre jit disabled Jun 22 08:33:40.387675 dv-cinder-845178-8-iscsi devstack@keystone.service[86693]: detected number of CPU cores: 4 Jun 22 08:33:40.387675 dv-cinder-845178-8-iscsi devstack@keystone.service[86693]: current working directory: / Jun 22 08:33:40.387675 dv-cinder-845178-8-iscsi devstack@keystone.service[86693]: detected binary path: /usr/bin/uwsgi-core Jun 22 08:33:40.387675 dv-cinder-845178-8-iscsi devstack@keystone.service[86693]: your processes number limit is 47680 Jun 22 08:33:40.388273 dv-cinder-845178-8-iscsi devstack@keystone.service[86693]: your memory page size is 4096 bytes Jun 22 08:33:40.388273 dv-cinder-845178-8-iscsi devstack@keystone.service[86693]: detected max file descriptor number: 2048 Jun 22 08:33:40.388273 dv-cinder-845178-8-iscsi devstack@keystone.service[86693]: lock engine: pthread robust mutexes Jun 22 08:33:40.388273 dv-cinder-845178-8-iscsi devstack@keystone.service[86693]: thunder lock: enabled Jun 22 08:33:40.388273 dv-cinder-845178-8-iscsi devstack@keystone.service[86693]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 22 08:33:40.388273 dv-cinder-845178-8-iscsi devstack@keystone.service[86693]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 22 08:33:40.432481 dv-cinder-845178-8-iscsi devstack@keystone.service[86693]: Python main interpreter initialized at 0x55f064f3a9c0 Jun 22 08:33:40.432481 dv-cinder-845178-8-iscsi devstack@keystone.service[86693]: python threads support enabled Jun 22 08:33:40.432481 dv-cinder-845178-8-iscsi devstack@keystone.service[86693]: your server socket listen backlog is limited to 100 connections Jun 22 08:33:40.432481 dv-cinder-845178-8-iscsi devstack@keystone.service[86693]: your mercy for graceful operations on workers is 90 seconds Jun 22 08:33:40.432852 dv-cinder-845178-8-iscsi devstack@keystone.service[86693]: mapped 403077 bytes (393 KB) for 2 cores Jun 22 08:33:40.432928 dv-cinder-845178-8-iscsi devstack@keystone.service[86693]: *** Operational MODE: preforking *** Jun 22 08:33:40.433181 dv-cinder-845178-8-iscsi devstack@keystone.service[86693]: *** uWSGI is running in multiple interpreter mode *** Jun 22 08:33:40.433181 dv-cinder-845178-8-iscsi devstack@keystone.service[86693]: spawned uWSGI master process (pid: 86693) Jun 22 08:33:40.433393 dv-cinder-845178-8-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 22 08:33:40.435413 dv-cinder-845178-8-iscsi devstack@keystone.service[86693]: spawned uWSGI worker 1 (pid: 86701, cores: 1) Jun 22 08:33:40.435413 dv-cinder-845178-8-iscsi devstack@keystone.service[86693]: spawned uWSGI worker 2 (pid: 86702, cores: 1) Jun 22 08:33:40.435413 dv-cinder-845178-8-iscsi devstack@keystone.service[86693]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 22 08:33:45.888892 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 08:33:45.888892 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: from cryptography.utils import int_from_bytes Jun 22 08:33:45.889700 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 08:33:45.889700 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: from cryptography.utils import int_from_bytes Jun 22 08:33:45.890148 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 08:33:45.890148 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: from cryptography.utils import int_from_bytes Jun 22 08:33:45.890269 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 08:33:45.890269 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: from cryptography.utils import int_from_bytes Jun 22 08:33:45.938305 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 22 08:33:45.938496 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 22 08:33:45.938578 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 22 08:33:45.938654 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 22 08:33:45.938720 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] command line args: [] {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 22 08:33:45.938784 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] command line args: [] {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 22 08:33:45.938931 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 22 08:33:45.939025 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 22 08:33:45.939098 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] ================================================================================ {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 22 08:33:45.939205 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] ================================================================================ {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 22 08:33:45.939354 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] admin_token = **** {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.939458 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] admin_token = **** {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.939604 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] config_dir = [] {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.939708 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] config_dir = [] {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.939792 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.939896 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.939975 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] config_source = [] {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.940078 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] config_source = [] {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.940168 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] debug = True {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.940246 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] debug = True {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.940318 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.940556 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.940705 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.940789 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.940855 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.940917 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.941087 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.941176 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.941335 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.941419 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.941566 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] list_limit = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.941650 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] list_limit = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.941746 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] log_config_append = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.941826 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] log_config_append = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.941936 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.942021 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.942111 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] log_dir = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.942185 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] log_dir = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.942304 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] log_file = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.942936 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] log_file = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.943063 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.943204 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.943326 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.943443 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.943556 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.943680 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.943795 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.943918 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.944036 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.944157 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.944281 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.944393 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.944499 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.944613 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.944728 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.944818 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.944899 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.945022 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.945099 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.945213 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.945289 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.945405 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.945489 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.945569 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.945685 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.945764 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.945928 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.946011 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.946230 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.946359 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.946722 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.946803 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.946928 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] publish_errors = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.947004 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] publish_errors = False {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.947124 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.947201 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.947356 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.947436 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.947533 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.947616 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.947781 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.947876 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.948015 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.948092 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.948250 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] standard_threads = False {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.948334 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] standard_threads = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.948483 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.948612 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.948725 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.948804 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.948902 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.948984 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.949067 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] use_journal = False {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.949137 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] use_journal = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.949238 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] use_json = False {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.949316 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] use_json = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.949413 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] use_stderr = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.949496 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] use_stderr = False {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.949580 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] use_syslog = False {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.949658 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] use_syslog = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.949803 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.949887 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:33:45.950060 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.950159 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.950320 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.950407 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.950578 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.950657 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.950817 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.950904 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.951068 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.951146 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.951305 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.951383 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.951553 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.951631 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.951793 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.951871 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.952038 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.952114 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.952286 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.952363 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.952534 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.952611 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.952771 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.952847 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.953019 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.953104 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.953255 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.953345 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.953499 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.953577 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.953744 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.953821 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.953969 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.954043 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.954247 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.954333 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.954500 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.954586 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.954749 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.954827 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.954984 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.955060 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.955238 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.955320 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.955497 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.955575 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.955749 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.955828 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.955997 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.956075 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.956231 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.956308 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.956459 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.956534 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.956689 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.956775 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.956925 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.957010 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.957172 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.957256 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.957420 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.957506 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.957652 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.957727 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.957880 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.957955 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.958767 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.958904 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.959023 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.959108 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.959267 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.959345 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.959520 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.959608 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.959750 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.959827 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.959987 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.960065 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.960226 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.960385 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.960461 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.960530 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.960673 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.960758 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.960907 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.960996 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.961139 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.961216 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.961376 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.961452 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.961625 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.961712 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.961859 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.961936 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.962107 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.962231 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.962332 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.962436 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.962569 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.962680 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.962806 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.962911 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.963072 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.963217 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.963311 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.963436 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.963518 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.963591 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.963739 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.963871 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.963955 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.964035 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.964183 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.964262 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.964420 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.964511 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.964652 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.964729 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.964899 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.964980 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.965136 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.965215 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.965375 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.965456 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.965605 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.965691 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.965863 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.965942 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.966126 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.966223 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.966349 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.966427 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.966587 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.966667 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.966821 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.966910 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.967087 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.967165 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.967328 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.967404 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.967577 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.967660 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.967821 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.967899 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.968058 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.968135 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.968293 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.968370 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.968529 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.968607 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.968781 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.968862 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.969018 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.969101 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.969257 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.969333 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.969499 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.969575 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.969740 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.969819 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.969978 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.970054 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.970237 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.970316 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.970474 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.970554 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.970711 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.970789 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.970973 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.971049 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.971213 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.971291 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.971455 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.971531 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.971691 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.971776 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.971929 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.972004 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.972161 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.972240 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.972398 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.972482 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.972636 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.972722 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.972864 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.972942 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.973096 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.973172 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.973323 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.973398 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.973559 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.973638 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.974333 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.974517 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.974616 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.974694 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.974809 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.974890 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.975058 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.975134 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.975298 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.975377 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.975555 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.975633 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.975814 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.975891 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.976058 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.976142 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.976289 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] auth.external = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.976366 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] auth.external = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.976521 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.976604 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.976817 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.976934 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.977051 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.977139 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.977284 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] auth.password = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.977367 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] auth.password = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.977513 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] auth.token = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.977590 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] auth.token = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.977755 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.977839 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.977991 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.978138 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.978262 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.978340 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.978496 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.978585 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.978744 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.978828 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.978995 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.979072 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.979227 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.979312 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.979467 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] credential.caching = True {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.979543 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] credential.caching = True {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.979713 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.979788 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.979962 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.980047 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.980212 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.980295 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.980447 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.980523 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.980693 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.980785 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.980926 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.981006 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.981190 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.981267 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.981442 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.981527 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.981682 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.981759 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.981934 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.982017 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.982244 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.982344 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.982495 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.982574 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.982762 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.982849 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.983011 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.983098 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.983269 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.983354 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.983508 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] federation.caching = True {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.983584 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] federation.caching = True {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.983745 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.983829 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.983992 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.984070 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.984239 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.984315 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.984469 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.984553 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.984717 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.984802 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.984952 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.985029 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.985204 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.985291 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.985444 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.985520 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.985696 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.985772 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.985935 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.986020 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.986206 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.986286 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.986445 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] identity.caching = True {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.986523 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] identity.caching = True {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.986693 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.986850 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.986926 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.986996 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.987168 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.987247 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.987403 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.987482 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.987651 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.987729 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.987882 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.987959 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.988125 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.988209 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.988369 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.988441 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.988622 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.988709 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.988855 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.988961 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.989086 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.989167 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.989427 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.990046 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.990204 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.990287 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.990455 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.990535 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.990704 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.990793 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.990962 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.991043 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.991209 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.991288 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.991480 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.991565 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.991718 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.991798 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.991956 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.992036 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.992190 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.992268 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.992427 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.992508 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.992660 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.992738 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.992896 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.992974 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.993138 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.993218 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.993375 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.993453 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.993623 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.993702 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.993853 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.993933 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.994123 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.994208 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.994366 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.994446 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.994604 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.994684 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.994848 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.995033 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.995115 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.995187 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.995313 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.995394 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.995551 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.995630 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.995778 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.995856 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.996017 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.996097 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.996251 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.996329 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.996492 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.996571 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.996720 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.996798 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.996958 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.997028 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.997209 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.997339 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.997477 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.997606 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.997754 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.997890 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.997890 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.998150 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.998292 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.998419 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.998554 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.998682 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.998810 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.998936 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.999075 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.999204 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.999330 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.999456 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.999596 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] ldap.user = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.999723 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.user = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.999858 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:45.999991 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.000122 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.000249 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.000376 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.000510 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.000637 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.000764 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.000889 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.001018 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.001148 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.001283 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.001421 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.001550 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.001678 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.001830 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.001959 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.002118 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.002248 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.002378 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.002507 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.002634 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.002762 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.002900 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.003028 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.003166 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.003297 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.003424 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.003563 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.003698 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.003828 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.003954 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.004081 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.004209 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.004339 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.004474 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.004602 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.004730 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.004858 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.004994 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.005124 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.005261 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.005392 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.005520 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.005648 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.005776 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.005904 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.006040 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.006186 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.006316 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.006446 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.006573 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.006699 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.006845 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.006975 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.007103 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.007229 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.007356 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.007486 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.007622 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.007749 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.007876 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.008004 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.008143 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.008269 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.008407 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.008548 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.008677 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.008824 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.008946 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.009074 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.009211 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.009340 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] resource.caching = True {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.009467 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] resource.caching = True {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.009597 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.009725 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.009853 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.009989 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.010137 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.010263 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.010401 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.010530 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.010659 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.010797 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.010925 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.011053 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.011179 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.011306 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.011434 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.011645 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.011776 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.011908 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.012035 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] role.caching = True {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.012163 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] role.caching = True {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.012302 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] role.driver = sql {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.012438 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] role.driver = sql {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.012565 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.012700 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.012829 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.012957 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.013085 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.013222 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.013351 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.013479 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.013610 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.013733 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.013871 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.014018 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.014182 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.014313 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.014441 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.014569 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.014712 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.014841 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.014970 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.015095 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.015223 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.015350 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.015484 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.015612 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.015738 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.015877 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.016004 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.016132 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.016271 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.016398 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.016524 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.016652 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.016778 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.016908 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.017058 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.017186 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.017315 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.017443 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.017580 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.017580 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.017827 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.017827 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.018068 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.018068 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.018319 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.018444 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.018578 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.018703 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.018827 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.018951 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.019076 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.019218 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.019356 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.019486 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.019615 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.019744 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.019868 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.020256 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.020382 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.020506 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.020631 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.020756 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.020881 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.021014 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.021150 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.021276 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] token.caching = True {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.021402 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.021526 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.021651 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] token.caching = True {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.021783 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.021908 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.022033 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.022220 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.022344 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.022471 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.022611 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.022736 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.022861 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.022999 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.023125 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.023249 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.023382 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.023508 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.023637 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.023761 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.023885 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.024009 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.024141 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.024267 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.024391 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.024516 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.024640 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.024775 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.024908 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.025033 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.025156 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.025281 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.025405 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.025531 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.025663 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.025793 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.025918 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] database.connection = **** {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.026057 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.026212 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.026343 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] database.connection = **** {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.026489 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.026628 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.026756 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.026892 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.027021 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.027148 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.027276 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.027405 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.027534 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.027669 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.027798 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.027925 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.028053 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.028181 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.028316 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.028454 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.028584 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.028713 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.028841 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.028966 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.029096 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.029232 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.029380 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.029507 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.029637 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.029766 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.029891 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.030027 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.030178 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.030305 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.030430 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.030556 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.030682 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.030817 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.030948 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 22 08:33:46.031074 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:33:46.031074 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 22 08:33:46.059034 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:33:46.059258 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:33:46.059409 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:33:46.059554 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:33:46.059685 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:33:46.059821 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:33:46.068087 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:33:46.068309 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:33:46.096084 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:33:46.096326 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:33:46.096422 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:33:46.096525 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:33:46.241959 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:33:46.242568 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:33:46.293646 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:33:46.293840 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:33:46.293951 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:33:46.294033 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:33:46.358336 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:33:46.358564 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:33:46.358792 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:33:46.358878 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:33:46.359015 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:33:46.359100 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:33:46.359237 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:33:46.359320 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:33:46.359457 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:33:46.359549 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:33:46.359672 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:33:46.359889 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:33:46.385408 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:33:46.385645 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:33:46.385872 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:33:46.385985 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:33:46.386120 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:33:46.386255 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:33:46.386339 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:33:46.386480 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:33:46.386566 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:33:46.386697 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:33:46.386780 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:33:46.386910 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:33:46.387120 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:33:46.387331 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:33:46.398125 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:33:46.398609 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:33:46.410744 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:33:46.410981 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:33:46.411229 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:33:46.411318 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:33:46.411457 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:33:46.411537 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:33:46.411678 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:33:46.411769 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:33:46.411896 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:33:46.411979 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:33:46.412114 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:33:46.412193 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:33:46.412329 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:33:46.412544 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:33:46.429808 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.429916 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.430024 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 22 08:33:46.430131 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 22 08:33:46.430393 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.430481 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.430595 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 22 08:33:46.430693 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 22 08:33:46.430869 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.430956 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.431131 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.431215 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.431391 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.431471 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.431649 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.431745 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.443072 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.443169 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.443352 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.443435 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.443622 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.443719 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.443898 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.443982 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.452212 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:33:46.452307 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:33:46.455523 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:33:46.455610 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:33:46.455806 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.455889 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.456088 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.456180 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.456370 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.456449 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.456647 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.456728 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.456907 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.456987 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.457170 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.457250 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.457440 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.457520 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.457705 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.457784 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.457973 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.458050 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.458299 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.458399 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.484718 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.484841 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.486342 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:33:46.486478 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:33:46.486624 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.486762 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.492575 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:33:46.492698 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:33:46.492927 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.493041 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.493211 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.493331 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.500687 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:33:46.500815 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:33:46.500975 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.501084 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.506088 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:33:46.506184 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:33:46.506379 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.506462 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.506661 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.506744 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.506943 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.507023 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.507215 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.507296 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.507488 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.507577 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.507755 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.507836 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.508021 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.508112 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.527617 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.527715 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.527894 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.527976 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.532495 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:33:46.532585 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:33:46.536187 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.536773 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.537120 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.537217 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.542185 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:33:46.542271 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:33:46.545786 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:33:46.545869 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:33:46.549475 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.549560 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.549771 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.549852 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.550053 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.550147 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.550360 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.550443 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.550638 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.550718 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.550918 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.551009 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.570589 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:33:46.570679 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:33:46.570880 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.570961 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.571147 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.571228 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.571415 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.571495 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.579283 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.579451 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.580982 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.581097 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.581268 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.581349 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.585123 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:33:46.585426 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.585731 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.586038 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.586397 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.586820 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:33:46.587125 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.587426 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.587731 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.588062 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.599741 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:33:46.602501 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.602501 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.602501 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.602813 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:33:46.602813 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.602813 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.602813 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.603077 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.603077 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.603077 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.603993 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.604285 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.604582 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.620910 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:33:46.622563 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:33:46.624260 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:33:46.625859 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:33:46.627602 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.629160 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.629334 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.631480 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.631578 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:33:46.631806 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.632103 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.633117 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:33:46.633394 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.633673 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.639446 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.641060 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:33:46.641149 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.642715 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:33:46.644323 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.644615 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.645260 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.645626 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.646780 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.647068 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.647454 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.647734 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.655272 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:33:46.655563 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.655844 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.656857 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:33:46.657143 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.657429 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.663768 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:33:46.664052 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.664333 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.664608 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.664883 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.665252 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.665332 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:33:46.665545 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.665640 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.665826 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.665908 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.666118 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.666202 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.666391 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.666473 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.666676 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.666764 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.666950 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.667035 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.667219 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.667299 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.667501 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.667590 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.667812 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.668084 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.668346 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.668610 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.668885 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:33:46.706328 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f064f3a9c0 pid: 86702 (default app) Jun 22 08:33:46.707076 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f064f3a9c0 pid: 86701 (default app) Jun 22 08:33:46.710411 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de606051-9bd8-4a03-b5a4-c18d25992940 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:33:46.710722 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de606051-9bd8-4a03-b5a4-c18d25992940 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:33:46.711005 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de606051-9bd8-4a03-b5a4-c18d25992940 None None] PATH_INFO: `/v3` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:33:46.715261 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 791 bytes} [Wed Jun 22 08:33:46 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:33:54.393496 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16cc0e-6402-4c19-814a-2d64acf03f64 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:33:54.394062 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16cc0e-6402-4c19-814a-2d64acf03f64 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:33:54.394062 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16cc0e-6402-4c19-814a-2d64acf03f64 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:33:54.398791 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1/2] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:33:54 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:33:54.404264 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2369c51-94f3-4d74-9d6a-1fa27bad6ca3 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:33:54.404670 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2369c51-94f3-4d74-9d6a-1fa27bad6ca3 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:33:54.404827 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2369c51-94f3-4d74-9d6a-1fa27bad6ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:33:54.475250 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: INFO dbcounter [None req-e2369c51-94f3-4d74-9d6a-1fa27bad6ca3 None None] Registered counter for database keystone Jun 22 08:33:54.496683 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG oslo_db.sqlalchemy.engines [None req-e2369c51-94f3-4d74-9d6a-1fa27bad6ca3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86702) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 08:33:54.503388 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writer thread running {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 08:33:54.684162 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG passlib.handlers.bcrypt [None req-e2369c51-94f3-4d74-9d6a-1fa27bad6ca3 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86702) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 22 08:33:54.684574 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG passlib.handlers.bcrypt [None req-e2369c51-94f3-4d74-9d6a-1fa27bad6ca3 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86702) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 22 08:33:54.743229 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-e2369c51-94f3-4d74-9d6a-1fa27bad6ca3 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:33:54.744862 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-e2369c51-94f3-4d74-9d6a-1fa27bad6ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:33:54.868923 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 2/3] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:33:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 465 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 22 08:33:55.047192 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16cc0e-6402-4c19-814a-2d64acf03f64 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:33:55.118470 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: INFO dbcounter [None req-0e16cc0e-6402-4c19-814a-2d64acf03f64 None None] Registered counter for database keystone Jun 22 08:33:55.138604 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG oslo_db.sqlalchemy.engines [None req-0e16cc0e-6402-4c19-814a-2d64acf03f64 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86701) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 08:33:55.144917 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writer thread running {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 08:33:55.265463 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16cc0e-6402-4c19-814a-2d64acf03f64 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:33:55.269721 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a57db9f-e703-4373-ae09-00e771cbaa14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:33:55.271220 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57db9f-e703-4373-ae09-00e771cbaa14 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:33:55.271503 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57db9f-e703-4373-ae09-00e771cbaa14 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:33:55.271777 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57db9f-e703-4373-ae09-00e771cbaa14 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:33:55.280222 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a57db9f-e703-4373-ae09-00e771cbaa14 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:33:55.337069 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8a57db9f-e703-4373-ae09-00e771cbaa14 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 22 08:33:55.337411 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a57db9f-e703-4373-ae09-00e771cbaa14 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:33:55.347706 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 2/4] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Jun 22 08:33:55 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 22 08:33:55.354183 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2369c51-94f3-4d74-9d6a-1fa27bad6ca3 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:33:55.368710 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2369c51-94f3-4d74-9d6a-1fa27bad6ca3 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:33:55.373198 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc4a632-e994-4222-b6ba-34c0d166d4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:33:55.374350 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc4a632-e994-4222-b6ba-34c0d166d4ed admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:33:55.374642 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc4a632-e994-4222-b6ba-34c0d166d4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:33:55.374921 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc4a632-e994-4222-b6ba-34c0d166d4ed admin admin] PATH_INFO: `/v3/projects/272f01980f584e4888194eeac35f8209` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:33:55.379098 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc4a632-e994-4222-b6ba-34c0d166d4ed admin admin] RBAC: Authorizing `identity:get_project(project_id=272f01980f584e4888194eeac35f8209)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:33:55.430949 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5bc4a632-e994-4222-b6ba-34c0d166d4ed admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 22 08:33:55.431505 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc4a632-e994-4222-b6ba-34c0d166d4ed admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:33:55.435950 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 3/5] 10.222.0.42 () {56 vars in 1207 bytes} [Wed Jun 22 08:33:55 2022] GET /identity/v3/projects/272f01980f584e4888194eeac35f8209 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:33:57.450176 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2383958-9bdd-47af-94a7-2d3d751f59df None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:33:57.450697 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2383958-9bdd-47af-94a7-2d3d751f59df None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:33:57.450779 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2383958-9bdd-47af-94a7-2d3d751f59df None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:33:57.454949 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 3/6] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:33:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:33:57.460775 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914854e4-60ab-4f6b-892f-4fd3cb4d33ac None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:33:57.461188 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914854e4-60ab-4f6b-892f-4fd3cb4d33ac None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:33:57.461352 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914854e4-60ab-4f6b-892f-4fd3cb4d33ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:33:57.480656 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-914854e4-60ab-4f6b-892f-4fd3cb4d33ac None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:33:57.482260 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-914854e4-60ab-4f6b-892f-4fd3cb4d33ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:33:57.491283 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 4/7] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:33:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 22 08:33:57.513819 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2383958-9bdd-47af-94a7-2d3d751f59df None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:33:57.526848 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2383958-9bdd-47af-94a7-2d3d751f59df None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:33:57.531104 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72fc2d0-674f-43e8-8931-fe40e427f836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:33:57.531743 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72fc2d0-674f-43e8-8931-fe40e427f836 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:33:57.532031 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72fc2d0-674f-43e8-8931-fe40e427f836 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:33:57.532313 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72fc2d0-674f-43e8-8931-fe40e427f836 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:33:57.540811 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72fc2d0-674f-43e8-8931-fe40e427f836 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:33:57.542638 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72fc2d0-674f-43e8-8931-fe40e427f836 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:33:57.551793 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 4/8] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Jun 22 08:33:57 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 22 08:33:57.559406 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914854e4-60ab-4f6b-892f-4fd3cb4d33ac None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:33:57.568659 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914854e4-60ab-4f6b-892f-4fd3cb4d33ac None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:33:57.573078 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c93bb47-fe02-4015-8db2-d8dcc6da1b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:33:57.573938 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93bb47-fe02-4015-8db2-d8dcc6da1b5f admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:33:57.574263 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93bb47-fe02-4015-8db2-d8dcc6da1b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:33:57.574541 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93bb47-fe02-4015-8db2-d8dcc6da1b5f admin admin] PATH_INFO: `/v3/users/6ca353121b49417da331c92ca4f0c767` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:33:57.575931 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c93bb47-fe02-4015-8db2-d8dcc6da1b5f admin admin] RBAC: Authorizing `identity:get_user(user_id=6ca353121b49417da331c92ca4f0c767)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:33:57.577760 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c93bb47-fe02-4015-8db2-d8dcc6da1b5f admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:33:57.579364 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 5/9] 10.222.0.42 () {56 vars in 1198 bytes} [Wed Jun 22 08:33:57 2022] GET /identity/v3/users/6ca353121b49417da331c92ca4f0c767 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:33:59.654534 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9872a-02c5-42da-b80e-e15559161f77 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:33:59.655038 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9872a-02c5-42da-b80e-e15559161f77 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:33:59.655119 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9872a-02c5-42da-b80e-e15559161f77 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:33:59.656442 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 5/10] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:33:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:33:59.662128 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80a31a-ffc9-4cbb-8320-b89079109c12 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:33:59.662513 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80a31a-ffc9-4cbb-8320-b89079109c12 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:33:59.662699 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80a31a-ffc9-4cbb-8320-b89079109c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:33:59.679517 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-4c80a31a-ffc9-4cbb-8320-b89079109c12 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:33:59.680698 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-4c80a31a-ffc9-4cbb-8320-b89079109c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:33:59.725669 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059af0d-2230-48d2-a859-425e9a222b88 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:33:59.725956 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059af0d-2230-48d2-a859-425e9a222b88 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:33:59.726270 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059af0d-2230-48d2-a859-425e9a222b88 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:33:59.727625 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 6/11] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:33:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:33:59.732769 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5b3fd-5da9-4292-a8b4-b7a5e369e149 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:33:59.733060 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5b3fd-5da9-4292-a8b4-b7a5e369e149 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:33:59.733343 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5b3fd-5da9-4292-a8b4-b7a5e369e149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:33:59.763138 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 6/12] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:33:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:33:59.773234 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG passlib.handlers.bcrypt [None req-2fa5b3fd-5da9-4292-a8b4-b7a5e369e149 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86701) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 22 08:33:59.773656 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG passlib.handlers.bcrypt [None req-2fa5b3fd-5da9-4292-a8b4-b7a5e369e149 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86701) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 22 08:33:59.787990 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c80a31a-ffc9-4cbb-8320-b89079109c12 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:33:59.811059 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:33:59.820832 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-2fa5b3fd-5da9-4292-a8b4-b7a5e369e149 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:33:59.822922 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-2fa5b3fd-5da9-4292-a8b4-b7a5e369e149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:33:59.892092 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c80a31a-ffc9-4cbb-8320-b89079109c12 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:33:59.923747 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 7/13] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:33:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:33:59.927371 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be2d32c-1b8a-4fb6-8144-59a52ca98232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:33:59.928193 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be2d32c-1b8a-4fb6-8144-59a52ca98232 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:33:59.928482 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be2d32c-1b8a-4fb6-8144-59a52ca98232 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:33:59.928767 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be2d32c-1b8a-4fb6-8144-59a52ca98232 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:33:59.940080 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be2d32c-1b8a-4fb6-8144-59a52ca98232 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:33:59.946879 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5b3fd-5da9-4292-a8b4-b7a5e369e149 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:33:59.952286 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-6be2d32c-1b8a-4fb6-8144-59a52ca98232 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:33:59.952286 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:33:59.952286 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:33:59.952286 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:33:59.952286 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:33:59.952286 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:33:59.952286 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:33:59.952286 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:33:59.952286 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:33:59.952286 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:33:59.952286 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:33:59.952286 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:33:59.952286 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:33:59.952286 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:33:59.952286 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:33:59.952286 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:33:59.953367 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:33:59.953367 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:33:59.953367 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:33:59.953367 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:33:59.953367 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:33:59.953367 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:33:59.953367 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:33:59.953367 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:33:59.953367 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:33:59.953367 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:33:59.953367 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:33:59.953367 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:33:59.953367 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:33:59.953367 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:33:59.953367 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:33:59.953367 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:33:59.954366 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:33:59.954366 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:33:59.954366 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:33:59.954366 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:33:59.954366 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:33:59.954366 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:33:59.954366 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:33:59.954366 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:33:59.954366 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:33:59.954366 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:33:59.954366 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:33:59.954366 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:33:59.958412 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 7/14] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Jun 22 08:33:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:33:59.959689 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be2d32c-1b8a-4fb6-8144-59a52ca98232 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:00.042045 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:00.048251 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5b3fd-5da9-4292-a8b4-b7a5e369e149 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:00.050749 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:00.062243 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be2d32c-1b8a-4fb6-8144-59a52ca98232 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:00.088580 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c48557a-08cb-4f00-aa17-f847a58975e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:00.089487 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c48557a-08cb-4f00-aa17-f847a58975e8 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:00.089771 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c48557a-08cb-4f00-aa17-f847a58975e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:00.090045 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c48557a-08cb-4f00-aa17-f847a58975e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:00.096453 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c183ede1-dbc9-4e12-88b4-ba689ba9d050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:00.097115 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c183ede1-dbc9-4e12-88b4-ba689ba9d050 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:00.097404 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c183ede1-dbc9-4e12-88b4-ba689ba9d050 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:00.097680 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c183ede1-dbc9-4e12-88b4-ba689ba9d050 None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:00.098983 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c183ede1-dbc9-4e12-88b4-ba689ba9d050 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:00.099295 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c183ede1-dbc9-4e12-88b4-ba689ba9d050 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:00.100706 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c183ede1-dbc9-4e12-88b4-ba689ba9d050 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:00.112362 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 8/15] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Jun 22 08:33:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:34:00.118512 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c183ede1-dbc9-4e12-88b4-ba689ba9d050 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:00.158545 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c48557a-08cb-4f00-aa17-f847a58975e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:00.160075 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c48557a-08cb-4f00-aa17-f847a58975e8 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:00.217917 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c183ede1-dbc9-4e12-88b4-ba689ba9d050 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:00.254461 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a773fed3-3d3a-49f3-9da8-df7b414b5292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:00.256164 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773fed3-3d3a-49f3-9da8-df7b414b5292 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:00.256459 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773fed3-3d3a-49f3-9da8-df7b414b5292 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:00.256743 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773fed3-3d3a-49f3-9da8-df7b414b5292 None admin] PATH_INFO: `/v3/users/6ca353121b49417da331c92ca4f0c767` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:00.257973 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a773fed3-3d3a-49f3-9da8-df7b414b5292 None admin] RBAC: Authorizing `identity:get_user(user_id=6ca353121b49417da331c92ca4f0c767)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:00.259473 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a773fed3-3d3a-49f3-9da8-df7b414b5292 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:00.261104 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 9/16] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Jun 22 08:34:00 2022] GET /identity/v3/users/6ca353121b49417da331c92ca4f0c767 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:34:00.261467 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 8/17] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Jun 22 08:33:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 22 08:34:00.266544 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a773fed3-3d3a-49f3-9da8-df7b414b5292 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:00.266747 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c48557a-08cb-4f00-aa17-f847a58975e8 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:00.269411 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:00.282039 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:00.367067 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a773fed3-3d3a-49f3-9da8-df7b414b5292 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:00.368381 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c48557a-08cb-4f00-aa17-f847a58975e8 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:00.402933 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff658a-4544-47d0-9a35-74cabe858b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:00.403176 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00273400-1541-4b7b-9e2a-94b15d130b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:00.403727 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff658a-4544-47d0-9a35-74cabe858b88 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:00.403820 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00273400-1541-4b7b-9e2a-94b15d130b67 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:00.404004 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00273400-1541-4b7b-9e2a-94b15d130b67 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:00.404100 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff658a-4544-47d0-9a35-74cabe858b88 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:00.404280 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00273400-1541-4b7b-9e2a-94b15d130b67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:00.404375 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff658a-4544-47d0-9a35-74cabe858b88 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:00.405465 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ff658a-4544-47d0-9a35-74cabe858b88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:00.406944 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ff658a-4544-47d0-9a35-74cabe858b88 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:00.408547 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 10/18] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:34:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:00.414685 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff658a-4544-47d0-9a35-74cabe858b88 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:00.423498 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00273400-1541-4b7b-9e2a-94b15d130b67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:00.424965 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00273400-1541-4b7b-9e2a-94b15d130b67 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:00.446938 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-00273400-1541-4b7b-9e2a-94b15d130b67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:34:00.446938 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:34:00.446938 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:34:00.446938 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:34:00.446938 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:34:00.446938 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:34:00.446938 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:34:00.446938 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:34:00.446938 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:34:00.446938 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:34:00.446938 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:34:00.446938 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:34:00.446938 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:34:00.446938 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:34:00.446938 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:34:00.447861 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:34:00.447861 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:34:00.447861 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:34:00.447861 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:34:00.447861 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:34:00.447861 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:34:00.447861 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:34:00.447861 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:34:00.447861 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:34:00.447861 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:34:00.447861 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:34:00.447861 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:34:00.447861 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:34:00.447861 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:34:00.447861 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:34:00.447861 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:34:00.447861 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:34:00.448858 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:34:00.448858 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:34:00.448858 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:34:00.448858 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:34:00.448858 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 9/19] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:34:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:34:00.454206 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00273400-1541-4b7b-9e2a-94b15d130b67 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:00.498823 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:00.514459 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:00.519257 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff658a-4544-47d0-9a35-74cabe858b88 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:00.553801 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e91f95-b993-4822-9cf6-f49daf34bb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:00.554494 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e91f95-b993-4822-9cf6-f49daf34bb60 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:00.554782 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e91f95-b993-4822-9cf6-f49daf34bb60 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:00.555061 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e91f95-b993-4822-9cf6-f49daf34bb60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:00.555902 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e91f95-b993-4822-9cf6-f49daf34bb60 None admin] RBAC: Adding query filter params (role.id=c7518e0f532945af80c33860f2ac506d, scope.domain.id=default, user.id=6ca353121b49417da331c92ca4f0c767) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:00.556216 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e91f95-b993-4822-9cf6-f49daf34bb60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:00.557702 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e91f95-b993-4822-9cf6-f49daf34bb60 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:00.558882 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00273400-1541-4b7b-9e2a-94b15d130b67 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:00.564464 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 11/20] 10.222.0.42 () {56 vars in 1322 bytes} [Wed Jun 22 08:34:00 2022] GET /identity/v3/role_assignments?user.id=6ca353121b49417da331c92ca4f0c767&scope.domain.id=default&role.id=c7518e0f532945af80c33860f2ac506d => generated 233 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:34:00.594650 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746647c6-f0dd-49e8-a169-7b8f27a23947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:00.595340 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746647c6-f0dd-49e8-a169-7b8f27a23947 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:00.595628 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746647c6-f0dd-49e8-a169-7b8f27a23947 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:00.595906 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746647c6-f0dd-49e8-a169-7b8f27a23947 None admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:00.596660 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746647c6-f0dd-49e8-a169-7b8f27a23947 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:00.596968 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746647c6-f0dd-49e8-a169-7b8f27a23947 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:00.598997 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746647c6-f0dd-49e8-a169-7b8f27a23947 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:00.618597 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 10/21] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:34:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:34:03.028173 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09633ce-7962-48e1-a064-d7abce05d5e1 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:03.029230 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09633ce-7962-48e1-a064-d7abce05d5e1 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:03.029735 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09633ce-7962-48e1-a064-d7abce05d5e1 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:03.031360 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 12/22] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:34:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:34:03.037798 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a43db-1eaf-43dc-9c97-40f23a3557be None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:03.038728 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a43db-1eaf-43dc-9c97-40f23a3557be None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:03.039224 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a43db-1eaf-43dc-9c97-40f23a3557be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:03.058136 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-cb8a43db-1eaf-43dc-9c97-40f23a3557be None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:34:03.059749 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-cb8a43db-1eaf-43dc-9c97-40f23a3557be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:34:03.094934 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc351195-1cf1-420b-8c56-92531f6b0afa None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:03.095571 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc351195-1cf1-420b-8c56-92531f6b0afa None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:03.096066 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc351195-1cf1-420b-8c56-92531f6b0afa None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:03.097953 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 13/23] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:34:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:34:03.104190 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c718f6-9320-448d-b42d-d245007413c8 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:03.105010 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c718f6-9320-448d-b42d-d245007413c8 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:03.105693 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c718f6-9320-448d-b42d-d245007413c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:03.131356 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-41c718f6-9320-448d-b42d-d245007413c8 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:34:03.134510 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-41c718f6-9320-448d-b42d-d245007413c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:34:03.203233 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 11/24] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:34:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:34:03.247199 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 14/25] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:34:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:34:03.265668 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8a43db-1eaf-43dc-9c97-40f23a3557be None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:03.287761 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c718f6-9320-448d-b42d-d245007413c8 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:03.378661 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:03.427074 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:03.448326 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8a43db-1eaf-43dc-9c97-40f23a3557be None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:03.451903 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c718f6-9320-448d-b42d-d245007413c8 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:03.496752 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2425e6-86c7-4b09-a5d7-2706234c3c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:03.498228 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2425e6-86c7-4b09-a5d7-2706234c3c65 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:03.499749 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2425e6-86c7-4b09-a5d7-2706234c3c65 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:03.501020 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2425e6-86c7-4b09-a5d7-2706234c3c65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:03.519507 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c44003-af1a-45fe-bca0-9d2cbeb98a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:03.520969 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c44003-af1a-45fe-bca0-9d2cbeb98a34 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:03.521452 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c44003-af1a-45fe-bca0-9d2cbeb98a34 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:03.521951 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c44003-af1a-45fe-bca0-9d2cbeb98a34 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:03.523897 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2425e6-86c7-4b09-a5d7-2706234c3c65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:03.527052 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2425e6-86c7-4b09-a5d7-2706234c3c65 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:03.537486 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c44003-af1a-45fe-bca0-9d2cbeb98a34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:34:03.547575 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-24c44003-af1a-45fe-bca0-9d2cbeb98a34 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:34:03.547575 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:34:03.547575 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:34:03.547575 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:34:03.547575 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:34:03.547575 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:34:03.547575 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:34:03.547575 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:34:03.547575 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:34:03.547575 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:34:03.547575 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:34:03.547575 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:34:03.547575 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:34:03.547575 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:34:03.547575 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:34:03.547575 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:34:03.548512 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:34:03.548512 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:34:03.548512 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:34:03.548512 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:34:03.548512 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:34:03.548512 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:34:03.548512 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:34:03.548512 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:34:03.548512 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:34:03.548512 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:34:03.548512 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:34:03.548512 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:34:03.548512 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:34:03.548512 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:34:03.548512 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:34:03.548512 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:34:03.549408 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:34:03.549408 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:34:03.549408 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:34:03.549408 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:34:03.549408 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:34:03.549408 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:34:03.549408 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:34:03.549408 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:34:03.549408 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:34:03.549408 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:34:03.549408 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:34:03.549408 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:34:03.551959 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 12/26] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Jun 22 08:34:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:34:03.553376 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f064e7-d548-48b1-ad33-d9eef1d86e5f None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:03.553865 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f064e7-d548-48b1-ad33-d9eef1d86e5f None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:03.554326 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f064e7-d548-48b1-ad33-d9eef1d86e5f None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:03.555745 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 13/27] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:34:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:34:03.556951 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015824e1-8b6d-4a7b-ab6c-7a63bc44f32c None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:03.557358 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015824e1-8b6d-4a7b-ab6c-7a63bc44f32c None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:03.558263 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015824e1-8b6d-4a7b-ab6c-7a63bc44f32c None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:03.563632 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-fe2425e6-86c7-4b09-a5d7-2706234c3c65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:34:03.563632 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:34:03.563632 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:34:03.563632 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:34:03.563632 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:34:03.563632 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:34:03.563632 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:34:03.563632 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:34:03.563632 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:34:03.563632 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:34:03.563632 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:34:03.563632 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:34:03.563632 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:34:03.563632 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:34:03.563632 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:34:03.565089 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:34:03.565089 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:34:03.565089 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:34:03.565089 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:34:03.565089 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:34:03.565089 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:34:03.565089 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:34:03.565089 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:34:03.565089 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:34:03.565089 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:34:03.565089 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:34:03.565089 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:34:03.565089 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:34:03.565089 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:34:03.565089 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:34:03.565089 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:34:03.565089 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:34:03.565893 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:34:03.565893 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:34:03.565893 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:34:03.565893 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:34:03.566130 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 14/28] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:34:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:34:03.566130 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015824e1-8b6d-4a7b-ab6c-7a63bc44f32c None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:03.568814 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 15/29] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:34:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:34:03.570382 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5333a8d7-35a7-4dd4-88db-9fadf21a3fad None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:03.570886 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5333a8d7-35a7-4dd4-88db-9fadf21a3fad None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:03.571364 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5333a8d7-35a7-4dd4-88db-9fadf21a3fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:03.592946 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-5333a8d7-35a7-4dd4-88db-9fadf21a3fad None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:34:03.594551 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-5333a8d7-35a7-4dd4-88db-9fadf21a3fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:34:03.702406 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 16/30] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:34:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:34:03.703797 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5083887-7981-4a66-b177-2d288de30961 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:03.704078 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5083887-7981-4a66-b177-2d288de30961 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:03.704389 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5083887-7981-4a66-b177-2d288de30961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:03.705188 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015824e1-8b6d-4a7b-ab6c-7a63bc44f32c None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:03.714710 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:03.726744 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-e5083887-7981-4a66-b177-2d288de30961 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:34:03.728327 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-e5083887-7981-4a66-b177-2d288de30961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:34:03.757831 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd72244-c295-4208-8475-e0f67d9f55a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:03.758543 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd72244-c295-4208-8475-e0f67d9f55a2 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:03.758829 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd72244-c295-4208-8475-e0f67d9f55a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:03.759262 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd72244-c295-4208-8475-e0f67d9f55a2 None admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:03.760173 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd72244-c295-4208-8475-e0f67d9f55a2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:03.760486 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd72244-c295-4208-8475-e0f67d9f55a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:03.762619 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd72244-c295-4208-8475-e0f67d9f55a2 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:03.780293 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 15/31] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Jun 22 08:34:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:03.785612 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd72244-c295-4208-8475-e0f67d9f55a2 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:03.804774 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:03.829652 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 17/32] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:34:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:34:03.830975 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5083887-7981-4a66-b177-2d288de30961 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:03.903549 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd72244-c295-4208-8475-e0f67d9f55a2 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:03.945479 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c34f3-3df0-4f39-bb96-cc3ba36e741f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:03.946207 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c34f3-3df0-4f39-bb96-cc3ba36e741f None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:03.946481 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c34f3-3df0-4f39-bb96-cc3ba36e741f None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:03.947022 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c34f3-3df0-4f39-bb96-cc3ba36e741f None admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:03.947586 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4c34f3-3df0-4f39-bb96-cc3ba36e741f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:03.947897 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4c34f3-3df0-4f39-bb96-cc3ba36e741f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:03.949396 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4c34f3-3df0-4f39-bb96-cc3ba36e741f None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:03.963516 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5083887-7981-4a66-b177-2d288de30961 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:03.963992 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 16/33] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:34:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:03.969170 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c34f3-3df0-4f39-bb96-cc3ba36e741f None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:04.003660 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:04.017836 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bfbf02-d438-4efd-a3ed-3cbcc5a89ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:04.019003 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bfbf02-d438-4efd-a3ed-3cbcc5a89ce5 None admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:04.019481 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bfbf02-d438-4efd-a3ed-3cbcc5a89ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:04.019970 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bfbf02-d438-4efd-a3ed-3cbcc5a89ce5 None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:04.021239 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bfbf02-d438-4efd-a3ed-3cbcc5a89ce5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:04.022898 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bfbf02-d438-4efd-a3ed-3cbcc5a89ce5 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:04.085181 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c34f3-3df0-4f39-bb96-cc3ba36e741f None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:04.130651 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd80cf4-1a09-4be3-8679-df558c04c5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:04.131530 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd80cf4-1a09-4be3-8679-df558c04c5cc None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:04.131816 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd80cf4-1a09-4be3-8679-df558c04c5cc None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:04.132092 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd80cf4-1a09-4be3-8679-df558c04c5cc None admin] PATH_INFO: `/v3/users/6ca353121b49417da331c92ca4f0c767` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:04.133688 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd80cf4-1a09-4be3-8679-df558c04c5cc None admin] RBAC: Authorizing `identity:get_user(user_id=6ca353121b49417da331c92ca4f0c767)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:04.135177 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd80cf4-1a09-4be3-8679-df558c04c5cc None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:04.136836 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 17/34] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Jun 22 08:34:03 2022] GET /identity/v3/users/6ca353121b49417da331c92ca4f0c767 => generated 247 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:04.137578 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd80cf4-1a09-4be3-8679-df558c04c5cc None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:04.167105 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 18/35] 10.222.0.42 () {60 vars in 1131 bytes} [Wed Jun 22 08:34:03 2022] POST /identity/v3/roles => generated 219 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:34:04.168752 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bfbf02-d438-4efd-a3ed-3cbcc5a89ce5 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:04.240444 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:04.312454 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bfbf02-d438-4efd-a3ed-3cbcc5a89ce5 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:04.317946 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:04.330173 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd80cf4-1a09-4be3-8679-df558c04c5cc None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:04.367661 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f679c3-a202-444d-a3c4-c81d1561f8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:04.368324 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f679c3-a202-444d-a3c4-c81d1561f8bf None admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:04.368613 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f679c3-a202-444d-a3c4-c81d1561f8bf None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:04.368893 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f679c3-a202-444d-a3c4-c81d1561f8bf None admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:04.370823 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f679c3-a202-444d-a3c4-c81d1561f8bf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:04.372592 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f679c3-a202-444d-a3c4-c81d1561f8bf None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:04.390176 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5546b17-8f68-4434-b094-0aba15737af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:04.391547 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5546b17-8f68-4434-b094-0aba15737af5 None admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:04.392063 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5546b17-8f68-4434-b094-0aba15737af5 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:04.392547 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5546b17-8f68-4434-b094-0aba15737af5 None admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:04.394176 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5546b17-8f68-4434-b094-0aba15737af5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:04.396188 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5546b17-8f68-4434-b094-0aba15737af5 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:04.410778 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 19/36] 10.222.0.42 () {60 vars in 1141 bytes} [Wed Jun 22 08:34:04 2022] POST /identity/v3/projects => generated 301 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:34:04.411737 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f679c3-a202-444d-a3c4-c81d1561f8bf None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:04.550501 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:04.555973 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f679c3-a202-444d-a3c4-c81d1561f8bf None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:04.604415 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef0a332-38ca-47a1-ba27-bb36a001ddcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:04.605229 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0a332-38ca-47a1-ba27-bb36a001ddcc None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:04.605517 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0a332-38ca-47a1-ba27-bb36a001ddcc None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:04.605800 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0a332-38ca-47a1-ba27-bb36a001ddcc None admin] PATH_INFO: `/v3/domains/default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:04.607016 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 18/37] 10.222.0.42 () {60 vars in 1131 bytes} [Wed Jun 22 08:34:04 2022] POST /identity/v3/roles => generated 225 bytes in 470 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:34:04.607943 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef0a332-38ca-47a1-ba27-bb36a001ddcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:04.609518 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef0a332-38ca-47a1-ba27-bb36a001ddcc None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:04.611509 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 20/38] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:34:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:04.618724 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5546b17-8f68-4434-b094-0aba15737af5 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:04.762358 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5546b17-8f68-4434-b094-0aba15737af5 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:04.788447 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c91a3-3047-4bf2-aeab-62f50c557f34 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:04.788794 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c91a3-3047-4bf2-aeab-62f50c557f34 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:04.789012 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c91a3-3047-4bf2-aeab-62f50c557f34 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:04.791776 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 21/39] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:34:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:34:04.797461 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43821614-cfe1-49de-a1a8-10e72943cb88 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:04.797751 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43821614-cfe1-49de-a1a8-10e72943cb88 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:04.798035 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43821614-cfe1-49de-a1a8-10e72943cb88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:04.810688 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6babed9b-7cf3-49e5-9f7a-59c69eccfce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:04.812728 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6babed9b-7cf3-49e5-9f7a-59c69eccfce4 None admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:04.813464 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6babed9b-7cf3-49e5-9f7a-59c69eccfce4 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:04.814293 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6babed9b-7cf3-49e5-9f7a-59c69eccfce4 None admin] PATH_INFO: `/v3/domains/default/users/6ca353121b49417da331c92ca4f0c767/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:04.817667 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6babed9b-7cf3-49e5-9f7a-59c69eccfce4 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=6ca353121b49417da331c92ca4f0c767, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:04.819324 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6babed9b-7cf3-49e5-9f7a-59c69eccfce4 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:04.821052 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-43821614-cfe1-49de-a1a8-10e72943cb88 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:34:04.822629 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-43821614-cfe1-49de-a1a8-10e72943cb88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:34:04.839403 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 19/40] 10.222.0.42 () {58 vars in 1361 bytes} [Wed Jun 22 08:34:04 2022] PUT /identity/v3/domains/default/users/6ca353121b49417da331c92ca4f0c767/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:34:04.840785 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c96d23-7e6f-4fe0-8e32-7bc01354febc None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:04.841031 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c96d23-7e6f-4fe0-8e32-7bc01354febc None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:04.841292 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c96d23-7e6f-4fe0-8e32-7bc01354febc None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:04.842856 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 20/41] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:34:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:34:04.851543 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b5fbf-06fb-4b19-a556-8a30858ef816 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:04.851877 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b5fbf-06fb-4b19-a556-8a30858ef816 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:04.852162 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b5fbf-06fb-4b19-a556-8a30858ef816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:04.872948 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-3a5b5fbf-06fb-4b19-a556-8a30858ef816 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:34:04.874522 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-3a5b5fbf-06fb-4b19-a556-8a30858ef816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:34:04.890554 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:04.927587 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 22/42] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:34:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:34:04.952737 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43821614-cfe1-49de-a1a8-10e72943cb88 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:05.090707 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 21/43] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:34:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:34:05.116356 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b5fbf-06fb-4b19-a556-8a30858ef816 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:05.193076 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:05.201622 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43821614-cfe1-49de-a1a8-10e72943cb88 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:05.238162 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2683df-754a-465a-866b-5a66a9007179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:05.239489 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2683df-754a-465a-866b-5a66a9007179 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:05.239770 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2683df-754a-465a-866b-5a66a9007179 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:05.240057 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2683df-754a-465a-866b-5a66a9007179 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:05.241262 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2683df-754a-465a-866b-5a66a9007179 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:05.242771 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2683df-754a-465a-866b-5a66a9007179 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:05.243434 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b5fbf-06fb-4b19-a556-8a30858ef816 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:05.244420 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 23/44] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:34:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:34:05.249981 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2683df-754a-465a-866b-5a66a9007179 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:05.305305 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d56e70-f47f-41f4-aa55-9e18d9be6528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:05.307680 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d56e70-f47f-41f4-aa55-9e18d9be6528 None admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:05.307978 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d56e70-f47f-41f4-aa55-9e18d9be6528 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:05.308271 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d56e70-f47f-41f4-aa55-9e18d9be6528 None admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:05.309540 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d56e70-f47f-41f4-aa55-9e18d9be6528 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:05.311400 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d56e70-f47f-41f4-aa55-9e18d9be6528 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:05.330071 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 22/45] 10.222.0.42 () {60 vars in 1131 bytes} [Wed Jun 22 08:34:05 2022] POST /identity/v3/roles => generated 223 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 08:34:05.390867 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2683df-754a-465a-866b-5a66a9007179 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:05.433969 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ad3f19-d86c-4fa4-9419-3d30cc2fdbeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:05.434873 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad3f19-d86c-4fa4-9419-3d30cc2fdbeb None admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:05.435321 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad3f19-d86c-4fa4-9419-3d30cc2fdbeb None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:05.435757 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad3f19-d86c-4fa4-9419-3d30cc2fdbeb None admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:05.436646 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ad3f19-d86c-4fa4-9419-3d30cc2fdbeb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:05.438371 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ad3f19-d86c-4fa4-9419-3d30cc2fdbeb None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:05.468566 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 24/46] 10.222.0.42 () {60 vars in 1141 bytes} [Wed Jun 22 08:34:05 2022] POST /identity/v3/projects => generated 312 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 08:34:06.929727 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf7144-7394-4f0c-81cc-7382a40cddf4 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:06.930303 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf7144-7394-4f0c-81cc-7382a40cddf4 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:06.930303 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf7144-7394-4f0c-81cc-7382a40cddf4 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:06.931712 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 23/47] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:34:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:34:06.937114 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee2a4e0-d76e-4683-bbcb-10b8076f95d4 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:06.938318 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee2a4e0-d76e-4683-bbcb-10b8076f95d4 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:06.938318 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee2a4e0-d76e-4683-bbcb-10b8076f95d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:06.955293 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-7ee2a4e0-d76e-4683-bbcb-10b8076f95d4 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:34:06.956518 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-7ee2a4e0-d76e-4683-bbcb-10b8076f95d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:34:06.968202 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:07.026571 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 25/48] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:34:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:34:07.050233 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf7144-7394-4f0c-81cc-7382a40cddf4 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:07.060303 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:07.164023 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf7144-7394-4f0c-81cc-7382a40cddf4 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:07.198163 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b3d15-cef9-46ad-b460-d7e9973f6452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:07.198882 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b3d15-cef9-46ad-b460-d7e9973f6452 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:07.199170 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b3d15-cef9-46ad-b460-d7e9973f6452 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:07.199445 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b3d15-cef9-46ad-b460-d7e9973f6452 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:07.210727 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9b3d15-cef9-46ad-b460-d7e9973f6452 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:34:07.218449 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-5e9b3d15-cef9-46ad-b460-d7e9973f6452 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:34:07.218449 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:34:07.218449 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:34:07.218449 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:34:07.218449 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:34:07.218449 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:34:07.218449 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:34:07.218449 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:34:07.218449 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:34:07.218449 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:34:07.218449 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:34:07.218449 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:34:07.218449 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:34:07.218449 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:34:07.218449 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:34:07.218449 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:34:07.219435 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:34:07.219435 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:34:07.219435 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:34:07.219435 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:34:07.219435 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:34:07.219435 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:34:07.219435 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:34:07.219435 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:34:07.219435 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:34:07.219435 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:34:07.219435 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:34:07.219435 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:34:07.219435 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:34:07.219435 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:34:07.219435 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:34:07.219435 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:34:07.220280 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:34:07.220280 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:34:07.220280 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:34:07.220280 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:34:07.220280 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:34:07.220280 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:34:07.220280 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:34:07.220280 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:34:07.220280 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:34:07.220280 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:34:07.220280 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:34:07.220280 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:34:07.220280 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 24/49] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Jun 22 08:34:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:34:07.225958 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee2a4e0-d76e-4683-bbcb-10b8076f95d4 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:07.327479 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee2a4e0-d76e-4683-bbcb-10b8076f95d4 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:07.363764 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb89c0-efe8-4d00-8862-0b166f51dd46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:07.364963 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb89c0-efe8-4d00-8862-0b166f51dd46 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:07.365252 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb89c0-efe8-4d00-8862-0b166f51dd46 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:07.365529 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb89c0-efe8-4d00-8862-0b166f51dd46 None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:07.366321 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbb89c0-efe8-4d00-8862-0b166f51dd46 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:07.366632 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbb89c0-efe8-4d00-8862-0b166f51dd46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:07.368042 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbb89c0-efe8-4d00-8862-0b166f51dd46 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:07.376741 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 26/50] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Jun 22 08:34:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:07.383071 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b3d15-cef9-46ad-b460-d7e9973f6452 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:07.452497 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:07.490105 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b3d15-cef9-46ad-b460-d7e9973f6452 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:07.525951 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e650f0ba-2274-4fdd-b932-5efea4112ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:07.526860 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e650f0ba-2274-4fdd-b932-5efea4112ed1 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:07.527149 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e650f0ba-2274-4fdd-b932-5efea4112ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:07.527422 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f94d5-5b62-4d0a-82d8-d54a9ef571b0 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:07.527512 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e650f0ba-2274-4fdd-b932-5efea4112ed1 None admin] PATH_INFO: `/v3/users/6ca353121b49417da331c92ca4f0c767` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:07.527723 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f94d5-5b62-4d0a-82d8-d54a9ef571b0 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:07.528010 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f94d5-5b62-4d0a-82d8-d54a9ef571b0 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:07.528653 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e650f0ba-2274-4fdd-b932-5efea4112ed1 None admin] RBAC: Authorizing `identity:get_user(user_id=6ca353121b49417da331c92ca4f0c767)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:07.529396 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 27/51] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:34:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:34:07.530808 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e650f0ba-2274-4fdd-b932-5efea4112ed1 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:07.531891 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 25/52] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Jun 22 08:34:07 2022] GET /identity/v3/users/6ca353121b49417da331c92ca4f0c767 => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:07.534430 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1994d4-2da0-4035-ac9b-9f6c92a417cf None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:07.534725 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1994d4-2da0-4035-ac9b-9f6c92a417cf None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:07.535008 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1994d4-2da0-4035-ac9b-9f6c92a417cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:07.537891 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e650f0ba-2274-4fdd-b932-5efea4112ed1 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:07.553606 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-0a1994d4-2da0-4035-ac9b-9f6c92a417cf None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:34:07.554852 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-0a1994d4-2da0-4035-ac9b-9f6c92a417cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:34:07.557136 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:07.628826 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 28/53] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:34:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:34:07.655636 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1994d4-2da0-4035-ac9b-9f6c92a417cf None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:07.658197 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e650f0ba-2274-4fdd-b932-5efea4112ed1 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:07.698512 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa5265-d575-4ee8-822b-d4e02663f713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:07.699408 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa5265-d575-4ee8-822b-d4e02663f713 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:07.699700 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa5265-d575-4ee8-822b-d4e02663f713 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:07.699976 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa5265-d575-4ee8-822b-d4e02663f713 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:07.701215 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaa5265-d575-4ee8-822b-d4e02663f713 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:07.702801 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaa5265-d575-4ee8-822b-d4e02663f713 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:07.704410 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 26/54] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:34:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:34:07.711024 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa5265-d575-4ee8-822b-d4e02663f713 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:07.713884 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:07.765318 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1994d4-2da0-4035-ac9b-9f6c92a417cf None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:07.803532 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b090a302-ae8d-49c5-811f-0be272164d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:07.804336 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090a302-ae8d-49c5-811f-0be272164d06 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:07.804625 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090a302-ae8d-49c5-811f-0be272164d06 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:07.804912 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090a302-ae8d-49c5-811f-0be272164d06 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:07.806140 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b090a302-ae8d-49c5-811f-0be272164d06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:07.807636 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b090a302-ae8d-49c5-811f-0be272164d06 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:07.809527 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 29/55] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:34:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:34:07.816317 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b090a302-ae8d-49c5-811f-0be272164d06 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:07.826745 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:07.837804 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa5265-d575-4ee8-822b-d4e02663f713 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:07.875320 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d571a0b2-7aff-44c5-b285-2110a41df762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:07.875998 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571a0b2-7aff-44c5-b285-2110a41df762 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:07.876290 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571a0b2-7aff-44c5-b285-2110a41df762 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:07.876574 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571a0b2-7aff-44c5-b285-2110a41df762 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:07.877431 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d571a0b2-7aff-44c5-b285-2110a41df762 None admin] RBAC: Adding query filter params (role.id=c7518e0f532945af80c33860f2ac506d, scope.domain.id=default, user.id=6ca353121b49417da331c92ca4f0c767) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:07.877749 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d571a0b2-7aff-44c5-b285-2110a41df762 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:07.879268 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d571a0b2-7aff-44c5-b285-2110a41df762 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:07.888931 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 27/56] 10.222.0.42 () {56 vars in 1322 bytes} [Wed Jun 22 08:34:07 2022] GET /identity/v3/role_assignments?user.id=6ca353121b49417da331c92ca4f0c767&scope.domain.id=default&role.id=c7518e0f532945af80c33860f2ac506d => generated 530 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:34:07.947765 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b090a302-ae8d-49c5-811f-0be272164d06 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:07.995633 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba5fd3c-8c92-4f55-8c30-2d89f22c39cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:07.996230 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5fd3c-8c92-4f55-8c30-2d89f22c39cb None admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:07.996521 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5fd3c-8c92-4f55-8c30-2d89f22c39cb None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:07.996804 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5fd3c-8c92-4f55-8c30-2d89f22c39cb None admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:07.997554 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba5fd3c-8c92-4f55-8c30-2d89f22c39cb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:07.999098 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba5fd3c-8c92-4f55-8c30-2d89f22c39cb None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:08.029004 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 30/57] 10.222.0.42 () {60 vars in 1140 bytes} [Wed Jun 22 08:34:07 2022] POST /identity/v3/projects => generated 298 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 08:34:10.134443 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ed975-6a15-49cb-9971-024bac5cc145 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:10.134951 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ed975-6a15-49cb-9971-024bac5cc145 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:10.135033 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ed975-6a15-49cb-9971-024bac5cc145 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:10.136369 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 28/58] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:34:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:34:10.141374 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e6dc7-581b-485f-8714-d7c8d3e4feda None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:10.141778 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e6dc7-581b-485f-8714-d7c8d3e4feda None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:10.141967 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e6dc7-581b-485f-8714-d7c8d3e4feda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:10.159459 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-f81e6dc7-581b-485f-8714-d7c8d3e4feda None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:34:10.161168 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-f81e6dc7-581b-485f-8714-d7c8d3e4feda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:34:10.213266 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:10.228458 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 31/59] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:34:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:34:10.252216 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ed975-6a15-49cb-9971-024bac5cc145 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:10.318624 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:10.353989 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ed975-6a15-49cb-9971-024bac5cc145 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:10.385963 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c428e-219e-4cc3-9550-66269d85c751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:10.386709 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c428e-219e-4cc3-9550-66269d85c751 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:10.387064 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c428e-219e-4cc3-9550-66269d85c751 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:10.387343 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c428e-219e-4cc3-9550-66269d85c751 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:10.388502 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41c428e-219e-4cc3-9550-66269d85c751 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:10.389949 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41c428e-219e-4cc3-9550-66269d85c751 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:10.391589 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 29/60] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:34:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:10.397919 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81e6dc7-581b-485f-8714-d7c8d3e4feda None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:10.493765 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81e6dc7-581b-485f-8714-d7c8d3e4feda None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:10.527649 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59339bb0-b43d-4a72-987a-2b7eea0385a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:10.528322 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59339bb0-b43d-4a72-987a-2b7eea0385a2 None admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:10.528609 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59339bb0-b43d-4a72-987a-2b7eea0385a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:10.528890 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59339bb0-b43d-4a72-987a-2b7eea0385a2 None admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:10.529621 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59339bb0-b43d-4a72-987a-2b7eea0385a2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:10.531110 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59339bb0-b43d-4a72-987a-2b7eea0385a2 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:10.555718 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 32/61] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Jun 22 08:34:10 2022] POST /identity/v3/users => generated 275 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:34:13.742405 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f733fea-81c9-488a-9e72-ab7edebba17e None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:13.743350 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f733fea-81c9-488a-9e72-ab7edebba17e None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:13.743813 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f733fea-81c9-488a-9e72-ab7edebba17e None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:13.745386 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 30/62] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:34:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:34:13.750912 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49945311-be4f-4242-b60b-9fd9b80c561e None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:13.751785 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49945311-be4f-4242-b60b-9fd9b80c561e None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:13.752264 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49945311-be4f-4242-b60b-9fd9b80c561e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:13.779135 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-49945311-be4f-4242-b60b-9fd9b80c561e None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:34:13.780649 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-49945311-be4f-4242-b60b-9fd9b80c561e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:34:13.837472 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:13.872650 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 33/63] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:34:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:34:13.919869 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f733fea-81c9-488a-9e72-ab7edebba17e None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:13.964882 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f66c2-2891-444f-a808-cc11151fd19f None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:13.965176 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f66c2-2891-444f-a808-cc11151fd19f None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:13.965466 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f66c2-2891-444f-a808-cc11151fd19f None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:13.966975 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 34/64] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:34:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:34:13.972824 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cea601-3254-42b4-9731-0cc2d32cec58 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:13.973751 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cea601-3254-42b4-9731-0cc2d32cec58 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:13.973985 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cea601-3254-42b4-9731-0cc2d32cec58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:13.999282 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-b0cea601-3254-42b4-9731-0cc2d32cec58 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:34:14.000437 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-b0cea601-3254-42b4-9731-0cc2d32cec58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:34:14.097935 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f733fea-81c9-488a-9e72-ab7edebba17e None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:14.135898 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 35/65] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:34:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:34:14.161198 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fe2534-a2e1-4cc6-aa09-e198480ac3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:14.162021 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe2534-a2e1-4cc6-aa09-e198480ac3d3 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:14.162352 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe2534-a2e1-4cc6-aa09-e198480ac3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:14.162644 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe2534-a2e1-4cc6-aa09-e198480ac3d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:14.164986 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:14.180391 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fe2534-a2e1-4cc6-aa09-e198480ac3d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:34:14.192983 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-32fe2534-a2e1-4cc6-aa09-e198480ac3d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:34:14.192983 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:34:14.192983 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:34:14.192983 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:34:14.192983 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:34:14.192983 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:34:14.192983 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:34:14.192983 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:34:14.192983 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:34:14.192983 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:34:14.192983 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:34:14.192983 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:34:14.192983 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:34:14.192983 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:34:14.192983 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:34:14.192983 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:34:14.193839 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:34:14.193839 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:34:14.193839 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:34:14.193839 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:34:14.193839 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:34:14.193839 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:34:14.193839 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:34:14.193839 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:34:14.193839 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:34:14.193839 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:34:14.193839 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:34:14.193839 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:34:14.193839 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:34:14.193839 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:34:14.193839 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:34:14.193839 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:34:14.194704 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:34:14.194704 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:34:14.194704 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:34:14.194704 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:34:14.194704 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:34:14.194704 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:34:14.194704 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:34:14.194704 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:34:14.194704 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:34:14.194704 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:34:14.194704 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:34:14.194704 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:34:14.194704 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 31/66] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Jun 22 08:34:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:34:14.200836 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cea601-3254-42b4-9731-0cc2d32cec58 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:14.213169 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fe2534-a2e1-4cc6-aa09-e198480ac3d3 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:14.324872 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fe2534-a2e1-4cc6-aa09-e198480ac3d3 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:14.330644 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cea601-3254-42b4-9731-0cc2d32cec58 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:14.333042 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:14.359861 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d20d907-fdef-404a-aace-ffe83f152732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:14.360541 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20d907-fdef-404a-aace-ffe83f152732 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:14.360827 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20d907-fdef-404a-aace-ffe83f152732 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:14.361104 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20d907-fdef-404a-aace-ffe83f152732 None admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:14.361862 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d20d907-fdef-404a-aace-ffe83f152732 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:14.362212 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d20d907-fdef-404a-aace-ffe83f152732 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:14.363684 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d20d907-fdef-404a-aace-ffe83f152732 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:14.366798 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527eb2f-a176-44fa-b07e-e6a5616750c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:14.367598 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527eb2f-a176-44fa-b07e-e6a5616750c0 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:14.367883 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527eb2f-a176-44fa-b07e-e6a5616750c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:14.368160 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527eb2f-a176-44fa-b07e-e6a5616750c0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:14.372884 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 32/67] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Jun 22 08:34:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:14.374431 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2585cb-af7b-4357-9b74-04873da63972 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:14.374732 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2585cb-af7b-4357-9b74-04873da63972 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:14.375018 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2585cb-af7b-4357-9b74-04873da63972 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:14.376434 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 33/68] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:34:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:34:14.377451 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e9565-0f8f-46be-94b2-51026ee361f0 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:14.377663 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e9565-0f8f-46be-94b2-51026ee361f0 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:14.377952 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e9565-0f8f-46be-94b2-51026ee361f0 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:14.378981 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b527eb2f-a176-44fa-b07e-e6a5616750c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:34:14.383385 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 34/69] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:34:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:34:14.383385 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d40f16-7f5d-49be-96fd-2d51146a4f4b None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:14.383385 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d40f16-7f5d-49be-96fd-2d51146a4f4b None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:14.383385 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d40f16-7f5d-49be-96fd-2d51146a4f4b None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:14.383385 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 35/70] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:34:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:34:14.383385 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d40f16-7f5d-49be-96fd-2d51146a4f4b None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:14.388726 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-b527eb2f-a176-44fa-b07e-e6a5616750c0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:34:14.388726 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:34:14.388726 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:34:14.388726 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:34:14.388726 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:34:14.388726 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:34:14.388726 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:34:14.388726 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:34:14.388726 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:34:14.388726 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:34:14.388726 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:34:14.388726 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:34:14.388726 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:34:14.388726 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:34:14.388726 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:34:14.388726 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:34:14.389564 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:34:14.389564 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:34:14.389564 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:34:14.389564 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:34:14.389564 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:34:14.389564 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:34:14.389564 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:34:14.389564 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:34:14.389564 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:34:14.389564 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:34:14.389564 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:34:14.389564 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:34:14.389564 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:34:14.389564 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:34:14.389564 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:34:14.389564 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:34:14.390338 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:34:14.390338 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:34:14.390338 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:34:14.390338 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:34:14.390338 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:34:14.390338 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:34:14.390338 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:34:14.390338 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:34:14.390338 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:34:14.390338 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:34:14.390338 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:34:14.390338 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:34:14.390338 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 36/71] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Jun 22 08:34:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:34:14.391450 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb3eac0-3e76-48a4-82f0-58150d563be4 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:14.391540 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb3eac0-3e76-48a4-82f0-58150d563be4 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:14.391796 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb3eac0-3e76-48a4-82f0-58150d563be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:14.408865 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-9fb3eac0-3e76-48a4-82f0-58150d563be4 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:34:14.410100 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-9fb3eac0-3e76-48a4-82f0-58150d563be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:34:14.444387 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:14.478071 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 37/72] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:34:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:34:14.479413 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9fb1c-43ec-4242-81a4-705d6aba1384 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:14.479703 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9fb1c-43ec-4242-81a4-705d6aba1384 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:14.479978 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9fb1c-43ec-4242-81a4-705d6aba1384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:14.496909 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-12c9fb1c-43ec-4242-81a4-705d6aba1384 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:34:14.498131 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-12c9fb1c-43ec-4242-81a4-705d6aba1384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:34:14.498898 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d40f16-7f5d-49be-96fd-2d51146a4f4b None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:14.533050 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b9066-1554-4e5c-af1a-5223be4cbbf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:14.533840 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b9066-1554-4e5c-af1a-5223be4cbbf2 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:14.534156 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b9066-1554-4e5c-af1a-5223be4cbbf2 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:14.534442 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b9066-1554-4e5c-af1a-5223be4cbbf2 None admin] PATH_INFO: `/v3/users/6ca353121b49417da331c92ca4f0c767` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:14.536213 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014b9066-1554-4e5c-af1a-5223be4cbbf2 None admin] RBAC: Authorizing `identity:get_user(user_id=6ca353121b49417da331c92ca4f0c767)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:14.537689 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014b9066-1554-4e5c-af1a-5223be4cbbf2 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:14.539403 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 36/73] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Jun 22 08:34:14 2022] GET /identity/v3/users/6ca353121b49417da331c92ca4f0c767 => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:14.540599 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daebd404-60dc-4c0b-917c-11090dd63727 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:14.540894 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daebd404-60dc-4c0b-917c-11090dd63727 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:14.541179 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daebd404-60dc-4c0b-917c-11090dd63727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:14.558246 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-daebd404-60dc-4c0b-917c-11090dd63727 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:34:14.559463 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-daebd404-60dc-4c0b-917c-11090dd63727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:34:14.566928 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 38/74] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:34:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:34:14.567786 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c9fb1c-43ec-4242-81a4-705d6aba1384 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:14.592341 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:14.632900 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 37/75] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:34:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:34:14.633931 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daebd404-60dc-4c0b-917c-11090dd63727 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:14.672219 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c9fb1c-43ec-4242-81a4-705d6aba1384 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:14.698729 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:14.711820 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b714b5c5-cd8f-4281-ac4f-1ab6e9498c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:14.712494 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714b5c5-cd8f-4281-ac4f-1ab6e9498c6f None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:14.712785 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714b5c5-cd8f-4281-ac4f-1ab6e9498c6f None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:14.713070 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714b5c5-cd8f-4281-ac4f-1ab6e9498c6f None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:14.713836 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b714b5c5-cd8f-4281-ac4f-1ab6e9498c6f None admin] RBAC: Adding query filter params (name=member) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:14.714183 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b714b5c5-cd8f-4281-ac4f-1ab6e9498c6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:14.715607 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b714b5c5-cd8f-4281-ac4f-1ab6e9498c6f None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:14.724209 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 39/76] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Jun 22 08:34:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:14.724209 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b714b5c5-cd8f-4281-ac4f-1ab6e9498c6f None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:14.743817 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daebd404-60dc-4c0b-917c-11090dd63727 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:14.778473 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81769d2-d9b1-43b2-b26a-9450fd666d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:14.779282 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81769d2-d9b1-43b2-b26a-9450fd666d39 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:14.779581 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81769d2-d9b1-43b2-b26a-9450fd666d39 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:14.779864 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81769d2-d9b1-43b2-b26a-9450fd666d39 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:14.790321 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81769d2-d9b1-43b2-b26a-9450fd666d39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:34:14.798005 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-e81769d2-d9b1-43b2-b26a-9450fd666d39 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:34:14.798005 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:34:14.798005 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:34:14.798005 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:34:14.798005 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:34:14.798005 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:34:14.798005 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:34:14.798005 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:34:14.798005 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:34:14.798005 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:34:14.798005 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:34:14.798005 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:34:14.798005 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:34:14.798005 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:34:14.798005 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:34:14.798005 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:34:14.799047 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:34:14.799047 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:34:14.799047 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:34:14.799047 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:34:14.799047 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:34:14.799047 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:34:14.799047 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:34:14.799047 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:34:14.799047 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:34:14.799047 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:34:14.799047 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:34:14.799047 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:34:14.799047 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:34:14.799047 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:34:14.799047 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:34:14.799047 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:34:14.799954 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:34:14.799954 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:34:14.799954 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:34:14.799954 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:34:14.799954 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:34:14.799954 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:34:14.799954 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:34:14.799954 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:34:14.799954 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:34:14.799954 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:34:14.799954 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:34:14.799954 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:34:14.799954 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 38/77] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Jun 22 08:34:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:34:14.800680 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81769d2-d9b1-43b2-b26a-9450fd666d39 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:14.812125 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:14.827781 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b714b5c5-cd8f-4281-ac4f-1ab6e9498c6f None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:14.861493 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c803f7a0-da63-402b-999e-c06bff2c7da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:14.862177 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803f7a0-da63-402b-999e-c06bff2c7da1 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:14.862462 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803f7a0-da63-402b-999e-c06bff2c7da1 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:14.862741 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803f7a0-da63-402b-999e-c06bff2c7da1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:14.913889 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81769d2-d9b1-43b2-b26a-9450fd666d39 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:14.928309 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:14.935697 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c803f7a0-da63-402b-999e-c06bff2c7da1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:14.935697 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c803f7a0-da63-402b-999e-c06bff2c7da1 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:14.950395 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f72b8f-f7a0-4e36-bb72-7ef8fc613712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:14.951188 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f72b8f-f7a0-4e36-bb72-7ef8fc613712 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:14.951478 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f72b8f-f7a0-4e36-bb72-7ef8fc613712 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:14.951754 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f72b8f-f7a0-4e36-bb72-7ef8fc613712 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:14.952960 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f72b8f-f7a0-4e36-bb72-7ef8fc613712 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:14.954455 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f72b8f-f7a0-4e36-bb72-7ef8fc613712 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:14.956085 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 39/78] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:34:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:14.956849 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f72b8f-f7a0-4e36-bb72-7ef8fc613712 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:15.022742 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:15.039730 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 40/79] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Jun 22 08:34:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:34:15.040591 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c803f7a0-da63-402b-999e-c06bff2c7da1 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:15.058775 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f72b8f-f7a0-4e36-bb72-7ef8fc613712 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:15.092937 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215990c3-f8e6-41f1-95e1-fb1f5ceb0bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:15.093754 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215990c3-f8e6-41f1-95e1-fb1f5ceb0bde None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:15.094043 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215990c3-f8e6-41f1-95e1-fb1f5ceb0bde None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:15.094352 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215990c3-f8e6-41f1-95e1-fb1f5ceb0bde None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:15.104726 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215990c3-f8e6-41f1-95e1-fb1f5ceb0bde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:34:15.112841 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-215990c3-f8e6-41f1-95e1-fb1f5ceb0bde None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:34:15.112841 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:34:15.112841 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:34:15.112841 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:34:15.112841 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:34:15.112841 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:34:15.112841 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:34:15.112841 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:34:15.112841 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:34:15.112841 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:34:15.112841 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:34:15.112841 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:34:15.112841 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:34:15.112841 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:34:15.112841 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:34:15.112841 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:34:15.113910 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:34:15.113910 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:34:15.113910 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:34:15.113910 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:34:15.113910 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:34:15.113910 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:34:15.113910 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:34:15.113910 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:34:15.113910 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:34:15.113910 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:34:15.113910 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:34:15.113910 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:34:15.113910 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:34:15.113910 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:34:15.113910 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:34:15.113910 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:34:15.119390 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:34:15.119390 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:34:15.119390 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:34:15.119390 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:34:15.119390 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:34:15.119390 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:34:15.119390 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:34:15.119390 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:34:15.119390 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:34:15.119390 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:34:15.119390 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:34:15.119390 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:34:15.119390 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 40/80] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Jun 22 08:34:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:34:15.119390 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215990c3-f8e6-41f1-95e1-fb1f5ceb0bde None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:15.146706 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c803f7a0-da63-402b-999e-c06bff2c7da1 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:15.158123 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:15.183738 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73edb35-7421-4969-9c7d-bf9d0719be37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:15.184615 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73edb35-7421-4969-9c7d-bf9d0719be37 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:15.184900 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73edb35-7421-4969-9c7d-bf9d0719be37 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:15.185179 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73edb35-7421-4969-9c7d-bf9d0719be37 None admin] PATH_INFO: `/v3/users/df27ddfb34374fed99b8b5d643046079` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:15.198943 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73edb35-7421-4969-9c7d-bf9d0719be37 None admin] RBAC: Authorizing `identity:get_user(user_id=df27ddfb34374fed99b8b5d643046079)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:15.200412 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73edb35-7421-4969-9c7d-bf9d0719be37 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:15.202303 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 41/81] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Jun 22 08:34:15 2022] GET /identity/v3/users/df27ddfb34374fed99b8b5d643046079 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:15.202876 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73edb35-7421-4969-9c7d-bf9d0719be37 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:15.218223 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215990c3-f8e6-41f1-95e1-fb1f5ceb0bde None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:15.249899 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:15.250967 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3950f-d4a2-4635-a90e-52004d19ae57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:15.251637 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3950f-d4a2-4635-a90e-52004d19ae57 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:15.251915 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3950f-d4a2-4635-a90e-52004d19ae57 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:15.252199 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3950f-d4a2-4635-a90e-52004d19ae57 None admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:15.252964 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af3950f-d4a2-4635-a90e-52004d19ae57 None admin] RBAC: Adding query filter params (name=member) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:15.253283 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af3950f-d4a2-4635-a90e-52004d19ae57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:15.255379 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af3950f-d4a2-4635-a90e-52004d19ae57 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:15.264096 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 41/82] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Jun 22 08:34:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:15.264945 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3950f-d4a2-4635-a90e-52004d19ae57 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:15.310592 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73edb35-7421-4969-9c7d-bf9d0719be37 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:15.355210 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad33f6c-8bfd-4567-965c-5023e96989fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:15.355890 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad33f6c-8bfd-4567-965c-5023e96989fa None admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:15.356192 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad33f6c-8bfd-4567-965c-5023e96989fa None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:15.356473 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad33f6c-8bfd-4567-965c-5023e96989fa None admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:15.357206 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad33f6c-8bfd-4567-965c-5023e96989fa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:15.358721 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad33f6c-8bfd-4567-965c-5023e96989fa None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:15.367619 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3950f-d4a2-4635-a90e-52004d19ae57 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:15.369982 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:15.378749 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 42/83] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Jun 22 08:34:15 2022] POST /identity/v3/users => generated 289 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:34:15.382324 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad33f6c-8bfd-4567-965c-5023e96989fa None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:15.414588 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db030338-536f-4998-ac47-c50b4f762ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:15.415484 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db030338-536f-4998-ac47-c50b4f762ab9 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:15.415776 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db030338-536f-4998-ac47-c50b4f762ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:15.416066 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db030338-536f-4998-ac47-c50b4f762ab9 None admin] PATH_INFO: `/v3/projects/68c923ae1ea74d589e86978e4dd415c2` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:15.417405 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db030338-536f-4998-ac47-c50b4f762ab9 None admin] RBAC: Authorizing `identity:get_project(project_id=68c923ae1ea74d589e86978e4dd415c2)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:15.418946 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db030338-536f-4998-ac47-c50b4f762ab9 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:15.420749 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 42/84] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Jun 22 08:34:15 2022] GET /identity/v3/projects/68c923ae1ea74d589e86978e4dd415c2 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:15.421552 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db030338-536f-4998-ac47-c50b4f762ab9 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:15.507345 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:15.511019 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad33f6c-8bfd-4567-965c-5023e96989fa None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:15.536944 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db030338-536f-4998-ac47-c50b4f762ab9 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:15.555238 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c441b-c78a-4810-847e-349a6b560536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:15.555921 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c441b-c78a-4810-847e-349a6b560536 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:15.556207 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c441b-c78a-4810-847e-349a6b560536 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:15.556484 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c441b-c78a-4810-847e-349a6b560536 None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:15.557750 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200c441b-c78a-4810-847e-349a6b560536 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:15.557750 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200c441b-c78a-4810-847e-349a6b560536 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:15.559012 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200c441b-c78a-4810-847e-349a6b560536 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:15.567880 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 43/85] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Jun 22 08:34:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:15.568653 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c441b-c78a-4810-847e-349a6b560536 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:15.581943 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b66c0bd-ff19-4e23-87e1-7dd12cde9d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:15.583176 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66c0bd-ff19-4e23-87e1-7dd12cde9d42 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:15.583465 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66c0bd-ff19-4e23-87e1-7dd12cde9d42 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:15.583746 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66c0bd-ff19-4e23-87e1-7dd12cde9d42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:15.635999 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:15.675033 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b66c0bd-ff19-4e23-87e1-7dd12cde9d42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:15.676630 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b66c0bd-ff19-4e23-87e1-7dd12cde9d42 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:15.695767 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c441b-c78a-4810-847e-349a6b560536 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:15.742222 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5acde-0f6c-4935-ba82-3d0176e1540a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:15.743596 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5acde-0f6c-4935-ba82-3d0176e1540a None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:15.743896 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5acde-0f6c-4935-ba82-3d0176e1540a None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:15.744186 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5acde-0f6c-4935-ba82-3d0176e1540a None admin] PATH_INFO: `/v3/users/df27ddfb34374fed99b8b5d643046079` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:15.745742 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a5acde-0f6c-4935-ba82-3d0176e1540a None admin] RBAC: Authorizing `identity:get_user(user_id=df27ddfb34374fed99b8b5d643046079)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:15.747790 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a5acde-0f6c-4935-ba82-3d0176e1540a None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:15.750203 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 44/86] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Jun 22 08:34:15 2022] GET /identity/v3/users/df27ddfb34374fed99b8b5d643046079 => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:15.755425 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5acde-0f6c-4935-ba82-3d0176e1540a None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:15.791994 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:15.805182 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 43/87] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Jun 22 08:34:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:34:15.805876 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b66c0bd-ff19-4e23-87e1-7dd12cde9d42 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:15.874181 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5acde-0f6c-4935-ba82-3d0176e1540a None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:15.911190 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863e05b5-d6b0-4e26-b1c4-c6f21f68434c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:15.912177 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e05b5-d6b0-4e26-b1c4-c6f21f68434c None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:15.912638 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e05b5-d6b0-4e26-b1c4-c6f21f68434c None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:15.913096 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e05b5-d6b0-4e26-b1c4-c6f21f68434c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:15.914127 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863e05b5-d6b0-4e26-b1c4-c6f21f68434c None admin] RBAC: Adding query filter params (role.id=c7518e0f532945af80c33860f2ac506d, scope.project.id=68c923ae1ea74d589e86978e4dd415c2, user.id=6ca353121b49417da331c92ca4f0c767) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:15.914644 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863e05b5-d6b0-4e26-b1c4-c6f21f68434c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:15.916376 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863e05b5-d6b0-4e26-b1c4-c6f21f68434c None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:15.923023 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 45/88] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Jun 22 08:34:15 2022] GET /identity/v3/role_assignments?user.id=6ca353121b49417da331c92ca4f0c767&scope.project.id=68c923ae1ea74d589e86978e4dd415c2&role.id=c7518e0f532945af80c33860f2ac506d => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:15.924115 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863e05b5-d6b0-4e26-b1c4-c6f21f68434c None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:15.924578 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:15.936875 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b66c0bd-ff19-4e23-87e1-7dd12cde9d42 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:16.031857 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af71c889-3e99-4a93-9f90-fb745afafa66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:16.032772 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71c889-3e99-4a93-9f90-fb745afafa66 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:16.033059 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71c889-3e99-4a93-9f90-fb745afafa66 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:16.033337 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71c889-3e99-4a93-9f90-fb745afafa66 None admin] PATH_INFO: `/v3/users/df27ddfb34374fed99b8b5d643046079` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:16.043111 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af71c889-3e99-4a93-9f90-fb745afafa66 None admin] RBAC: Authorizing `identity:get_user(user_id=df27ddfb34374fed99b8b5d643046079)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:16.044603 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af71c889-3e99-4a93-9f90-fb745afafa66 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:16.046572 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 44/89] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Jun 22 08:34:15 2022] GET /identity/v3/users/df27ddfb34374fed99b8b5d643046079 => generated 275 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:16.047759 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af71c889-3e99-4a93-9f90-fb745afafa66 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:16.081223 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:16.089729 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863e05b5-d6b0-4e26-b1c4-c6f21f68434c None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:16.141407 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eba3958-d92d-4b87-b94c-e0afd4158b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:16.142370 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba3958-d92d-4b87-b94c-e0afd4158b91 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:16.142682 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba3958-d92d-4b87-b94c-e0afd4158b91 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:16.142972 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba3958-d92d-4b87-b94c-e0afd4158b91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:16.220533 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af71c889-3e99-4a93-9f90-fb745afafa66 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:16.240277 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eba3958-d92d-4b87-b94c-e0afd4158b91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:16.242266 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eba3958-d92d-4b87-b94c-e0afd4158b91 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:16.284643 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246553ca-6e6a-427b-ac17-2a1f48579b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:16.286572 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246553ca-6e6a-427b-ac17-2a1f48579b45 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:16.287158 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246553ca-6e6a-427b-ac17-2a1f48579b45 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:16.287633 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246553ca-6e6a-427b-ac17-2a1f48579b45 None admin] PATH_INFO: `/v3/projects/68c923ae1ea74d589e86978e4dd415c2` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:16.291014 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246553ca-6e6a-427b-ac17-2a1f48579b45 None admin] RBAC: Authorizing `identity:get_project(project_id=68c923ae1ea74d589e86978e4dd415c2)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:16.292827 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246553ca-6e6a-427b-ac17-2a1f48579b45 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:16.294871 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 45/90] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Jun 22 08:34:16 2022] GET /identity/v3/projects/68c923ae1ea74d589e86978e4dd415c2 => generated 298 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:16.295879 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246553ca-6e6a-427b-ac17-2a1f48579b45 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:16.317043 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:16.368704 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:16.377787 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 46/91] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Jun 22 08:34:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:34:16.379286 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eba3958-d92d-4b87-b94c-e0afd4158b91 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:16.461954 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246553ca-6e6a-427b-ac17-2a1f48579b45 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:16.505111 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1581ca41-fbe5-42fb-a479-e079e234617a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:16.506160 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1581ca41-fbe5-42fb-a479-e079e234617a None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:16.506658 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1581ca41-fbe5-42fb-a479-e079e234617a None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:16.507637 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1581ca41-fbe5-42fb-a479-e079e234617a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:16.630988 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1581ca41-fbe5-42fb-a479-e079e234617a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:16.632857 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1581ca41-fbe5-42fb-a479-e079e234617a None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:16.635244 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eba3958-d92d-4b87-b94c-e0afd4158b91 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:16.658032 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:16.710992 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953c45e2-7da4-4c8b-b204-950192d3cd68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:16.712255 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c45e2-7da4-4c8b-b204-950192d3cd68 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:16.713879 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c45e2-7da4-4c8b-b204-950192d3cd68 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:16.714403 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c45e2-7da4-4c8b-b204-950192d3cd68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:16.719787 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953c45e2-7da4-4c8b-b204-950192d3cd68 None admin] RBAC: Adding query filter params (role.id=5ea101070f734fa59995615179f2eff2, scope.project.id=68c923ae1ea74d589e86978e4dd415c2, user.id=df27ddfb34374fed99b8b5d643046079) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:16.720385 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953c45e2-7da4-4c8b-b204-950192d3cd68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:16.722203 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953c45e2-7da4-4c8b-b204-950192d3cd68 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:16.733473 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 47/92] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Jun 22 08:34:16 2022] GET /identity/v3/role_assignments?user.id=df27ddfb34374fed99b8b5d643046079&scope.project.id=68c923ae1ea74d589e86978e4dd415c2&role.id=5ea101070f734fa59995615179f2eff2 => generated 259 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:16.734852 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953c45e2-7da4-4c8b-b204-950192d3cd68 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:16.836330 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 46/93] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Jun 22 08:34:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:34:16.843919 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1581ca41-fbe5-42fb-a479-e079e234617a None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:16.910519 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:16.982093 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1581ca41-fbe5-42fb-a479-e079e234617a None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:16.998619 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:17.041739 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae1dd3d-4e09-48d5-a1af-441aae871d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:17.043486 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1dd3d-4e09-48d5-a1af-441aae871d34 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:17.049992 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1dd3d-4e09-48d5-a1af-441aae871d34 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:17.050754 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1dd3d-4e09-48d5-a1af-441aae871d34 None admin] PATH_INFO: `/v3/projects/68c923ae1ea74d589e86978e4dd415c2` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:17.053024 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae1dd3d-4e09-48d5-a1af-441aae871d34 None admin] RBAC: Authorizing `identity:get_project(project_id=68c923ae1ea74d589e86978e4dd415c2)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:17.054798 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae1dd3d-4e09-48d5-a1af-441aae871d34 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:17.057026 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 47/94] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Jun 22 08:34:16 2022] GET /identity/v3/projects/68c923ae1ea74d589e86978e4dd415c2 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:17.063039 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae1dd3d-4e09-48d5-a1af-441aae871d34 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:17.084140 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953c45e2-7da4-4c8b-b204-950192d3cd68 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:17.190200 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae1dd3d-4e09-48d5-a1af-441aae871d34 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:17.206874 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76306d2a-f20c-4d1b-901d-a52679aa08be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:17.208264 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76306d2a-f20c-4d1b-901d-a52679aa08be None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:17.208549 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76306d2a-f20c-4d1b-901d-a52679aa08be None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:17.208823 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76306d2a-f20c-4d1b-901d-a52679aa08be None admin] PATH_INFO: `/v3/projects/c3d685c0c2b54c219d4a2ff337bdc18e` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:17.210101 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76306d2a-f20c-4d1b-901d-a52679aa08be None admin] RBAC: Authorizing `identity:get_project(project_id=c3d685c0c2b54c219d4a2ff337bdc18e)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:17.211568 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76306d2a-f20c-4d1b-901d-a52679aa08be None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:17.213288 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 48/95] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Jun 22 08:34:16 2022] GET /identity/v3/projects/c3d685c0c2b54c219d4a2ff337bdc18e => generated 312 bytes in 479 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:17.218979 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76306d2a-f20c-4d1b-901d-a52679aa08be None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:17.232865 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe04f22-57d7-42fb-92a2-d36e78c2608a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:17.233876 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe04f22-57d7-42fb-92a2-d36e78c2608a None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:17.234399 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe04f22-57d7-42fb-92a2-d36e78c2608a None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:17.234931 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe04f22-57d7-42fb-92a2-d36e78c2608a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:17.236398 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe04f22-57d7-42fb-92a2-d36e78c2608a None admin] RBAC: Adding query filter params (role.id=a92b520fb33f4333aad569d98be2bd7e, scope.project.id=68c923ae1ea74d589e86978e4dd415c2, user.id=df27ddfb34374fed99b8b5d643046079) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:17.236951 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe04f22-57d7-42fb-92a2-d36e78c2608a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:17.239180 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe04f22-57d7-42fb-92a2-d36e78c2608a None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:17.246155 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 48/96] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Jun 22 08:34:17 2022] GET /identity/v3/role_assignments?user.id=df27ddfb34374fed99b8b5d643046079&scope.project.id=68c923ae1ea74d589e86978e4dd415c2&role.id=a92b520fb33f4333aad569d98be2bd7e => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:34:17.412060 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76306d2a-f20c-4d1b-901d-a52679aa08be None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:17.450719 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:17.468907 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4564d7eb-56e2-490f-82fc-55bcd2ac42c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:17.469606 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4564d7eb-56e2-490f-82fc-55bcd2ac42c9 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:17.469900 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4564d7eb-56e2-490f-82fc-55bcd2ac42c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:17.470210 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4564d7eb-56e2-490f-82fc-55bcd2ac42c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:17.471085 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4564d7eb-56e2-490f-82fc-55bcd2ac42c9 None admin] RBAC: Adding query filter params (role.id=5ea101070f734fa59995615179f2eff2, scope.project.id=c3d685c0c2b54c219d4a2ff337bdc18e, user.id=df27ddfb34374fed99b8b5d643046079) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:17.471407 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4564d7eb-56e2-490f-82fc-55bcd2ac42c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:17.473526 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4564d7eb-56e2-490f-82fc-55bcd2ac42c9 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:17.480421 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 49/97] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Jun 22 08:34:17 2022] GET /identity/v3/role_assignments?user.id=df27ddfb34374fed99b8b5d643046079&scope.project.id=c3d685c0c2b54c219d4a2ff337bdc18e&role.id=5ea101070f734fa59995615179f2eff2 => generated 259 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:34:17.876552 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd41ad4-162b-434b-9277-abc691da5017 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:17.877082 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd41ad4-162b-434b-9277-abc691da5017 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:17.877082 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd41ad4-162b-434b-9277-abc691da5017 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:17.878680 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 49/98] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:34:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:34:17.891658 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716f9ce-c3c5-45b7-8ac3-8787dd09c213 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:17.891957 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716f9ce-c3c5-45b7-8ac3-8787dd09c213 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:17.892250 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716f9ce-c3c5-45b7-8ac3-8787dd09c213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:17.919139 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-8716f9ce-c3c5-45b7-8ac3-8787dd09c213 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:34:17.920477 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-8716f9ce-c3c5-45b7-8ac3-8787dd09c213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:34:18.020575 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 50/99] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:34:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:34:18.068793 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd41ad4-162b-434b-9277-abc691da5017 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:18.125691 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:18.195936 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd41ad4-162b-434b-9277-abc691da5017 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:18.241300 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26640cc2-0758-4194-9195-3b88bb6715bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:18.242162 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26640cc2-0758-4194-9195-3b88bb6715bd None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:18.242465 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26640cc2-0758-4194-9195-3b88bb6715bd None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:18.242755 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26640cc2-0758-4194-9195-3b88bb6715bd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:18.255303 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26640cc2-0758-4194-9195-3b88bb6715bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:34:18.272761 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-26640cc2-0758-4194-9195-3b88bb6715bd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 08:34:18.272761 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:34:18.272761 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:34:18.272761 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:34:18.272761 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:34:18.272761 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:34:18.272761 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:34:18.272761 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:34:18.272761 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:34:18.272761 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:34:18.272761 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:34:18.272761 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:34:18.272761 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:34:18.272761 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:34:18.272761 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:34:18.272761 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:34:18.273660 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:34:18.273660 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:34:18.273660 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:34:18.273660 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:34:18.273660 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:34:18.273660 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:34:18.273660 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:34:18.273660 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:34:18.273660 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:34:18.273660 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:34:18.273660 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:34:18.273660 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:34:18.273660 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:34:18.273660 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:34:18.273660 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:34:18.273660 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:34:18.274434 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:34:18.274434 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:34:18.274434 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:34:18.274434 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:34:18.274434 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:34:18.274434 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:34:18.274434 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:34:18.274434 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:34:18.274434 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:34:18.274434 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:34:18.274434 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 08:34:18.274434 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:34:18.274434 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 50/100] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Jun 22 08:34:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:34:18.283322 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716f9ce-c3c5-45b7-8ac3-8787dd09c213 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:18.437273 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc69c4-e022-46fc-8508-d05222c7b01d None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:18.437590 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc69c4-e022-46fc-8508-d05222c7b01d None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:18.437856 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc69c4-e022-46fc-8508-d05222c7b01d None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:18.439477 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 51/101] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:34:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:34:18.444763 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08971c66-1b3d-4842-985e-93fca87b02f7 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:18.445063 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08971c66-1b3d-4842-985e-93fca87b02f7 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:18.445354 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08971c66-1b3d-4842-985e-93fca87b02f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:18.459926 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716f9ce-c3c5-45b7-8ac3-8787dd09c213 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:18.463598 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-08971c66-1b3d-4842-985e-93fca87b02f7 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:34:18.464817 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-08971c66-1b3d-4842-985e-93fca87b02f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:34:18.490561 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:18.521300 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396beef-d21f-4007-aeb8-655d2489dae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:18.521994 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396beef-d21f-4007-aeb8-655d2489dae8 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:18.522303 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396beef-d21f-4007-aeb8-655d2489dae8 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:18.522583 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396beef-d21f-4007-aeb8-655d2489dae8 None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:18.523350 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2396beef-d21f-4007-aeb8-655d2489dae8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:18.523663 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2396beef-d21f-4007-aeb8-655d2489dae8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:18.525080 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2396beef-d21f-4007-aeb8-655d2489dae8 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:18.534346 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 51/102] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Jun 22 08:34:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:18.540392 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396beef-d21f-4007-aeb8-655d2489dae8 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:18.578335 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 52/103] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:34:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:34:18.663147 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08971c66-1b3d-4842-985e-93fca87b02f7 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:18.669222 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396beef-d21f-4007-aeb8-655d2489dae8 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:18.706115 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99767da4-690f-49b5-bad8-3b556c7619cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:18.707020 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99767da4-690f-49b5-bad8-3b556c7619cf None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:18.707342 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99767da4-690f-49b5-bad8-3b556c7619cf None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:18.707630 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99767da4-690f-49b5-bad8-3b556c7619cf None admin] PATH_INFO: `/v3/users/424948f8f3e8434dae1ee2753fa22bd4` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:18.724635 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99767da4-690f-49b5-bad8-3b556c7619cf None admin] RBAC: Authorizing `identity:get_user(user_id=424948f8f3e8434dae1ee2753fa22bd4)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:18.726613 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99767da4-690f-49b5-bad8-3b556c7619cf None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:18.728589 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 52/104] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Jun 22 08:34:18 2022] GET /identity/v3/users/424948f8f3e8434dae1ee2753fa22bd4 => generated 289 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:34:18.733927 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99767da4-690f-49b5-bad8-3b556c7619cf None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:18.734546 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:18.780129 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:18.843464 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99767da4-690f-49b5-bad8-3b556c7619cf None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:18.860036 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08971c66-1b3d-4842-985e-93fca87b02f7 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:18.881084 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1685b6d4-19e3-4a64-b70b-608c0cb0b3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:18.881746 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1685b6d4-19e3-4a64-b70b-608c0cb0b3d5 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:18.882036 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1685b6d4-19e3-4a64-b70b-608c0cb0b3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:18.882347 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1685b6d4-19e3-4a64-b70b-608c0cb0b3d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:18.925634 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129cb8ad-b26b-4a7e-87c6-e43fd61b9832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:18.927145 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129cb8ad-b26b-4a7e-87c6-e43fd61b9832 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:18.927439 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129cb8ad-b26b-4a7e-87c6-e43fd61b9832 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:18.929007 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129cb8ad-b26b-4a7e-87c6-e43fd61b9832 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:18.929007 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129cb8ad-b26b-4a7e-87c6-e43fd61b9832 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:18.930592 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129cb8ad-b26b-4a7e-87c6-e43fd61b9832 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:18.932261 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 53/105] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:34:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:18.937886 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129cb8ad-b26b-4a7e-87c6-e43fd61b9832 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:18.956464 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1685b6d4-19e3-4a64-b70b-608c0cb0b3d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:18.958607 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1685b6d4-19e3-4a64-b70b-608c0cb0b3d5 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:19.003441 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:19.071983 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 53/106] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Jun 22 08:34:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:34:19.073355 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c79ff-7f16-4396-967e-2674a5c2d3a2 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:19.073649 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c79ff-7f16-4396-967e-2674a5c2d3a2 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:19.073935 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c79ff-7f16-4396-967e-2674a5c2d3a2 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:19.079743 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 54/107] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:34:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:34:19.081201 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3c79ff-7f16-4396-967e-2674a5c2d3a2 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:19.084543 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:19.089400 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129cb8ad-b26b-4a7e-87c6-e43fd61b9832 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:19.133609 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf1c099-90a6-4ac3-bb29-3303b830b7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:19.134326 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf1c099-90a6-4ac3-bb29-3303b830b7db None admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:19.134621 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf1c099-90a6-4ac3-bb29-3303b830b7db None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:19.134908 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf1c099-90a6-4ac3-bb29-3303b830b7db None admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:19.135651 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf1c099-90a6-4ac3-bb29-3303b830b7db None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:19.137273 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf1c099-90a6-4ac3-bb29-3303b830b7db None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:19.189112 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 54/108] 10.222.0.42 () {60 vars in 1141 bytes} [Wed Jun 22 08:34:18 2022] POST /identity/v3/projects => generated 302 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 08:34:19.190625 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33d28e-2be5-4bea-8235-a8795b73777f None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:19.190925 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33d28e-2be5-4bea-8235-a8795b73777f None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:19.191216 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33d28e-2be5-4bea-8235-a8795b73777f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:19.234711 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-7e33d28e-2be5-4bea-8235-a8795b73777f None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:34:19.238390 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-7e33d28e-2be5-4bea-8235-a8795b73777f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:34:19.256789 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3c79ff-7f16-4396-967e-2674a5c2d3a2 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:19.347499 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6939e38d-dd8d-42ac-b4c5-c85726932ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:19.349348 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939e38d-dd8d-42ac-b4c5-c85726932ce1 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:19.349864 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939e38d-dd8d-42ac-b4c5-c85726932ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:19.350388 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939e38d-dd8d-42ac-b4c5-c85726932ce1 None admin] PATH_INFO: `/v3/projects/68c923ae1ea74d589e86978e4dd415c2` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:19.351906 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6939e38d-dd8d-42ac-b4c5-c85726932ce1 None admin] RBAC: Authorizing `identity:get_project(project_id=68c923ae1ea74d589e86978e4dd415c2)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:19.353594 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6939e38d-dd8d-42ac-b4c5-c85726932ce1 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:19.355572 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 55/109] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Jun 22 08:34:19 2022] GET /identity/v3/projects/68c923ae1ea74d589e86978e4dd415c2 => generated 298 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:19.372303 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6939e38d-dd8d-42ac-b4c5-c85726932ce1 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:19.382443 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 55/110] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:34:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:34:19.389689 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:19.418056 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e33d28e-2be5-4bea-8235-a8795b73777f None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:19.519484 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:19.542679 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e33d28e-2be5-4bea-8235-a8795b73777f None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:19.547326 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6939e38d-dd8d-42ac-b4c5-c85726932ce1 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:19.585649 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c7e89f-c3b5-48e0-908f-ef99beafa348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:19.586528 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7e89f-c3b5-48e0-908f-ef99beafa348 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:19.586820 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7e89f-c3b5-48e0-908f-ef99beafa348 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:19.587106 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7e89f-c3b5-48e0-908f-ef99beafa348 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:19.588938 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10092a71-144c-4032-ba42-69aa8425f454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:19.589996 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10092a71-144c-4032-ba42-69aa8425f454 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:19.590797 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10092a71-144c-4032-ba42-69aa8425f454 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:19.591094 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10092a71-144c-4032-ba42-69aa8425f454 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:19.592036 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10092a71-144c-4032-ba42-69aa8425f454 None admin] RBAC: Adding query filter params (role.id=78088ffb8c224af39e594570dd740336, scope.project.id=68c923ae1ea74d589e86978e4dd415c2, user.id=424948f8f3e8434dae1ee2753fa22bd4) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:19.592357 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10092a71-144c-4032-ba42-69aa8425f454 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:19.594221 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10092a71-144c-4032-ba42-69aa8425f454 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:19.601976 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c7e89f-c3b5-48e0-908f-ef99beafa348 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:34:19.603068 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 56/111] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Jun 22 08:34:19 2022] GET /identity/v3/role_assignments?user.id=424948f8f3e8434dae1ee2753fa22bd4&scope.project.id=68c923ae1ea74d589e86978e4dd415c2&role.id=78088ffb8c224af39e594570dd740336 => generated 259 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:19.604284 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9171bda-b426-4fc9-adee-156c10231d5d None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:19.604579 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9171bda-b426-4fc9-adee-156c10231d5d None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:19.604922 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9171bda-b426-4fc9-adee-156c10231d5d None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:19.609890 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-a4c7e89f-c3b5-48e0-908f-ef99beafa348 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:34:19.609890 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:34:19.609890 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:34:19.609890 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:34:19.609890 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:34:19.609890 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:34:19.609890 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:34:19.609890 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:34:19.609890 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:34:19.609890 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:34:19.609890 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:34:19.609890 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:34:19.609890 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:34:19.609890 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:34:19.609890 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:34:19.609890 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:34:19.610789 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:34:19.610789 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:34:19.610789 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:34:19.610789 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:34:19.610789 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:34:19.610789 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:34:19.610789 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:34:19.610789 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:34:19.610789 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:34:19.610789 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:34:19.610789 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:34:19.610789 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:34:19.610789 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:34:19.610789 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:34:19.610789 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:34:19.610789 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:34:19.611529 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:34:19.611529 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:34:19.611529 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:34:19.611529 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:34:19.611529 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:34:19.611529 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:34:19.611529 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:34:19.611529 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:34:19.611529 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:34:19.611529 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:34:19.611529 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:34:19.611529 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:34:19.612081 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 57/112] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:34:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:34:19.612147 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 56/113] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Jun 22 08:34:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:34:19.617905 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9171bda-b426-4fc9-adee-156c10231d5d None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:19.618659 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f061d60-d9f9-4433-8daa-78272778a8a5 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:19.618966 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f061d60-d9f9-4433-8daa-78272778a8a5 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:19.619251 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f061d60-d9f9-4433-8daa-78272778a8a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:19.658782 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-2f061d60-d9f9-4433-8daa-78272778a8a5 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:34:19.660030 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-2f061d60-d9f9-4433-8daa-78272778a8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:34:19.754488 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:19.781109 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9171bda-b426-4fc9-adee-156c10231d5d None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:19.856106 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 57/114] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:34:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 22 08:34:19.857270 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc78ca8a-3c85-4423-9948-f378c3687525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:19.857971 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78ca8a-3c85-4423-9948-f378c3687525 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:19.858288 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78ca8a-3c85-4423-9948-f378c3687525 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:19.858573 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78ca8a-3c85-4423-9948-f378c3687525 None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:19.859350 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc78ca8a-3c85-4423-9948-f378c3687525 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:19.859670 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc78ca8a-3c85-4423-9948-f378c3687525 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:19.861077 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc78ca8a-3c85-4423-9948-f378c3687525 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:19.876013 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 58/115] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Jun 22 08:34:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:19.887284 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f061d60-d9f9-4433-8daa-78272778a8a5 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:19.916070 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc78ca8a-3c85-4423-9948-f378c3687525 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:20.100522 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc78ca8a-3c85-4423-9948-f378c3687525 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:20.101577 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:20.170907 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e0d326-d011-4c62-be62-125ae26288d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:20.171990 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0d326-d011-4c62-be62-125ae26288d3 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:20.172431 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0d326-d011-4c62-be62-125ae26288d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:20.172863 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0d326-d011-4c62-be62-125ae26288d3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:20.175265 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:20.193660 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f061d60-d9f9-4433-8daa-78272778a8a5 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:20.197208 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e0d326-d011-4c62-be62-125ae26288d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:34:20.209387 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-f8e0d326-d011-4c62-be62-125ae26288d3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:34:20.209387 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:34:20.209387 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:34:20.209387 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:34:20.209387 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:34:20.209387 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:34:20.209387 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:34:20.209387 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:34:20.209387 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:34:20.209387 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:34:20.209387 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:34:20.209387 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:34:20.209387 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:34:20.209387 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:34:20.209387 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:34:20.209387 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:34:20.210377 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:34:20.210377 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:34:20.210377 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:34:20.210377 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:34:20.210377 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:34:20.210377 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:34:20.210377 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:34:20.210377 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:34:20.210377 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:34:20.210377 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:34:20.210377 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:34:20.210377 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:34:20.210377 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:34:20.210377 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:34:20.210377 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:34:20.210377 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:34:20.211198 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:34:20.211198 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:34:20.211198 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:34:20.211198 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:34:20.211198 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:34:20.211198 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:34:20.211198 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:34:20.211198 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:34:20.211198 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:34:20.211198 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:34:20.211198 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:34:20.211198 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:34:20.213773 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 59/116] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Jun 22 08:34:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:34:20.220000 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e0d326-d011-4c62-be62-125ae26288d3 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:20.304374 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82faa7b-ec54-4fd3-9aea-a2d03d2e7cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:20.305322 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82faa7b-ec54-4fd3-9aea-a2d03d2e7cbb None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:20.305615 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82faa7b-ec54-4fd3-9aea-a2d03d2e7cbb None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:20.305899 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82faa7b-ec54-4fd3-9aea-a2d03d2e7cbb None admin] PATH_INFO: `/v3/users/6ca353121b49417da331c92ca4f0c767` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:20.308603 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82faa7b-ec54-4fd3-9aea-a2d03d2e7cbb None admin] RBAC: Authorizing `identity:get_user(user_id=6ca353121b49417da331c92ca4f0c767)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:20.310102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82faa7b-ec54-4fd3-9aea-a2d03d2e7cbb None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:20.321025 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 58/117] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Jun 22 08:34:19 2022] GET /identity/v3/users/6ca353121b49417da331c92ca4f0c767 => generated 247 bytes in 434 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:20.337844 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82faa7b-ec54-4fd3-9aea-a2d03d2e7cbb None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:20.432518 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e0d326-d011-4c62-be62-125ae26288d3 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:20.490108 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af98a4c8-4f2d-456c-9f41-3b0ea2078aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:20.494588 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98a4c8-4f2d-456c-9f41-3b0ea2078aed None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:20.495460 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98a4c8-4f2d-456c-9f41-3b0ea2078aed None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:20.495953 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98a4c8-4f2d-456c-9f41-3b0ea2078aed None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:20.496980 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af98a4c8-4f2d-456c-9f41-3b0ea2078aed None admin] RBAC: Adding query filter params (name=member) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:20.497503 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af98a4c8-4f2d-456c-9f41-3b0ea2078aed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:20.499183 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af98a4c8-4f2d-456c-9f41-3b0ea2078aed None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:20.509045 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 60/118] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Jun 22 08:34:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:34:20.515008 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2d689-5f01-4a6f-b639-31cc4f01f9c2 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:20.515592 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2d689-5f01-4a6f-b639-31cc4f01f9c2 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:20.516105 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2d689-5f01-4a6f-b639-31cc4f01f9c2 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:20.517687 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 61/119] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:34:20 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:34:20.518224 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82faa7b-ec54-4fd3-9aea-a2d03d2e7cbb None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:20.518957 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2d689-5f01-4a6f-b639-31cc4f01f9c2 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:20.558983 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c00fc5-3e6b-4228-aac0-3c0530c98d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:20.561772 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c00fc5-3e6b-4228-aac0-3c0530c98d10 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:20.561772 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c00fc5-3e6b-4228-aac0-3c0530c98d10 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:20.561950 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c00fc5-3e6b-4228-aac0-3c0530c98d10 None admin] PATH_INFO: `/v3/projects/68c923ae1ea74d589e86978e4dd415c2` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:20.565672 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c00fc5-3e6b-4228-aac0-3c0530c98d10 None admin] RBAC: Authorizing `identity:get_project(project_id=68c923ae1ea74d589e86978e4dd415c2)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:20.570273 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c00fc5-3e6b-4228-aac0-3c0530c98d10 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:20.573898 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 59/120] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Jun 22 08:34:20 2022] GET /identity/v3/projects/68c923ae1ea74d589e86978e4dd415c2 => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:34:20.575124 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a67fe-6c39-4124-bdab-ddc4d5fd82f7 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:20.575329 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a67fe-6c39-4124-bdab-ddc4d5fd82f7 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:20.575613 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a67fe-6c39-4124-bdab-ddc4d5fd82f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:20.603928 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:20.617560 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-9d7a67fe-6c39-4124-bdab-ddc4d5fd82f7 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:34:20.618836 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-9d7a67fe-6c39-4124-bdab-ddc4d5fd82f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:34:20.626491 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:20.684695 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2d689-5f01-4a6f-b639-31cc4f01f9c2 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:20.705770 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 60/121] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:34:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:34:20.707741 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a67fe-6c39-4124-bdab-ddc4d5fd82f7 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:20.742554 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1af787-2b46-4eb6-aadb-7c69e14b5721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:20.743463 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1af787-2b46-4eb6-aadb-7c69e14b5721 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:20.743757 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1af787-2b46-4eb6-aadb-7c69e14b5721 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:20.744094 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1af787-2b46-4eb6-aadb-7c69e14b5721 None admin] PATH_INFO: `/v3/users/df27ddfb34374fed99b8b5d643046079` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:20.745506 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1af787-2b46-4eb6-aadb-7c69e14b5721 None admin] RBAC: Authorizing `identity:get_user(user_id=df27ddfb34374fed99b8b5d643046079)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:20.747442 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1af787-2b46-4eb6-aadb-7c69e14b5721 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:20.749134 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 62/122] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Jun 22 08:34:20 2022] GET /identity/v3/users/df27ddfb34374fed99b8b5d643046079 => generated 275 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:20.750423 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087edb26-468b-4098-96f4-f9751b843b88 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:20.750720 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087edb26-468b-4098-96f4-f9751b843b88 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:20.751008 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087edb26-468b-4098-96f4-f9751b843b88 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:20.752339 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 63/123] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:34:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:34:20.753041 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087edb26-468b-4098-96f4-f9751b843b88 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:20.817794 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a67fe-6c39-4124-bdab-ddc4d5fd82f7 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:20.854719 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0145fcc-7c9b-424f-b3c5-266e1af9893e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:20.856008 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0145fcc-7c9b-424f-b3c5-266e1af9893e None admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:20.856514 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0145fcc-7c9b-424f-b3c5-266e1af9893e None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:20.856994 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0145fcc-7c9b-424f-b3c5-266e1af9893e None admin] PATH_INFO: `/v3/projects/68c923ae1ea74d589e86978e4dd415c2/users/6ca353121b49417da331c92ca4f0c767/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:20.859304 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0145fcc-7c9b-424f-b3c5-266e1af9893e None admin] RBAC: Authorizing `identity:create_grant(project_id=68c923ae1ea74d589e86978e4dd415c2, user_id=6ca353121b49417da331c92ca4f0c767, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:20.860995 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0145fcc-7c9b-424f-b3c5-266e1af9893e None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:20.865060 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:20.880104 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087edb26-468b-4098-96f4-f9751b843b88 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:20.880898 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 61/124] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Jun 22 08:34:20 2022] PUT /identity/v3/projects/68c923ae1ea74d589e86978e4dd415c2/users/6ca353121b49417da331c92ca4f0c767/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:34:20.886341 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0145fcc-7c9b-424f-b3c5-266e1af9893e None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:20.940683 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:20.966510 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1cd71d-b9ac-4e4d-8bde-fc1d19cb9e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:20.969047 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1cd71d-b9ac-4e4d-8bde-fc1d19cb9e6a None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:20.969352 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1cd71d-b9ac-4e4d-8bde-fc1d19cb9e6a None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:20.969636 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1cd71d-b9ac-4e4d-8bde-fc1d19cb9e6a None admin] PATH_INFO: `/v3/roles/member` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:20.995024 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1cd71d-b9ac-4e4d-8bde-fc1d19cb9e6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:34:21.013992 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-2a1cd71d-b9ac-4e4d-8bde-fc1d19cb9e6a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:34:21.013992 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:34:21.013992 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:34:21.013992 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:34:21.013992 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:34:21.013992 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:34:21.013992 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:34:21.013992 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:34:21.013992 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:34:21.013992 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:34:21.013992 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:34:21.013992 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:34:21.013992 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:34:21.013992 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:34:21.013992 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:34:21.013992 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:34:21.014939 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:34:21.014939 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:34:21.014939 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:34:21.014939 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:34:21.014939 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:34:21.014939 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:34:21.014939 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:34:21.014939 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:34:21.014939 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:34:21.014939 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:34:21.014939 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:34:21.014939 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:34:21.014939 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:34:21.014939 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:34:21.014939 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:34:21.014939 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:34:21.015702 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:34:21.015702 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:34:21.015702 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:34:21.015702 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:34:21.015702 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:34:21.015702 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:34:21.015702 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:34:21.015702 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:34:21.015702 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:34:21.015702 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:34:21.015702 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:34:21.015702 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:34:21.015702 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 64/125] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Jun 22 08:34:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:34:21.017894 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b128c18-2f08-4793-ae30-d102dcee50d3 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:21.018212 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b128c18-2f08-4793-ae30-d102dcee50d3 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:21.018497 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b128c18-2f08-4793-ae30-d102dcee50d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:21.059586 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-5b128c18-2f08-4793-ae30-d102dcee50d3 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:34:21.060841 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-5b128c18-2f08-4793-ae30-d102dcee50d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:34:21.103930 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0145fcc-7c9b-424f-b3c5-266e1af9893e None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:21.144044 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0c8c11-7650-40e9-aa68-f8a77605b05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:21.144950 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c8c11-7650-40e9-aa68-f8a77605b05d None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:21.145558 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c8c11-7650-40e9-aa68-f8a77605b05d None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:21.145843 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c8c11-7650-40e9-aa68-f8a77605b05d None admin] PATH_INFO: `/v3/projects/68c923ae1ea74d589e86978e4dd415c2` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:21.146507 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 65/126] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:34:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:34:21.147375 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b128c18-2f08-4793-ae30-d102dcee50d3 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:21.154384 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0c8c11-7650-40e9-aa68-f8a77605b05d None admin] RBAC: Authorizing `identity:get_project(project_id=68c923ae1ea74d589e86978e4dd415c2)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:21.156079 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0c8c11-7650-40e9-aa68-f8a77605b05d None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:21.158124 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 62/127] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Jun 22 08:34:20 2022] GET /identity/v3/projects/68c923ae1ea74d589e86978e4dd415c2 => generated 298 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:21.164408 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0c8c11-7650-40e9-aa68-f8a77605b05d None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:21.251401 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:21.269670 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b128c18-2f08-4793-ae30-d102dcee50d3 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:21.286782 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:21.299495 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0c8c11-7650-40e9-aa68-f8a77605b05d None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:21.309246 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2cff60-8386-44d6-aed0-a2e1854b9070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:21.310039 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cff60-8386-44d6-aed0-a2e1854b9070 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:21.310424 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cff60-8386-44d6-aed0-a2e1854b9070 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:21.310782 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cff60-8386-44d6-aed0-a2e1854b9070 None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:21.311626 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2cff60-8386-44d6-aed0-a2e1854b9070 None admin] RBAC: Adding query filter params (name=member) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:21.311944 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2cff60-8386-44d6-aed0-a2e1854b9070 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:21.313381 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2cff60-8386-44d6-aed0-a2e1854b9070 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:21.323044 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 66/128] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Jun 22 08:34:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:21.323708 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2cff60-8386-44d6-aed0-a2e1854b9070 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:21.341527 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f85eaa-b00f-4317-9698-53b2049294f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:21.342767 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f85eaa-b00f-4317-9698-53b2049294f6 None admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:21.343237 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f85eaa-b00f-4317-9698-53b2049294f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:21.343749 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f85eaa-b00f-4317-9698-53b2049294f6 None admin] PATH_INFO: `/v3/projects/68c923ae1ea74d589e86978e4dd415c2/users/df27ddfb34374fed99b8b5d643046079/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:21.346262 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f85eaa-b00f-4317-9698-53b2049294f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=68c923ae1ea74d589e86978e4dd415c2, user_id=df27ddfb34374fed99b8b5d643046079, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:21.348067 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f85eaa-b00f-4317-9698-53b2049294f6 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:21.367336 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 63/129] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Jun 22 08:34:21 2022] PUT /identity/v3/projects/68c923ae1ea74d589e86978e4dd415c2/users/df27ddfb34374fed99b8b5d643046079/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:34:21.368676 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f85eaa-b00f-4317-9698-53b2049294f6 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:21.437697 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2cff60-8386-44d6-aed0-a2e1854b9070 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:21.474974 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db023ff1-bc73-4e64-820d-d6a706575a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:21.475817 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db023ff1-bc73-4e64-820d-d6a706575a96 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:21.476110 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db023ff1-bc73-4e64-820d-d6a706575a96 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:21.476383 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db023ff1-bc73-4e64-820d-d6a706575a96 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:21.488954 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db023ff1-bc73-4e64-820d-d6a706575a96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:34:21.497210 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-db023ff1-bc73-4e64-820d-d6a706575a96 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:34:21.497210 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:34:21.497210 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:34:21.497210 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:34:21.497210 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:34:21.497210 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:34:21.497210 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:34:21.497210 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:34:21.497210 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:34:21.497210 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:34:21.497210 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:34:21.497210 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:34:21.497210 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:34:21.497210 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:34:21.497210 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:34:21.497210 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:34:21.498187 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:34:21.498187 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:34:21.498187 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:34:21.498187 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:34:21.498187 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:34:21.498187 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:34:21.498187 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:34:21.498187 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:34:21.498187 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:34:21.498187 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:34:21.498187 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:34:21.498187 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:34:21.498187 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:34:21.498187 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:34:21.498187 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:34:21.498187 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:34:21.499033 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:34:21.499033 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:34:21.499033 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:34:21.499033 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:34:21.499033 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:34:21.499033 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:34:21.499033 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:34:21.499033 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:34:21.499033 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:34:21.499033 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:34:21.499033 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:34:21.499033 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:34:21.499033 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 67/130] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Jun 22 08:34:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:34:21.505147 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db023ff1-bc73-4e64-820d-d6a706575a96 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:21.544438 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:21.546506 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f85eaa-b00f-4317-9698-53b2049294f6 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:21.596147 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:21.616916 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db023ff1-bc73-4e64-820d-d6a706575a96 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:21.623475 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f79a84a-d69b-41cd-b4a6-4f443deb590c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:21.624796 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f79a84a-d69b-41cd-b4a6-4f443deb590c None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:21.625341 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f79a84a-d69b-41cd-b4a6-4f443deb590c None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:21.625828 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f79a84a-d69b-41cd-b4a6-4f443deb590c None admin] PATH_INFO: `/v3/users/df27ddfb34374fed99b8b5d643046079` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:21.630989 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f79a84a-d69b-41cd-b4a6-4f443deb590c None admin] RBAC: Authorizing `identity:get_user(user_id=df27ddfb34374fed99b8b5d643046079)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:21.632938 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f79a84a-d69b-41cd-b4a6-4f443deb590c None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:21.635472 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 64/131] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Jun 22 08:34:21 2022] GET /identity/v3/users/df27ddfb34374fed99b8b5d643046079 => generated 275 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:21.640670 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f79a84a-d69b-41cd-b4a6-4f443deb590c None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:21.658124 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c5acec-cf2d-4adc-a5b9-eef0de3230f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:21.658124 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5acec-cf2d-4adc-a5b9-eef0de3230f1 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:21.658124 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5acec-cf2d-4adc-a5b9-eef0de3230f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:21.658124 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5acec-cf2d-4adc-a5b9-eef0de3230f1 None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:21.658516 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c5acec-cf2d-4adc-a5b9-eef0de3230f1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:21.658516 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c5acec-cf2d-4adc-a5b9-eef0de3230f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:21.658849 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c5acec-cf2d-4adc-a5b9-eef0de3230f1 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:21.669155 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 68/132] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Jun 22 08:34:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:21.674793 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c5acec-cf2d-4adc-a5b9-eef0de3230f1 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:21.790189 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c5acec-cf2d-4adc-a5b9-eef0de3230f1 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:21.803293 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:21.828948 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e1dac-c5f9-414c-bba0-a39210d682ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:21.830158 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e1dac-c5f9-414c-bba0-a39210d682ee None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:21.830553 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e1dac-c5f9-414c-bba0-a39210d682ee None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:21.830939 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e1dac-c5f9-414c-bba0-a39210d682ee None admin] PATH_INFO: `/v3/users/df27ddfb34374fed99b8b5d643046079` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:21.832903 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728e1dac-c5f9-414c-bba0-a39210d682ee None admin] RBAC: Authorizing `identity:get_user(user_id=df27ddfb34374fed99b8b5d643046079)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:21.834688 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728e1dac-c5f9-414c-bba0-a39210d682ee None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:21.836935 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 69/133] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Jun 22 08:34:21 2022] GET /identity/v3/users/df27ddfb34374fed99b8b5d643046079 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:21.840059 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f79a84a-d69b-41cd-b4a6-4f443deb590c None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:21.846122 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e1dac-c5f9-414c-bba0-a39210d682ee None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:21.938834 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a21c565-3763-4f1b-bc12-369f68f1b6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:21.940004 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21c565-3763-4f1b-bc12-369f68f1b6e9 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:21.940447 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21c565-3763-4f1b-bc12-369f68f1b6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:21.940873 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21c565-3763-4f1b-bc12-369f68f1b6e9 None admin] PATH_INFO: `/v3/projects/c3d685c0c2b54c219d4a2ff337bdc18e` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:21.942445 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a21c565-3763-4f1b-bc12-369f68f1b6e9 None admin] RBAC: Authorizing `identity:get_project(project_id=c3d685c0c2b54c219d4a2ff337bdc18e)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:21.944068 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a21c565-3763-4f1b-bc12-369f68f1b6e9 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:21.946413 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 65/134] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Jun 22 08:34:21 2022] GET /identity/v3/projects/c3d685c0c2b54c219d4a2ff337bdc18e => generated 312 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:21.951722 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a21c565-3763-4f1b-bc12-369f68f1b6e9 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:21.955767 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e1dac-c5f9-414c-bba0-a39210d682ee None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:21.994315 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c9112-e095-4a86-a34c-8868769c78b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:21.995670 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c9112-e095-4a86-a34c-8868769c78b8 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:21.996092 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c9112-e095-4a86-a34c-8868769c78b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:21.996493 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c9112-e095-4a86-a34c-8868769c78b8 None admin] PATH_INFO: `/v3/projects/68c923ae1ea74d589e86978e4dd415c2` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:21.997985 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348c9112-e095-4a86-a34c-8868769c78b8 None admin] RBAC: Authorizing `identity:get_project(project_id=68c923ae1ea74d589e86978e4dd415c2)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:21.999815 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348c9112-e095-4a86-a34c-8868769c78b8 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:22.002301 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 70/135] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Jun 22 08:34:21 2022] GET /identity/v3/projects/68c923ae1ea74d589e86978e4dd415c2 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:34:22.008081 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c9112-e095-4a86-a34c-8868769c78b8 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:22.048323 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:22.054753 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:22.123920 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a21c565-3763-4f1b-bc12-369f68f1b6e9 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:22.183916 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c9112-e095-4a86-a34c-8868769c78b8 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:22.190384 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79725d6e-3077-4265-b911-edeecb912337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:22.191564 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79725d6e-3077-4265-b911-edeecb912337 None admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:22.195330 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79725d6e-3077-4265-b911-edeecb912337 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:22.195780 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79725d6e-3077-4265-b911-edeecb912337 None admin] PATH_INFO: `/v3/projects/c3d685c0c2b54c219d4a2ff337bdc18e/users/df27ddfb34374fed99b8b5d643046079/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:22.200118 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79725d6e-3077-4265-b911-edeecb912337 None admin] RBAC: Authorizing `identity:create_grant(project_id=c3d685c0c2b54c219d4a2ff337bdc18e, user_id=df27ddfb34374fed99b8b5d643046079, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:22.201823 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79725d6e-3077-4265-b911-edeecb912337 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:22.240982 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 66/136] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Jun 22 08:34:21 2022] PUT /identity/v3/projects/c3d685c0c2b54c219d4a2ff337bdc18e/users/df27ddfb34374fed99b8b5d643046079/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:34:22.243949 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e18e01-c9a3-4187-bd0e-a53f2973b5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:22.245069 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e18e01-c9a3-4187-bd0e-a53f2973b5c8 None admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:22.245571 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e18e01-c9a3-4187-bd0e-a53f2973b5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:22.245995 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e18e01-c9a3-4187-bd0e-a53f2973b5c8 None admin] PATH_INFO: `/v3/projects/68c923ae1ea74d589e86978e4dd415c2/users/df27ddfb34374fed99b8b5d643046079/roles/a92b520fb33f4333aad569d98be2bd7e` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:22.251401 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e18e01-c9a3-4187-bd0e-a53f2973b5c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=68c923ae1ea74d589e86978e4dd415c2, user_id=df27ddfb34374fed99b8b5d643046079, role_id=a92b520fb33f4333aad569d98be2bd7e)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:22.253344 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e18e01-c9a3-4187-bd0e-a53f2973b5c8 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:22.275401 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 71/137] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Jun 22 08:34:22 2022] PUT /identity/v3/projects/68c923ae1ea74d589e86978e4dd415c2/users/df27ddfb34374fed99b8b5d643046079/roles/a92b520fb33f4333aad569d98be2bd7e => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 08:34:22.544053 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545229d-4024-495e-8ced-4bc365d3d44b None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:22.544687 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545229d-4024-495e-8ced-4bc365d3d44b None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:22.545160 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545229d-4024-495e-8ced-4bc365d3d44b None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:22.546805 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 67/138] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:34:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:34:22.565733 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f115d1-4b60-4ac9-b19f-d5a40d22cd39 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:22.566136 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f115d1-4b60-4ac9-b19f-d5a40d22cd39 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:22.566525 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f115d1-4b60-4ac9-b19f-d5a40d22cd39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:22.586623 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-42f115d1-4b60-4ac9-b19f-d5a40d22cd39 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:34:22.587832 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-42f115d1-4b60-4ac9-b19f-d5a40d22cd39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:34:22.609465 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790a657-57b2-469b-aa56-08fec5cd9ed7 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:22.610093 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790a657-57b2-469b-aa56-08fec5cd9ed7 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:22.610613 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790a657-57b2-469b-aa56-08fec5cd9ed7 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:22.612220 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 68/139] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:34:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:34:22.618542 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5945710-7080-4cd5-9cbc-acf4913c7ce5 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:22.618831 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5945710-7080-4cd5-9cbc-acf4913c7ce5 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:22.619116 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5945710-7080-4cd5-9cbc-acf4913c7ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:22.643410 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-d5945710-7080-4cd5-9cbc-acf4913c7ce5 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:34:22.645676 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-d5945710-7080-4cd5-9cbc-acf4913c7ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:34:22.684050 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 72/140] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:34:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:34:22.729291 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f115d1-4b60-4ac9-b19f-d5a40d22cd39 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:22.756102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 69/141] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:34:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:34:22.764973 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:22.833749 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5945710-7080-4cd5-9cbc-acf4913c7ce5 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:22.855074 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f115d1-4b60-4ac9-b19f-d5a40d22cd39 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:22.914312 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c5a73f-cfbf-4a64-9ea4-d212f700101b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:22.915126 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5a73f-cfbf-4a64-9ea4-d212f700101b None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:22.915412 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5a73f-cfbf-4a64-9ea4-d212f700101b None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:22.915690 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5a73f-cfbf-4a64-9ea4-d212f700101b None admin] PATH_INFO: `/v3/domains/default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:22.922948 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c5a73f-cfbf-4a64-9ea4-d212f700101b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:22.924443 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c5a73f-cfbf-4a64-9ea4-d212f700101b None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:22.926812 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 73/142] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:34:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:34:22.932436 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c5a73f-cfbf-4a64-9ea4-d212f700101b None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:22.950664 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:23.065270 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5945710-7080-4cd5-9cbc-acf4913c7ce5 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:23.115329 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:23.132349 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203411e9-ef4d-43d0-b910-74f00b26d5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:23.133173 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203411e9-ef4d-43d0-b910-74f00b26d5ea None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:23.133457 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203411e9-ef4d-43d0-b910-74f00b26d5ea None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:23.133736 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203411e9-ef4d-43d0-b910-74f00b26d5ea None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:23.135389 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c5a73f-cfbf-4a64-9ea4-d212f700101b None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:23.162845 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203411e9-ef4d-43d0-b910-74f00b26d5ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:34:23.170771 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-203411e9-ef4d-43d0-b910-74f00b26d5ea None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 08:34:23.170771 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:34:23.170771 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:34:23.170771 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:34:23.170771 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:34:23.170771 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:34:23.170771 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:34:23.170771 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:34:23.170771 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:34:23.170771 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:34:23.170771 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:34:23.170771 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:34:23.170771 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:34:23.170771 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:34:23.170771 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:34:23.170771 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:34:23.171751 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:34:23.171751 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:34:23.171751 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:34:23.171751 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:34:23.171751 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:34:23.171751 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:34:23.171751 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:34:23.171751 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:34:23.171751 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:34:23.171751 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:34:23.171751 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:34:23.171751 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:34:23.171751 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:34:23.171751 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:34:23.171751 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:34:23.171751 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:34:23.172524 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:34:23.172524 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:34:23.172524 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:34:23.172524 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:34:23.172524 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:34:23.172524 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:34:23.172524 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:34:23.172524 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:34:23.172524 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:34:23.172524 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:34:23.172524 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 08:34:23.172524 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:34:23.172524 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 70/143] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Jun 22 08:34:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:34:23.179009 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203411e9-ef4d-43d0-b910-74f00b26d5ea None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:23.199512 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f09b68-27f2-4d6d-956a-3bdc9aa81d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:23.200941 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f09b68-27f2-4d6d-956a-3bdc9aa81d77 None admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:23.201781 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f09b68-27f2-4d6d-956a-3bdc9aa81d77 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:23.202734 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f09b68-27f2-4d6d-956a-3bdc9aa81d77 None admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:23.203877 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f09b68-27f2-4d6d-956a-3bdc9aa81d77 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:23.206997 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f09b68-27f2-4d6d-956a-3bdc9aa81d77 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:23.244447 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 74/144] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Jun 22 08:34:22 2022] POST /identity/v3/users => generated 283 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:34:23.338735 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203411e9-ef4d-43d0-b910-74f00b26d5ea None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:23.352943 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:23.388892 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceca240-806c-4f82-a0aa-cc159351ef8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:23.389587 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceca240-806c-4f82-a0aa-cc159351ef8b None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:23.389876 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceca240-806c-4f82-a0aa-cc159351ef8b None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:23.390242 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceca240-806c-4f82-a0aa-cc159351ef8b None admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:23.391012 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceca240-806c-4f82-a0aa-cc159351ef8b None admin] RBAC: Adding query filter params (name=reader) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:23.391329 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceca240-806c-4f82-a0aa-cc159351ef8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:23.392719 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceca240-806c-4f82-a0aa-cc159351ef8b None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:23.402872 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 71/145] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Jun 22 08:34:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:34:23.407977 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f09b68-27f2-4d6d-956a-3bdc9aa81d77 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:23.546121 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f09b68-27f2-4d6d-956a-3bdc9aa81d77 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:23.585043 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea54d456-65cf-43af-a920-e142dd134e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:23.586004 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54d456-65cf-43af-a920-e142dd134e21 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:23.586322 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54d456-65cf-43af-a920-e142dd134e21 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:23.586603 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54d456-65cf-43af-a920-e142dd134e21 None admin] PATH_INFO: `/v3/users/424948f8f3e8434dae1ee2753fa22bd4` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:23.587881 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea54d456-65cf-43af-a920-e142dd134e21 None admin] RBAC: Authorizing `identity:get_user(user_id=424948f8f3e8434dae1ee2753fa22bd4)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:23.589421 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea54d456-65cf-43af-a920-e142dd134e21 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:23.591449 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 75/146] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Jun 22 08:34:23 2022] GET /identity/v3/users/424948f8f3e8434dae1ee2753fa22bd4 => generated 289 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:23.599408 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceca240-806c-4f82-a0aa-cc159351ef8b None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:23.737039 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceca240-806c-4f82-a0aa-cc159351ef8b None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:23.783837 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50cf6a1-e748-466b-8522-2b299cc233c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:23.784782 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50cf6a1-e748-466b-8522-2b299cc233c0 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:23.785073 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50cf6a1-e748-466b-8522-2b299cc233c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:23.786098 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50cf6a1-e748-466b-8522-2b299cc233c0 None admin] PATH_INFO: `/v3/projects/68c923ae1ea74d589e86978e4dd415c2` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:23.790984 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50cf6a1-e748-466b-8522-2b299cc233c0 None admin] RBAC: Authorizing `identity:get_project(project_id=68c923ae1ea74d589e86978e4dd415c2)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:23.792467 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50cf6a1-e748-466b-8522-2b299cc233c0 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:23.794345 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 72/147] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Jun 22 08:34:23 2022] GET /identity/v3/projects/68c923ae1ea74d589e86978e4dd415c2 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:23.800166 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea54d456-65cf-43af-a920-e142dd134e21 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:23.820708 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:23.922868 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea54d456-65cf-43af-a920-e142dd134e21 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:23.965550 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5defb50c-5694-43c4-b0c2-235182b7cc1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:23.966558 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5defb50c-5694-43c4-b0c2-235182b7cc1e None admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:23.966883 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5defb50c-5694-43c4-b0c2-235182b7cc1e None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:23.967169 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5defb50c-5694-43c4-b0c2-235182b7cc1e None admin] PATH_INFO: `/v3/projects/68c923ae1ea74d589e86978e4dd415c2/users/424948f8f3e8434dae1ee2753fa22bd4/roles/78088ffb8c224af39e594570dd740336` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:23.969197 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5defb50c-5694-43c4-b0c2-235182b7cc1e None admin] RBAC: Authorizing `identity:create_grant(project_id=68c923ae1ea74d589e86978e4dd415c2, user_id=424948f8f3e8434dae1ee2753fa22bd4, role_id=78088ffb8c224af39e594570dd740336)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:23.970737 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5defb50c-5694-43c4-b0c2-235182b7cc1e None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:23.998065 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 76/148] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Jun 22 08:34:23 2022] PUT /identity/v3/projects/68c923ae1ea74d589e86978e4dd415c2/users/424948f8f3e8434dae1ee2753fa22bd4/roles/78088ffb8c224af39e594570dd740336 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:34:24.178031 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ecea96-a86f-40cd-9d04-e45a8a99f7b0 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:24.178598 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ecea96-a86f-40cd-9d04-e45a8a99f7b0 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:24.178693 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ecea96-a86f-40cd-9d04-e45a8a99f7b0 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:24.180177 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 73/149] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:34:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:34:24.185931 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1811e6-5ed9-46ed-bdd2-5e2b67a0e097 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:24.186266 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1811e6-5ed9-46ed-bdd2-5e2b67a0e097 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:24.186537 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1811e6-5ed9-46ed-bdd2-5e2b67a0e097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:24.205357 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-6c1811e6-5ed9-46ed-bdd2-5e2b67a0e097 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:34:24.210833 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-6c1811e6-5ed9-46ed-bdd2-5e2b67a0e097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:34:24.298542 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 77/150] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:34:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:34:24.336857 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ecea96-a86f-40cd-9d04-e45a8a99f7b0 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:24.384417 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:24.452137 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ecea96-a86f-40cd-9d04-e45a8a99f7b0 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:24.496300 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9101ceb0-80be-4477-9151-8079dad57a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:24.497125 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101ceb0-80be-4477-9151-8079dad57a1e None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:24.497417 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101ceb0-80be-4477-9151-8079dad57a1e None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:24.497704 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101ceb0-80be-4477-9151-8079dad57a1e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:24.514165 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9101ceb0-80be-4477-9151-8079dad57a1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:34:24.522277 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-9101ceb0-80be-4477-9151-8079dad57a1e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:34:24.522277 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:34:24.522277 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:34:24.522277 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:34:24.522277 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:34:24.522277 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:34:24.522277 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:34:24.522277 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:34:24.522277 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:34:24.522277 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:34:24.522277 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:34:24.522277 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:34:24.522277 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:34:24.522277 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:34:24.522277 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:34:24.522277 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:34:24.523152 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:34:24.523152 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:34:24.523152 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:34:24.523152 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:34:24.523152 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:34:24.523152 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:34:24.523152 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:34:24.523152 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:34:24.523152 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:34:24.523152 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:34:24.523152 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:34:24.523152 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:34:24.523152 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:34:24.523152 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:34:24.523152 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:34:24.523152 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:34:24.523895 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:34:24.523895 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:34:24.523895 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:34:24.523895 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:34:24.523895 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:34:24.523895 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:34:24.523895 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:34:24.523895 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:34:24.523895 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:34:24.523895 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:34:24.523895 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:34:24.523895 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:34:24.523895 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 74/151] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Jun 22 08:34:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:34:24.531028 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1811e6-5ed9-46ed-bdd2-5e2b67a0e097 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:24.539442 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:24.657610 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1811e6-5ed9-46ed-bdd2-5e2b67a0e097 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:24.697813 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc94e30-5f80-4729-b916-9accda450a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:24.698530 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc94e30-5f80-4729-b916-9accda450a6b None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:24.698820 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc94e30-5f80-4729-b916-9accda450a6b None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:24.699101 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc94e30-5f80-4729-b916-9accda450a6b None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:24.700284 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc94e30-5f80-4729-b916-9accda450a6b None admin] RBAC: Adding query filter params (name=admin) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:24.700632 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc94e30-5f80-4729-b916-9accda450a6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:24.702438 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc94e30-5f80-4729-b916-9accda450a6b None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:24.708406 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92b7c1-85a0-4319-8a3b-ec65825c6d33 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:24.708699 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92b7c1-85a0-4319-8a3b-ec65825c6d33 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:24.708973 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92b7c1-85a0-4319-8a3b-ec65825c6d33 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:24.710564 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 75/152] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:34:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:34:24.716366 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a9855-6cc2-404e-9fa0-a0dfb0771aca None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:24.716660 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a9855-6cc2-404e-9fa0-a0dfb0771aca None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:24.716944 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a9855-6cc2-404e-9fa0-a0dfb0771aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:24.721691 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 78/153] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Jun 22 08:34:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:24.727652 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc94e30-5f80-4729-b916-9accda450a6b None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:24.747093 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-6b4a9855-6cc2-404e-9fa0-a0dfb0771aca None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:34:24.748302 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-6b4a9855-6cc2-404e-9fa0-a0dfb0771aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:34:24.854544 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:24.893107 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc94e30-5f80-4729-b916-9accda450a6b None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:24.932919 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 76/154] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:34:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:34:24.946653 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4900037-b2eb-4519-b6c9-c127409412d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:24.947558 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4900037-b2eb-4519-b6c9-c127409412d5 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:24.947845 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4900037-b2eb-4519-b6c9-c127409412d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:24.948122 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4900037-b2eb-4519-b6c9-c127409412d5 None admin] PATH_INFO: `/v3/users/6ca353121b49417da331c92ca4f0c767` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:24.950890 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4900037-b2eb-4519-b6c9-c127409412d5 None admin] RBAC: Authorizing `identity:get_user(user_id=6ca353121b49417da331c92ca4f0c767)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:24.952612 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4900037-b2eb-4519-b6c9-c127409412d5 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:24.954545 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 79/155] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Jun 22 08:34:24 2022] GET /identity/v3/users/6ca353121b49417da331c92ca4f0c767 => generated 247 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:34:24.960942 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a9855-6cc2-404e-9fa0-a0dfb0771aca None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:24.970352 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4900037-b2eb-4519-b6c9-c127409412d5 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:25.007332 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:25.136354 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4900037-b2eb-4519-b6c9-c127409412d5 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:25.150290 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a9855-6cc2-404e-9fa0-a0dfb0771aca None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:25.204836 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f040803d-07c0-49ce-a085-6fc93bfbe29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:25.205652 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040803d-07c0-49ce-a085-6fc93bfbe29e None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:25.206235 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040803d-07c0-49ce-a085-6fc93bfbe29e None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:25.206235 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040803d-07c0-49ce-a085-6fc93bfbe29e None admin] PATH_INFO: `/v3/roles/member` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:25.215515 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce24169a-b07f-4e50-ace1-18b12fb6d3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:25.216189 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24169a-b07f-4e50-ace1-18b12fb6d3a3 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:25.216475 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24169a-b07f-4e50-ace1-18b12fb6d3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:25.216753 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24169a-b07f-4e50-ace1-18b12fb6d3a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:25.222453 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:25.235179 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f040803d-07c0-49ce-a085-6fc93bfbe29e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:34:25.246054 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-f040803d-07c0-49ce-a085-6fc93bfbe29e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:34:25.246054 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:34:25.246054 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:34:25.246054 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:34:25.246054 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:34:25.246054 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:34:25.246054 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:34:25.246054 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:34:25.246054 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:34:25.246054 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:34:25.246054 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:34:25.246054 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:34:25.246054 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:34:25.246054 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:34:25.246054 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:34:25.246054 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:34:25.247221 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:34:25.247221 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:34:25.247221 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:34:25.247221 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:34:25.247221 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:34:25.247221 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:34:25.247221 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:34:25.247221 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:34:25.247221 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:34:25.247221 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:34:25.247221 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:34:25.247221 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:34:25.247221 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:34:25.247221 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:34:25.247221 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:34:25.247221 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:34:25.248065 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:34:25.248065 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:34:25.248065 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:34:25.248065 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:34:25.248065 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:34:25.248065 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:34:25.248065 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:34:25.248065 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:34:25.248065 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:34:25.248065 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:34:25.248065 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:34:25.248065 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:34:25.257865 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 80/156] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Jun 22 08:34:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:34:25.263430 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f040803d-07c0-49ce-a085-6fc93bfbe29e None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:25.326963 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce24169a-b07f-4e50-ace1-18b12fb6d3a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:25.328459 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce24169a-b07f-4e50-ace1-18b12fb6d3a3 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:25.391275 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:25.524135 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f040803d-07c0-49ce-a085-6fc93bfbe29e None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:25.551486 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 77/157] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Jun 22 08:34:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 591 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:34:25.557596 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce24169a-b07f-4e50-ace1-18b12fb6d3a3 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:25.609392 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b6d0f-6885-4de5-bf57-525bed9299e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:25.610432 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b6d0f-6885-4de5-bf57-525bed9299e7 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:25.610926 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b6d0f-6885-4de5-bf57-525bed9299e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:25.611417 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b6d0f-6885-4de5-bf57-525bed9299e7 None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:25.612404 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310b6d0f-6885-4de5-bf57-525bed9299e7 None admin] RBAC: Adding query filter params (name=member) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:25.612932 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310b6d0f-6885-4de5-bf57-525bed9299e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:25.615199 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310b6d0f-6885-4de5-bf57-525bed9299e7 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:25.637027 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 81/158] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Jun 22 08:34:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:34:25.638786 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0605392-65c2-4123-956b-c1c0bcfc9682 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:25.650883 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0605392-65c2-4123-956b-c1c0bcfc9682 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:25.651502 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0605392-65c2-4123-956b-c1c0bcfc9682 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:25.653230 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 82/159] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:34:25 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:34:25.654223 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0605392-65c2-4123-956b-c1c0bcfc9682 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:25.764376 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce24169a-b07f-4e50-ace1-18b12fb6d3a3 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:25.796199 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:25.822501 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:25.826514 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3c1a1b-5fbb-47f3-a43d-65f228838e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:25.827392 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c1a1b-5fbb-47f3-a43d-65f228838e62 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:25.827673 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c1a1b-5fbb-47f3-a43d-65f228838e62 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:25.827950 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c1a1b-5fbb-47f3-a43d-65f228838e62 None admin] PATH_INFO: `/v3/projects/68c923ae1ea74d589e86978e4dd415c2` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:25.835252 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3c1a1b-5fbb-47f3-a43d-65f228838e62 None admin] RBAC: Authorizing `identity:get_project(project_id=68c923ae1ea74d589e86978e4dd415c2)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:25.836786 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3c1a1b-5fbb-47f3-a43d-65f228838e62 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:25.838608 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 78/160] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Jun 22 08:34:25 2022] GET /identity/v3/projects/68c923ae1ea74d589e86978e4dd415c2 => generated 298 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:25.840857 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14267a-0952-4ce1-bac4-8528f4dcace7 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:25.841145 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14267a-0952-4ce1-bac4-8528f4dcace7 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:25.841423 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14267a-0952-4ce1-bac4-8528f4dcace7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:25.869855 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0605392-65c2-4123-956b-c1c0bcfc9682 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:25.870066 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-1e14267a-0952-4ce1-bac4-8528f4dcace7 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:34:25.871168 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-1e14267a-0952-4ce1-bac4-8528f4dcace7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:34:25.942946 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1041b910-9654-4eed-ac74-f789f5e393b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:25.943770 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1041b910-9654-4eed-ac74-f789f5e393b1 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:25.944059 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1041b910-9654-4eed-ac74-f789f5e393b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:25.944340 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1041b910-9654-4eed-ac74-f789f5e393b1 None admin] PATH_INFO: `/v3/users/df27ddfb34374fed99b8b5d643046079` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:25.950984 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1041b910-9654-4eed-ac74-f789f5e393b1 None admin] RBAC: Authorizing `identity:get_user(user_id=df27ddfb34374fed99b8b5d643046079)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:25.952492 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1041b910-9654-4eed-ac74-f789f5e393b1 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:25.954276 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 83/161] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Jun 22 08:34:25 2022] GET /identity/v3/users/df27ddfb34374fed99b8b5d643046079 => generated 275 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:25.955064 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1041b910-9654-4eed-ac74-f789f5e393b1 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:25.987090 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 79/162] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:34:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:34:25.987971 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14267a-0952-4ce1-bac4-8528f4dcace7 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:26.105965 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1041b910-9654-4eed-ac74-f789f5e393b1 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:26.154457 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:26.156016 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14267a-0952-4ce1-bac4-8528f4dcace7 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:26.172690 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9301e47-bf2c-4d5d-b455-5bbde76a4e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:26.173365 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9301e47-bf2c-4d5d-b455-5bbde76a4e47 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:26.173649 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9301e47-bf2c-4d5d-b455-5bbde76a4e47 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:26.173925 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9301e47-bf2c-4d5d-b455-5bbde76a4e47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:26.174798 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9301e47-bf2c-4d5d-b455-5bbde76a4e47 None admin] RBAC: Adding query filter params (role.id=c7518e0f532945af80c33860f2ac506d, scope.project.id=68c923ae1ea74d589e86978e4dd415c2, user.id=6ca353121b49417da331c92ca4f0c767) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:26.175114 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9301e47-bf2c-4d5d-b455-5bbde76a4e47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:26.177120 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9301e47-bf2c-4d5d-b455-5bbde76a4e47 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:26.187508 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 84/163] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Jun 22 08:34:25 2022] GET /identity/v3/role_assignments?user.id=6ca353121b49417da331c92ca4f0c767&scope.project.id=68c923ae1ea74d589e86978e4dd415c2&role.id=c7518e0f532945af80c33860f2ac506d => generated 608 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:26.188354 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9301e47-bf2c-4d5d-b455-5bbde76a4e47 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:26.214553 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:26.230280 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b0fb9d-6a80-4f39-88f9-3ab3dc450fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:26.230931 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0fb9d-6a80-4f39-88f9-3ab3dc450fef None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:26.231216 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0fb9d-6a80-4f39-88f9-3ab3dc450fef None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:26.231496 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0fb9d-6a80-4f39-88f9-3ab3dc450fef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:26.373846 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b0fb9d-6a80-4f39-88f9-3ab3dc450fef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:26.375584 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9301e47-bf2c-4d5d-b455-5bbde76a4e47 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:26.376286 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b0fb9d-6a80-4f39-88f9-3ab3dc450fef None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:26.418129 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707bc27b-6c7e-411b-b5f7-c8b78981d05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:26.418129 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707bc27b-6c7e-411b-b5f7-c8b78981d05a None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:26.418129 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707bc27b-6c7e-411b-b5f7-c8b78981d05a None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:26.418129 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707bc27b-6c7e-411b-b5f7-c8b78981d05a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:26.428519 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707bc27b-6c7e-411b-b5f7-c8b78981d05a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:34:26.438309 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-707bc27b-6c7e-411b-b5f7-c8b78981d05a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:34:26.438309 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:34:26.438309 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:34:26.438309 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:34:26.438309 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:34:26.438309 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:34:26.438309 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:34:26.438309 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:34:26.438309 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:34:26.438309 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:34:26.438309 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:34:26.438309 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:34:26.438309 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:34:26.438309 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:34:26.438309 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:34:26.438309 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:34:26.439203 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:34:26.439203 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:34:26.439203 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:34:26.439203 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:34:26.439203 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:34:26.439203 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:34:26.439203 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:34:26.439203 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:34:26.439203 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:34:26.439203 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:34:26.439203 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:34:26.439203 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:34:26.439203 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:34:26.439203 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:34:26.439203 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:34:26.439203 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:34:26.440391 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:34:26.440391 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:34:26.440391 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:34:26.440391 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:34:26.440391 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:34:26.440391 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:34:26.440391 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:34:26.440391 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:34:26.440391 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:34:26.440391 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:34:26.440391 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:34:26.440391 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:34:26.440391 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 85/164] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Jun 22 08:34:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:34:26.441281 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9395f-9cde-48ac-8c10-24e67bc82fe3 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:26.441281 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9395f-9cde-48ac-8c10-24e67bc82fe3 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:26.441978 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9395f-9cde-48ac-8c10-24e67bc82fe3 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:26.448077 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 86/165] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:34:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:34:26.450796 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9395f-9cde-48ac-8c10-24e67bc82fe3 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:26.514297 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:26.575806 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9395f-9cde-48ac-8c10-24e67bc82fe3 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:26.616275 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc9ac6-c294-4b2c-b70a-1623c4c4aa6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:26.616962 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc9ac6-c294-4b2c-b70a-1623c4c4aa6e None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:26.617248 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc9ac6-c294-4b2c-b70a-1623c4c4aa6e None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:26.617527 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc9ac6-c294-4b2c-b70a-1623c4c4aa6e None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:26.618331 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc9ac6-c294-4b2c-b70a-1623c4c4aa6e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:26.618645 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc9ac6-c294-4b2c-b70a-1623c4c4aa6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:26.620040 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc9ac6-c294-4b2c-b70a-1623c4c4aa6e None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:26.620737 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 80/166] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Jun 22 08:34:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 633 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:34:26.622335 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6da05c-d5e6-4051-a03e-50f93efda40c None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:26.622857 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6da05c-d5e6-4051-a03e-50f93efda40c None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:26.623359 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6da05c-d5e6-4051-a03e-50f93efda40c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:26.633633 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 87/167] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Jun 22 08:34:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:34:26.640165 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc9ac6-c294-4b2c-b70a-1623c4c4aa6e None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:26.659081 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-ae6da05c-d5e6-4051-a03e-50f93efda40c None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:34:26.661209 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-ae6da05c-d5e6-4051-a03e-50f93efda40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:34:26.714437 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:26.772655 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc9ac6-c294-4b2c-b70a-1623c4c4aa6e None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:26.788268 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:26.808640 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 81/168] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:34:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:34:26.809513 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6da05c-d5e6-4051-a03e-50f93efda40c None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:26.816255 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad632416-75d1-405f-bac4-a9941d88e74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:26.818296 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad632416-75d1-405f-bac4-a9941d88e74c None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:26.818608 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad632416-75d1-405f-bac4-a9941d88e74c None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:26.818891 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad632416-75d1-405f-bac4-a9941d88e74c None admin] PATH_INFO: `/v3/projects/68c923ae1ea74d589e86978e4dd415c2` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:26.823292 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad632416-75d1-405f-bac4-a9941d88e74c None admin] RBAC: Authorizing `identity:get_project(project_id=68c923ae1ea74d589e86978e4dd415c2)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:26.824805 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad632416-75d1-405f-bac4-a9941d88e74c None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:26.826897 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 88/169] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Jun 22 08:34:26 2022] GET /identity/v3/projects/68c923ae1ea74d589e86978e4dd415c2 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:26.833929 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad632416-75d1-405f-bac4-a9941d88e74c None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:26.965192 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad632416-75d1-405f-bac4-a9941d88e74c None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:27.006732 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ef08aa-81d6-4c5c-af7f-d439e95a494d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:27.007410 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef08aa-81d6-4c5c-af7f-d439e95a494d None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:27.007698 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef08aa-81d6-4c5c-af7f-d439e95a494d None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:27.007984 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef08aa-81d6-4c5c-af7f-d439e95a494d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:27.008842 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ef08aa-81d6-4c5c-af7f-d439e95a494d None admin] RBAC: Adding query filter params (role.id=5ea101070f734fa59995615179f2eff2, scope.project.id=68c923ae1ea74d589e86978e4dd415c2, user.id=df27ddfb34374fed99b8b5d643046079) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:27.009160 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ef08aa-81d6-4c5c-af7f-d439e95a494d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:27.010887 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ef08aa-81d6-4c5c-af7f-d439e95a494d None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:27.015014 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6da05c-d5e6-4051-a03e-50f93efda40c None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:27.019280 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 89/170] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Jun 22 08:34:26 2022] GET /identity/v3/role_assignments?user.id=df27ddfb34374fed99b8b5d643046079&scope.project.id=68c923ae1ea74d589e86978e4dd415c2&role.id=5ea101070f734fa59995615179f2eff2 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:27.021013 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ef08aa-81d6-4c5c-af7f-d439e95a494d None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:27.098205 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:27.111909 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c3ed54-bd37-47d5-9c41-bdc549761a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:27.112823 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3ed54-bd37-47d5-9c41-bdc549761a36 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:27.113112 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3ed54-bd37-47d5-9c41-bdc549761a36 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:27.113973 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3ed54-bd37-47d5-9c41-bdc549761a36 None admin] PATH_INFO: `/v3/users/df27ddfb34374fed99b8b5d643046079` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:27.117654 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c3ed54-bd37-47d5-9c41-bdc549761a36 None admin] RBAC: Authorizing `identity:get_user(user_id=df27ddfb34374fed99b8b5d643046079)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:27.119215 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c3ed54-bd37-47d5-9c41-bdc549761a36 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:27.121227 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 82/171] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Jun 22 08:34:26 2022] GET /identity/v3/users/df27ddfb34374fed99b8b5d643046079 => generated 275 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:27.146311 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c3ed54-bd37-47d5-9c41-bdc549761a36 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:27.179672 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ef08aa-81d6-4c5c-af7f-d439e95a494d None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:27.217448 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:27.224945 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6492198-b82c-4010-b416-f5fd7ccfc354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:27.225772 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6492198-b82c-4010-b416-f5fd7ccfc354 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:27.226058 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6492198-b82c-4010-b416-f5fd7ccfc354 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:27.226385 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6492198-b82c-4010-b416-f5fd7ccfc354 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:27.240445 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6492198-b82c-4010-b416-f5fd7ccfc354 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:34:27.249483 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-d6492198-b82c-4010-b416-f5fd7ccfc354 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:34:27.249483 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:34:27.249483 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:34:27.249483 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:34:27.249483 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:34:27.249483 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:34:27.249483 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:34:27.249483 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:34:27.249483 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:34:27.249483 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:34:27.249483 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:34:27.249483 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:34:27.249483 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:34:27.249483 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:34:27.249483 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:34:27.249483 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:34:27.251707 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:34:27.251707 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:34:27.251707 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:34:27.251707 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:34:27.251707 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:34:27.251707 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:34:27.251707 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:34:27.251707 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:34:27.251707 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:34:27.251707 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:34:27.251707 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:34:27.251707 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:34:27.251707 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:34:27.251707 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:34:27.251707 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:34:27.251707 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:34:27.253617 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:34:27.253617 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:34:27.253617 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:34:27.253617 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:34:27.253617 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:34:27.253617 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:34:27.253617 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:34:27.253617 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:34:27.253617 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:34:27.253617 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:34:27.253617 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:34:27.253617 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:34:27.253617 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 90/172] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Jun 22 08:34:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:34:27.266278 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6492198-b82c-4010-b416-f5fd7ccfc354 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:27.393193 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6492198-b82c-4010-b416-f5fd7ccfc354 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:27.411612 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:27.416601 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c3ed54-bd37-47d5-9c41-bdc549761a36 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:27.458935 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21dde93-fd25-4a60-97af-b5541029fc47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:27.459636 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21dde93-fd25-4a60-97af-b5541029fc47 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:27.459927 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21dde93-fd25-4a60-97af-b5541029fc47 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:27.460212 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21dde93-fd25-4a60-97af-b5541029fc47 None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:27.460986 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21dde93-fd25-4a60-97af-b5541029fc47 None admin] RBAC: Adding query filter params (name=member) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:27.461300 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21dde93-fd25-4a60-97af-b5541029fc47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:27.462734 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21dde93-fd25-4a60-97af-b5541029fc47 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:27.478856 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb328b89-45c3-4582-8bbc-3cba06eaae0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:27.479302 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 91/173] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Jun 22 08:34:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:27.479533 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb328b89-45c3-4582-8bbc-3cba06eaae0e None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:27.479825 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb328b89-45c3-4582-8bbc-3cba06eaae0e None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:27.480110 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb328b89-45c3-4582-8bbc-3cba06eaae0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:27.487608 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21dde93-fd25-4a60-97af-b5541029fc47 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:27.620452 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb328b89-45c3-4582-8bbc-3cba06eaae0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:27.622229 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb328b89-45c3-4582-8bbc-3cba06eaae0e None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:27.662342 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:27.689066 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21dde93-fd25-4a60-97af-b5541029fc47 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:27.725946 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef30fb2-fa14-461a-86b9-b38b1d4b405d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:27.728485 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef30fb2-fa14-461a-86b9-b38b1d4b405d None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:27.728771 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef30fb2-fa14-461a-86b9-b38b1d4b405d None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:27.729050 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef30fb2-fa14-461a-86b9-b38b1d4b405d None admin] PATH_INFO: `/v3/users/df27ddfb34374fed99b8b5d643046079` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:27.732476 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef30fb2-fa14-461a-86b9-b38b1d4b405d None admin] RBAC: Authorizing `identity:get_user(user_id=df27ddfb34374fed99b8b5d643046079)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:27.733947 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef30fb2-fa14-461a-86b9-b38b1d4b405d None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:27.735954 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 92/174] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Jun 22 08:34:27 2022] GET /identity/v3/users/df27ddfb34374fed99b8b5d643046079 => generated 275 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:27.741273 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef30fb2-fa14-461a-86b9-b38b1d4b405d None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:27.781010 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:27.804795 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 83/175] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Jun 22 08:34:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 659 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:34:27.829678 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb328b89-45c3-4582-8bbc-3cba06eaae0e None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:27.867665 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef30fb2-fa14-461a-86b9-b38b1d4b405d None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:27.904756 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca46a5-6124-47c6-939d-e7ef56b57c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:27.905417 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca46a5-6124-47c6-939d-e7ef56b57c4c None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:27.905700 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca46a5-6124-47c6-939d-e7ef56b57c4c None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:27.905974 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca46a5-6124-47c6-939d-e7ef56b57c4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:27.979480 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deca46a5-6124-47c6-939d-e7ef56b57c4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:27.980897 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deca46a5-6124-47c6-939d-e7ef56b57c4c None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:28.011113 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb328b89-45c3-4582-8bbc-3cba06eaae0e None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:28.015712 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:28.054441 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:28.071729 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9eb76b-4f3f-4e33-9670-66d8e8d1fadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:28.072604 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9eb76b-4f3f-4e33-9670-66d8e8d1fadd None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:28.072889 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9eb76b-4f3f-4e33-9670-66d8e8d1fadd None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:28.073164 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9eb76b-4f3f-4e33-9670-66d8e8d1fadd None admin] PATH_INFO: `/v3/projects/68c923ae1ea74d589e86978e4dd415c2` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:28.078821 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9eb76b-4f3f-4e33-9670-66d8e8d1fadd None admin] RBAC: Authorizing `identity:get_project(project_id=68c923ae1ea74d589e86978e4dd415c2)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:28.080287 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9eb76b-4f3f-4e33-9670-66d8e8d1fadd None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:28.082254 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 84/176] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Jun 22 08:34:27 2022] GET /identity/v3/projects/68c923ae1ea74d589e86978e4dd415c2 => generated 298 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:28.091256 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 93/177] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Jun 22 08:34:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 22 08:34:28.093122 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9eb76b-4f3f-4e33-9670-66d8e8d1fadd None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:28.096827 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca46a5-6124-47c6-939d-e7ef56b57c4c None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:28.203529 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca46a5-6124-47c6-939d-e7ef56b57c4c None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:28.240545 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d7fff-6624-42ab-b9c1-36ea4e053a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:28.241324 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d7fff-6624-42ab-b9c1-36ea4e053a15 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:28.241604 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d7fff-6624-42ab-b9c1-36ea4e053a15 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:28.241880 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d7fff-6624-42ab-b9c1-36ea4e053a15 None admin] PATH_INFO: `/v3/projects/c3d685c0c2b54c219d4a2ff337bdc18e` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:28.243133 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545d7fff-6624-42ab-b9c1-36ea4e053a15 None admin] RBAC: Authorizing `identity:get_project(project_id=c3d685c0c2b54c219d4a2ff337bdc18e)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:28.244594 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545d7fff-6624-42ab-b9c1-36ea4e053a15 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:28.246333 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 94/178] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Jun 22 08:34:28 2022] GET /identity/v3/projects/c3d685c0c2b54c219d4a2ff337bdc18e => generated 312 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:34:28.247531 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d2679-a7d4-4e19-9f22-38b3e8513de4 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:28.247818 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d2679-a7d4-4e19-9f22-38b3e8513de4 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:28.248096 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d2679-a7d4-4e19-9f22-38b3e8513de4 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:28.249339 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 95/179] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:34:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:34:28.258655 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9eb76b-4f3f-4e33-9670-66d8e8d1fadd None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:28.258859 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137b124-39da-4d61-80f9-492158dab31f None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:28.259072 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137b124-39da-4d61-80f9-492158dab31f None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:28.259264 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137b124-39da-4d61-80f9-492158dab31f None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:28.260831 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 96/180] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:34:28 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:34:28.261851 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2175d-761a-408c-9b39-522e78181d7d None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:28.262167 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2175d-761a-408c-9b39-522e78181d7d None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:28.262448 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2175d-761a-408c-9b39-522e78181d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:28.271062 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:28.287535 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-6af2175d-761a-408c-9b39-522e78181d7d None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:34:28.289355 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-6af2175d-761a-408c-9b39-522e78181d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:34:28.298003 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c84e4b-3983-4094-a633-b102c1581bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:28.298707 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c84e4b-3983-4094-a633-b102c1581bfd None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:28.299132 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c84e4b-3983-4094-a633-b102c1581bfd None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:28.299748 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c84e4b-3983-4094-a633-b102c1581bfd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:28.300593 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c84e4b-3983-4094-a633-b102c1581bfd None admin] RBAC: Adding query filter params (role.id=a92b520fb33f4333aad569d98be2bd7e, scope.project.id=68c923ae1ea74d589e86978e4dd415c2, user.id=df27ddfb34374fed99b8b5d643046079) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:28.301472 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c84e4b-3983-4094-a633-b102c1581bfd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:28.302958 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c84e4b-3983-4094-a633-b102c1581bfd None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:28.309112 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 85/181] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Jun 22 08:34:28 2022] GET /identity/v3/role_assignments?user.id=df27ddfb34374fed99b8b5d643046079&scope.project.id=68c923ae1ea74d589e86978e4dd415c2&role.id=a92b520fb33f4333aad569d98be2bd7e => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:34:28.310098 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c84e4b-3983-4094-a633-b102c1581bfd None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:28.381671 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:28.389454 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 97/182] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:34:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:34:28.396126 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc49d63-caf8-4eaa-bfe5-e588f8d97d63 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:28.397062 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc49d63-caf8-4eaa-bfe5-e588f8d97d63 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:28.397467 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc49d63-caf8-4eaa-bfe5-e588f8d97d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:28.427365 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-9cc49d63-caf8-4eaa-bfe5-e588f8d97d63 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:34:28.429007 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-9cc49d63-caf8-4eaa-bfe5-e588f8d97d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:34:28.449831 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c84e4b-3983-4094-a633-b102c1581bfd None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:28.499521 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd15792-0f1f-4003-b7d3-be4f3caf1258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:28.499521 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd15792-0f1f-4003-b7d3-be4f3caf1258 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:28.499763 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd15792-0f1f-4003-b7d3-be4f3caf1258 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:28.500029 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd15792-0f1f-4003-b7d3-be4f3caf1258 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:28.500871 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd15792-0f1f-4003-b7d3-be4f3caf1258 None admin] RBAC: Adding query filter params (role.id=5ea101070f734fa59995615179f2eff2, scope.project.id=c3d685c0c2b54c219d4a2ff337bdc18e, user.id=df27ddfb34374fed99b8b5d643046079) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:28.501183 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd15792-0f1f-4003-b7d3-be4f3caf1258 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:28.504449 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd15792-0f1f-4003-b7d3-be4f3caf1258 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:28.506972 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 98/183] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:34:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:34:28.510987 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 86/184] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Jun 22 08:34:28 2022] GET /identity/v3/role_assignments?user.id=df27ddfb34374fed99b8b5d643046079&scope.project.id=c3d685c0c2b54c219d4a2ff337bdc18e&role.id=5ea101070f734fa59995615179f2eff2 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:28.510987 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd15792-0f1f-4003-b7d3-be4f3caf1258 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:28.515412 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfc45d8-bb2e-49c4-ad2d-cc64508f600c None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:28.515714 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfc45d8-bb2e-49c4-ad2d-cc64508f600c None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:28.516000 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfc45d8-bb2e-49c4-ad2d-cc64508f600c None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:28.517621 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 99/185] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:34:28 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:34:28.527656 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72fb726-aade-4a69-b869-07fc5b939883 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:28.527968 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72fb726-aade-4a69-b869-07fc5b939883 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:28.528234 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72fb726-aade-4a69-b869-07fc5b939883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:28.555627 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-f72fb726-aade-4a69-b869-07fc5b939883 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:34:28.556828 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-f72fb726-aade-4a69-b869-07fc5b939883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:34:28.632278 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:28.647179 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 100/186] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:34:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:34:28.648064 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72fb726-aade-4a69-b869-07fc5b939883 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:28.653497 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd15792-0f1f-4003-b7d3-be4f3caf1258 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:28.684618 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:28.700200 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41026159-f910-48db-849d-919e92953397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:28.701004 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41026159-f910-48db-849d-919e92953397 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:28.701294 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41026159-f910-48db-849d-919e92953397 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:28.701690 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41026159-f910-48db-849d-919e92953397 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:28.714471 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41026159-f910-48db-849d-919e92953397 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:34:28.722186 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-41026159-f910-48db-849d-919e92953397 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 08:34:28.722186 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:34:28.722186 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:34:28.722186 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:34:28.722186 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:34:28.722186 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:34:28.722186 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:34:28.722186 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:34:28.722186 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:34:28.722186 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:34:28.722186 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:34:28.722186 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:34:28.722186 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:34:28.722186 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:34:28.722186 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:34:28.722186 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:34:28.723592 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:34:28.723592 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:34:28.723592 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:34:28.723592 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:34:28.723592 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:34:28.723592 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:34:28.723592 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:34:28.723592 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:34:28.723592 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:34:28.723592 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:34:28.723592 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:34:28.723592 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:34:28.723592 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:34:28.723592 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:34:28.723592 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:34:28.723592 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:34:28.724377 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:34:28.724377 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:34:28.724377 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:34:28.724377 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:34:28.724377 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:34:28.724377 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:34:28.724377 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:34:28.724377 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:34:28.724377 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:34:28.724377 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:34:28.724377 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 08:34:28.724377 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:34:28.729346 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 87/187] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Jun 22 08:34:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:34:28.730818 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e0f0f-708b-47cd-bcc8-860afa152986 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:28.731111 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e0f0f-708b-47cd-bcc8-860afa152986 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:28.731390 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e0f0f-708b-47cd-bcc8-860afa152986 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:28.732831 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 88/188] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:34:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:34:28.733453 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e0f0f-708b-47cd-bcc8-860afa152986 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:28.775276 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72fb726-aade-4a69-b869-07fc5b939883 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:28.809948 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5edeb15-1481-4d0b-a2e3-16ba7ab319a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:28.810774 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5edeb15-1481-4d0b-a2e3-16ba7ab319a5 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:28.811060 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5edeb15-1481-4d0b-a2e3-16ba7ab319a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:28.811341 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5edeb15-1481-4d0b-a2e3-16ba7ab319a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:28.822759 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5edeb15-1481-4d0b-a2e3-16ba7ab319a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:34:28.830480 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-f5edeb15-1481-4d0b-a2e3-16ba7ab319a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:34:28.830480 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:34:28.830480 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:34:28.830480 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:34:28.830480 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:34:28.830480 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:34:28.830480 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:34:28.830480 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:34:28.830480 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:34:28.830480 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:34:28.830480 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:34:28.830480 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:34:28.830480 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:34:28.830480 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:34:28.830480 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:34:28.830480 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:34:28.831670 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:34:28.831670 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:34:28.831670 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:34:28.831670 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:34:28.831670 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:34:28.831670 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:34:28.831670 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:34:28.831670 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:34:28.831670 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:34:28.831670 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:34:28.831670 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:34:28.831670 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:34:28.831670 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:34:28.831670 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:34:28.831670 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:34:28.831670 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:34:28.833083 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:34:28.833083 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:34:28.833083 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:34:28.833083 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:34:28.833083 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:34:28.833083 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:34:28.833083 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:34:28.833083 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:34:28.833083 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:34:28.833083 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:34:28.833083 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:34:28.833083 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:34:28.833083 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 101/189] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Jun 22 08:34:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:34:28.833083 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5edeb15-1481-4d0b-a2e3-16ba7ab319a5 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:28.845803 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e0f0f-708b-47cd-bcc8-860afa152986 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:28.885352 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d060e200-cbbd-4f67-8b68-1cef25384037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:28.886189 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d060e200-cbbd-4f67-8b68-1cef25384037 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:28.886471 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d060e200-cbbd-4f67-8b68-1cef25384037 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:28.886744 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d060e200-cbbd-4f67-8b68-1cef25384037 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:28.894700 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:28.897372 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d060e200-cbbd-4f67-8b68-1cef25384037 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:34:28.905443 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-d060e200-cbbd-4f67-8b68-1cef25384037 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:34:28.905443 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:34:28.905443 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:34:28.905443 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:34:28.905443 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:34:28.905443 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:34:28.905443 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:34:28.905443 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:34:28.905443 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:34:28.905443 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:34:28.905443 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:34:28.905443 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:34:28.905443 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:34:28.905443 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:34:28.905443 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:34:28.905443 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:34:28.906514 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:34:28.906514 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:34:28.906514 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:34:28.906514 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:34:28.906514 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:34:28.906514 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:34:28.906514 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:34:28.906514 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:34:28.906514 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:34:28.906514 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:34:28.906514 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:34:28.906514 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:34:28.906514 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:34:28.906514 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:34:28.906514 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:34:28.906514 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:34:28.912788 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:34:28.912788 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:34:28.912788 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:34:28.912788 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:34:28.912788 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:34:28.912788 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:34:28.912788 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:34:28.912788 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:34:28.912788 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:34:28.912788 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:34:28.912788 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:34:28.912788 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:34:28.912788 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 89/190] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Jun 22 08:34:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:34:28.912788 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32bfe96-25e9-406e-aa33-1294415b13bc None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:28.913470 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32bfe96-25e9-406e-aa33-1294415b13bc None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:28.913470 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32bfe96-25e9-406e-aa33-1294415b13bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:28.927473 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-e32bfe96-25e9-406e-aa33-1294415b13bc None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:34:28.928629 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-e32bfe96-25e9-406e-aa33-1294415b13bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:34:28.941607 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5edeb15-1481-4d0b-a2e3-16ba7ab319a5 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:28.964220 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:28.977275 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d1e8b-e16f-49d3-94ec-491b30fb1626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:28.977942 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d1e8b-e16f-49d3-94ec-491b30fb1626 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:28.978309 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d1e8b-e16f-49d3-94ec-491b30fb1626 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:28.978527 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d1e8b-e16f-49d3-94ec-491b30fb1626 None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:28.979283 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d1e8b-e16f-49d3-94ec-491b30fb1626 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:28.979593 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d1e8b-e16f-49d3-94ec-491b30fb1626 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:28.980996 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d1e8b-e16f-49d3-94ec-491b30fb1626 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:28.988990 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 102/191] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Jun 22 08:34:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:28.993482 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d1e8b-e16f-49d3-94ec-491b30fb1626 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:28.998964 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 90/192] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:34:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:34:28.999812 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32bfe96-25e9-406e-aa33-1294415b13bc None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:29.094589 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d1e8b-e16f-49d3-94ec-491b30fb1626 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:29.099333 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32bfe96-25e9-406e-aa33-1294415b13bc None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:29.108768 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:29.128876 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ef052-0978-49ab-80b3-2b2adf18b31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:29.129544 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ef052-0978-49ab-80b3-2b2adf18b31d None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:29.129827 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ef052-0978-49ab-80b3-2b2adf18b31d None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:29.130131 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ef052-0978-49ab-80b3-2b2adf18b31d None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:29.130885 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315ef052-0978-49ab-80b3-2b2adf18b31d None admin] RBAC: Adding query filter params (name=admin) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:29.131198 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315ef052-0978-49ab-80b3-2b2adf18b31d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:29.132595 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315ef052-0978-49ab-80b3-2b2adf18b31d None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:29.133503 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b5a3f8-a075-466e-ad3b-5f9975b61784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:29.134186 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5a3f8-a075-466e-ad3b-5f9975b61784 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:29.134467 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5a3f8-a075-466e-ad3b-5f9975b61784 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:29.134746 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5a3f8-a075-466e-ad3b-5f9975b61784 None admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:29.135489 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b5a3f8-a075-466e-ad3b-5f9975b61784 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:29.135793 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b5a3f8-a075-466e-ad3b-5f9975b61784 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:29.137239 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b5a3f8-a075-466e-ad3b-5f9975b61784 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:29.140857 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 103/193] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Jun 22 08:34:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:29.141641 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ef052-0978-49ab-80b3-2b2adf18b31d None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:29.146018 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 91/194] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Jun 22 08:34:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:29.146891 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b5a3f8-a075-466e-ad3b-5f9975b61784 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:29.181105 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:29.241835 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ef052-0978-49ab-80b3-2b2adf18b31d None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:29.247356 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b5a3f8-a075-466e-ad3b-5f9975b61784 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:29.276063 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20baba16-280b-4954-972d-4603c241f84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:29.276968 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20baba16-280b-4954-972d-4603c241f84f None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:29.277255 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20baba16-280b-4954-972d-4603c241f84f None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:29.277528 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20baba16-280b-4954-972d-4603c241f84f None admin] PATH_INFO: `/v3/users/424948f8f3e8434dae1ee2753fa22bd4` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:29.278736 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20baba16-280b-4954-972d-4603c241f84f None admin] RBAC: Authorizing `identity:get_user(user_id=424948f8f3e8434dae1ee2753fa22bd4)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:29.280193 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20baba16-280b-4954-972d-4603c241f84f None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:29.281758 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345fc3a5-19a8-4b64-9e3d-1b30ab644ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:29.282460 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 104/195] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Jun 22 08:34:29 2022] GET /identity/v3/users/424948f8f3e8434dae1ee2753fa22bd4 => generated 289 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:29.282569 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345fc3a5-19a8-4b64-9e3d-1b30ab644ff2 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:29.282841 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345fc3a5-19a8-4b64-9e3d-1b30ab644ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:29.283115 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345fc3a5-19a8-4b64-9e3d-1b30ab644ff2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:29.283220 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20baba16-280b-4954-972d-4603c241f84f None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:29.284276 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345fc3a5-19a8-4b64-9e3d-1b30ab644ff2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:29.285793 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345fc3a5-19a8-4b64-9e3d-1b30ab644ff2 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:29.287478 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 92/196] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:34:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:29.288827 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345fc3a5-19a8-4b64-9e3d-1b30ab644ff2 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:29.330609 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:29.386727 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20baba16-280b-4954-972d-4603c241f84f None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:29.391696 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345fc3a5-19a8-4b64-9e3d-1b30ab644ff2 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:29.393209 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:29.420418 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f4e8b8-dfae-4c01-9312-b77bc395aced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:29.421289 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f4e8b8-dfae-4c01-9312-b77bc395aced None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:29.421572 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f4e8b8-dfae-4c01-9312-b77bc395aced None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:29.421845 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f4e8b8-dfae-4c01-9312-b77bc395aced None admin] PATH_INFO: `/v3/users/1fc9e1011e8a4eb38644e3a467a48897` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:29.427721 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc0b3b-2009-43de-8119-c6a1d10c1535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:29.428586 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc0b3b-2009-43de-8119-c6a1d10c1535 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:29.428872 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc0b3b-2009-43de-8119-c6a1d10c1535 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:29.429148 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc0b3b-2009-43de-8119-c6a1d10c1535 None admin] PATH_INFO: `/v3/users/1fc9e1011e8a4eb38644e3a467a48897` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:29.435417 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f4e8b8-dfae-4c01-9312-b77bc395aced None admin] RBAC: Authorizing `identity:get_user(user_id=1fc9e1011e8a4eb38644e3a467a48897)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:29.436911 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f4e8b8-dfae-4c01-9312-b77bc395aced None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:29.438776 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 105/197] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Jun 22 08:34:29 2022] GET /identity/v3/users/1fc9e1011e8a4eb38644e3a467a48897 => generated 283 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:29.439441 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f4e8b8-dfae-4c01-9312-b77bc395aced None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:29.447810 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc0b3b-2009-43de-8119-c6a1d10c1535 None admin] RBAC: Authorizing `identity:get_user(user_id=1fc9e1011e8a4eb38644e3a467a48897)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:29.449271 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc0b3b-2009-43de-8119-c6a1d10c1535 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:29.450991 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 93/198] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Jun 22 08:34:29 2022] GET /identity/v3/users/1fc9e1011e8a4eb38644e3a467a48897 => generated 283 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:29.451730 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc0b3b-2009-43de-8119-c6a1d10c1535 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:29.536651 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f4e8b8-dfae-4c01-9312-b77bc395aced None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:29.538170 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:29.567163 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc0b3b-2009-43de-8119-c6a1d10c1535 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:29.573289 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f058068-1bd5-47be-a282-20d721bda02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:29.573939 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f058068-1bd5-47be-a282-20d721bda02b None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:29.574252 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f058068-1bd5-47be-a282-20d721bda02b None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:29.574531 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f058068-1bd5-47be-a282-20d721bda02b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:29.600753 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5920eb4b-2eb7-4223-9a76-d78f401f31ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:29.601416 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5920eb4b-2eb7-4223-9a76-d78f401f31ef None admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:29.601698 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5920eb4b-2eb7-4223-9a76-d78f401f31ef None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:29.601973 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5920eb4b-2eb7-4223-9a76-d78f401f31ef None admin] PATH_INFO: `/v3/users` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:29.602711 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5920eb4b-2eb7-4223-9a76-d78f401f31ef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:29.604144 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5920eb4b-2eb7-4223-9a76-d78f401f31ef None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:29.629477 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 94/199] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Jun 22 08:34:29 2022] POST /identity/v3/users => generated 297 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:34:29.631428 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5920eb4b-2eb7-4223-9a76-d78f401f31ef None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:29.647476 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f058068-1bd5-47be-a282-20d721bda02b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:29.648902 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f058068-1bd5-47be-a282-20d721bda02b None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:29.652779 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:29.744255 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5920eb4b-2eb7-4223-9a76-d78f401f31ef None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:29.773732 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 106/200] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Jun 22 08:34:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:34:29.773732 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f058068-1bd5-47be-a282-20d721bda02b None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:29.774343 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:29.787797 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ba4b4-c2ed-4dcd-b737-b076c124e013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:29.788467 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ba4b4-c2ed-4dcd-b737-b076c124e013 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:29.788751 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ba4b4-c2ed-4dcd-b737-b076c124e013 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:29.789024 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ba4b4-c2ed-4dcd-b737-b076c124e013 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:29.872572 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ba4b4-c2ed-4dcd-b737-b076c124e013 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:29.874212 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ba4b4-c2ed-4dcd-b737-b076c124e013 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:29.896966 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:29.898394 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f058068-1bd5-47be-a282-20d721bda02b None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:29.942116 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d84df4-5f8e-4b3f-a252-b594fef4c255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:29.942776 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d84df4-5f8e-4b3f-a252-b594fef4c255 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:29.943119 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d84df4-5f8e-4b3f-a252-b594fef4c255 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:29.943395 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d84df4-5f8e-4b3f-a252-b594fef4c255 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:30.008347 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 95/201] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Jun 22 08:34:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:34:30.009790 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ba4b4-c2ed-4dcd-b737-b076c124e013 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:30.039960 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d84df4-5f8e-4b3f-a252-b594fef4c255 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:30.042017 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d84df4-5f8e-4b3f-a252-b594fef4c255 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:30.044207 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:30.119530 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ba4b4-c2ed-4dcd-b737-b076c124e013 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:30.136919 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:30.154620 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a089e-9d27-4529-80e5-58ff4e4614c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:30.155346 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a089e-9d27-4529-80e5-58ff4e4614c7 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:30.155628 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a089e-9d27-4529-80e5-58ff4e4614c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:30.155905 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a089e-9d27-4529-80e5-58ff4e4614c7 None admin] PATH_INFO: `/v3/projects/68c923ae1ea74d589e86978e4dd415c2` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:30.157293 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a089e-9d27-4529-80e5-58ff4e4614c7 None admin] RBAC: Authorizing `identity:get_project(project_id=68c923ae1ea74d589e86978e4dd415c2)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:30.158783 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a089e-9d27-4529-80e5-58ff4e4614c7 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:30.161062 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 96/202] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Jun 22 08:34:30 2022] GET /identity/v3/projects/68c923ae1ea74d589e86978e4dd415c2 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:30.165617 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a089e-9d27-4529-80e5-58ff4e4614c7 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:30.166090 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 107/203] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Jun 22 08:34:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:34:30.167638 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d84df4-5f8e-4b3f-a252-b594fef4c255 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:30.288327 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d84df4-5f8e-4b3f-a252-b594fef4c255 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:30.290736 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a089e-9d27-4529-80e5-58ff4e4614c7 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:30.310447 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:30.327586 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e507d-b1d5-4166-b873-af7dde7c4dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:30.328593 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e507d-b1d5-4166-b873-af7dde7c4dd6 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:30.328974 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e507d-b1d5-4166-b873-af7dde7c4dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:30.329347 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e507d-b1d5-4166-b873-af7dde7c4dd6 None admin] PATH_INFO: `/v3/projects/adfd1b153ab54652bb25b1b4a02bae1d` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:30.330676 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664e507d-b1d5-4166-b873-af7dde7c4dd6 None admin] RBAC: Authorizing `identity:get_project(project_id=adfd1b153ab54652bb25b1b4a02bae1d)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:30.332788 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664e507d-b1d5-4166-b873-af7dde7c4dd6 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:30.334692 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f26f2c6-e651-416c-a9b6-9ed410228817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:30.335228 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 97/204] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Jun 22 08:34:30 2022] GET /identity/v3/projects/adfd1b153ab54652bb25b1b4a02bae1d => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:30.335935 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e507d-b1d5-4166-b873-af7dde7c4dd6 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:30.336301 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26f2c6-e651-416c-a9b6-9ed410228817 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:30.336797 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26f2c6-e651-416c-a9b6-9ed410228817 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:30.337207 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26f2c6-e651-416c-a9b6-9ed410228817 None admin] PATH_INFO: `/v3/projects/adfd1b153ab54652bb25b1b4a02bae1d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:30.338598 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f26f2c6-e651-416c-a9b6-9ed410228817 None admin] RBAC: Authorizing `identity:get_project(project_id=adfd1b153ab54652bb25b1b4a02bae1d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:30.341609 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f26f2c6-e651-416c-a9b6-9ed410228817 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:30.343675 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 108/205] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Jun 22 08:34:30 2022] GET /identity/v3/projects/adfd1b153ab54652bb25b1b4a02bae1d => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:30.344568 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f26f2c6-e651-416c-a9b6-9ed410228817 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:30.398362 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:30.450301 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e507d-b1d5-4166-b873-af7dde7c4dd6 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:30.463883 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f26f2c6-e651-416c-a9b6-9ed410228817 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:30.486254 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f411b2-4e16-4da3-8609-e529fa898816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:30.487120 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f411b2-4e16-4da3-8609-e529fa898816 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:30.487486 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f411b2-4e16-4da3-8609-e529fa898816 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:30.487844 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f411b2-4e16-4da3-8609-e529fa898816 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:30.489528 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f411b2-4e16-4da3-8609-e529fa898816 None admin] RBAC: Adding query filter params (role.id=78088ffb8c224af39e594570dd740336, scope.project.id=68c923ae1ea74d589e86978e4dd415c2, user.id=424948f8f3e8434dae1ee2753fa22bd4) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:30.489904 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f411b2-4e16-4da3-8609-e529fa898816 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:30.492023 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f411b2-4e16-4da3-8609-e529fa898816 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:30.502954 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e782cfd3-5cd9-4b1f-917f-abb22abd352f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:30.504535 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782cfd3-5cd9-4b1f-917f-abb22abd352f None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:30.505046 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782cfd3-5cd9-4b1f-917f-abb22abd352f None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:30.505524 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782cfd3-5cd9-4b1f-917f-abb22abd352f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:30.506459 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 98/206] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Jun 22 08:34:30 2022] GET /identity/v3/role_assignments?user.id=424948f8f3e8434dae1ee2753fa22bd4&scope.project.id=68c923ae1ea74d589e86978e4dd415c2&role.id=78088ffb8c224af39e594570dd740336 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:30.506874 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e782cfd3-5cd9-4b1f-917f-abb22abd352f None admin] RBAC: Adding query filter params (role.id=c7518e0f532945af80c33860f2ac506d, scope.project.id=adfd1b153ab54652bb25b1b4a02bae1d, user.id=1fc9e1011e8a4eb38644e3a467a48897) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:30.507386 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e782cfd3-5cd9-4b1f-917f-abb22abd352f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:30.507503 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f411b2-4e16-4da3-8609-e529fa898816 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:30.509283 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e782cfd3-5cd9-4b1f-917f-abb22abd352f None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:30.516301 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 109/207] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Jun 22 08:34:30 2022] GET /identity/v3/role_assignments?user.id=1fc9e1011e8a4eb38644e3a467a48897&scope.project.id=adfd1b153ab54652bb25b1b4a02bae1d&role.id=c7518e0f532945af80c33860f2ac506d => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:30.635486 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f411b2-4e16-4da3-8609-e529fa898816 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:30.658484 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:30.674500 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed734a-5654-4c0f-8a72-f58fbfb078e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:30.675204 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed734a-5654-4c0f-8a72-f58fbfb078e9 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:30.675489 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed734a-5654-4c0f-8a72-f58fbfb078e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:30.675824 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed734a-5654-4c0f-8a72-f58fbfb078e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:30.676712 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed734a-5654-4c0f-8a72-f58fbfb078e9 None admin] RBAC: Adding query filter params (role.id=a92b520fb33f4333aad569d98be2bd7e, scope.project.id=adfd1b153ab54652bb25b1b4a02bae1d, user.id=1fc9e1011e8a4eb38644e3a467a48897) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:30.677030 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed734a-5654-4c0f-8a72-f58fbfb078e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:30.678586 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed734a-5654-4c0f-8a72-f58fbfb078e9 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:30.686591 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 99/208] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Jun 22 08:34:30 2022] GET /identity/v3/role_assignments?user.id=1fc9e1011e8a4eb38644e3a467a48897&scope.project.id=adfd1b153ab54652bb25b1b4a02bae1d&role.id=a92b520fb33f4333aad569d98be2bd7e => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:31.886828 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07cf6f8-bb52-451f-a752-701c78dcc4b6 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:31.887372 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07cf6f8-bb52-451f-a752-701c78dcc4b6 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:31.887449 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07cf6f8-bb52-451f-a752-701c78dcc4b6 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:31.889131 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 110/209] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:34:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:34:31.896151 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e46fc-1b01-4894-abfc-ac5a0cd2a831 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:31.896567 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e46fc-1b01-4894-abfc-ac5a0cd2a831 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:31.896833 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e46fc-1b01-4894-abfc-ac5a0cd2a831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:31.908646 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a98548-8ca7-44a3-8a77-4b840f01791c None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:31.908935 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a98548-8ca7-44a3-8a77-4b840f01791c None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:31.909217 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a98548-8ca7-44a3-8a77-4b840f01791c None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:31.911149 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 111/210] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:34:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:34:31.916130 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3414d64-e124-475b-9572-76f062feb109 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:31.916422 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3414d64-e124-475b-9572-76f062feb109 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:31.916706 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3414d64-e124-475b-9572-76f062feb109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:31.918443 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-9c8e46fc-1b01-4894-abfc-ac5a0cd2a831 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:34:31.919581 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-9c8e46fc-1b01-4894-abfc-ac5a0cd2a831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:34:31.934361 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-a3414d64-e124-475b-9572-76f062feb109 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:34:31.935744 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-a3414d64-e124-475b-9572-76f062feb109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:34:31.964622 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:32.002149 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 100/211] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:34:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:34:32.010134 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 112/212] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:34:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:34:32.025778 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e46fc-1b01-4894-abfc-ac5a0cd2a831 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:32.036396 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3414d64-e124-475b-9572-76f062feb109 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:32.145431 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e46fc-1b01-4894-abfc-ac5a0cd2a831 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:32.156570 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:32.157420 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3414d64-e124-475b-9572-76f062feb109 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:32.185983 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a18932e-37dc-4a08-851b-549e052facde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:32.186913 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a18932e-37dc-4a08-851b-549e052facde None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:32.187269 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a18932e-37dc-4a08-851b-549e052facde None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:32.187620 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a18932e-37dc-4a08-851b-549e052facde None admin] PATH_INFO: `/v3/roles/member` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:32.199383 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a18932e-37dc-4a08-851b-549e052facde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:34:32.204364 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3806727-b7df-44f4-9277-d3d58f890bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:32.205398 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3806727-b7df-44f4-9277-d3d58f890bde None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:32.205862 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3806727-b7df-44f4-9277-d3d58f890bde None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:32.206349 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3806727-b7df-44f4-9277-d3d58f890bde None admin] PATH_INFO: `/v3/domains/default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:32.207720 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3806727-b7df-44f4-9277-d3d58f890bde None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:32.208257 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-3a18932e-37dc-4a08-851b-549e052facde None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:34:32.208257 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:34:32.208257 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:34:32.208257 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:34:32.208257 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:34:32.208257 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:34:32.208257 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:34:32.208257 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:34:32.208257 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:34:32.208257 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:34:32.208257 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:34:32.208257 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:34:32.208257 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:34:32.208257 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:34:32.208257 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:34:32.208257 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:34:32.209107 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:34:32.209107 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:34:32.209107 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:34:32.209107 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:34:32.209107 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:34:32.209107 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:34:32.209107 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:34:32.209107 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:34:32.209107 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:34:32.209107 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:34:32.209107 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:34:32.209107 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:34:32.209107 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:34:32.209107 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:34:32.209107 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:34:32.209107 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:34:32.209889 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:34:32.209889 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:34:32.209889 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:34:32.209889 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:34:32.209889 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:34:32.209889 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:34:32.209889 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:34:32.209889 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:34:32.209889 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:34:32.209889 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:34:32.209889 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:34:32.209889 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:34:32.209889 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 101/213] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Jun 22 08:34:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:34:32.211398 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3806727-b7df-44f4-9277-d3d58f890bde None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:32.213178 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 113/214] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:34:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:34:32.218348 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a18932e-37dc-4a08-851b-549e052facde None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:32.219510 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3806727-b7df-44f4-9277-d3d58f890bde None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:32.264873 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:32.327358 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a18932e-37dc-4a08-851b-549e052facde None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:32.346271 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3806727-b7df-44f4-9277-d3d58f890bde None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:32.362019 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb17dc0d-6ecc-4304-a09c-0e0345ce8470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:32.362969 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17dc0d-6ecc-4304-a09c-0e0345ce8470 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:32.363970 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17dc0d-6ecc-4304-a09c-0e0345ce8470 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:32.364398 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17dc0d-6ecc-4304-a09c-0e0345ce8470 None admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:32.365345 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb17dc0d-6ecc-4304-a09c-0e0345ce8470 None admin] RBAC: Adding query filter params (name=member) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:32.365831 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb17dc0d-6ecc-4304-a09c-0e0345ce8470 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:32.367441 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb17dc0d-6ecc-4304-a09c-0e0345ce8470 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:32.376421 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 102/215] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Jun 22 08:34:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:32.382876 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb17dc0d-6ecc-4304-a09c-0e0345ce8470 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:32.386215 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e08b87-2872-42c3-a2d9-06e5c9482ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:32.386900 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e08b87-2872-42c3-a2d9-06e5c9482ee6 None admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:32.387182 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e08b87-2872-42c3-a2d9-06e5c9482ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:32.387455 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e08b87-2872-42c3-a2d9-06e5c9482ee6 None admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:32.388178 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e08b87-2872-42c3-a2d9-06e5c9482ee6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:32.389772 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e08b87-2872-42c3-a2d9-06e5c9482ee6 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:32.426270 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 114/216] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Jun 22 08:34:32 2022] POST /identity/v3/users => generated 297 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:34:32.427133 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:32.514467 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb17dc0d-6ecc-4304-a09c-0e0345ce8470 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:32.553942 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be74ec1f-5375-4790-b91f-b3ad1d6a9f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:32.554854 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be74ec1f-5375-4790-b91f-b3ad1d6a9f00 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:32.555139 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be74ec1f-5375-4790-b91f-b3ad1d6a9f00 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:32.555416 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be74ec1f-5375-4790-b91f-b3ad1d6a9f00 None admin] PATH_INFO: `/v3/users/41af391089274b1481c874f230a59c6f` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:32.571227 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be74ec1f-5375-4790-b91f-b3ad1d6a9f00 None admin] RBAC: Authorizing `identity:get_user(user_id=41af391089274b1481c874f230a59c6f)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:32.572704 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be74ec1f-5375-4790-b91f-b3ad1d6a9f00 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:32.575656 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 103/217] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Jun 22 08:34:32 2022] GET /identity/v3/users/41af391089274b1481c874f230a59c6f => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:32.581341 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e08b87-2872-42c3-a2d9-06e5c9482ee6 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:32.678106 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:32.694974 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e08b87-2872-42c3-a2d9-06e5c9482ee6 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:32.732714 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20f6469-55d5-4acf-b57a-a0bf614e3847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:32.733376 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f6469-55d5-4acf-b57a-a0bf614e3847 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:32.733656 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f6469-55d5-4acf-b57a-a0bf614e3847 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:32.733936 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f6469-55d5-4acf-b57a-a0bf614e3847 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:32.790238 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c14536-1943-4612-980b-1e1dd277a8a8 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:32.790550 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c14536-1943-4612-980b-1e1dd277a8a8 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:32.790731 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c14536-1943-4612-980b-1e1dd277a8a8 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:32.792129 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 104/218] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:34:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:34:32.793212 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e8d739-e817-4096-9b26-b0a3f7c8393d None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:32.793492 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e8d739-e817-4096-9b26-b0a3f7c8393d None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:32.793781 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e8d739-e817-4096-9b26-b0a3f7c8393d None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:32.795312 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 105/219] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:34:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:34:32.801120 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb6d69-62bd-4c61-814e-dad0214429a1 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:32.801411 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb6d69-62bd-4c61-814e-dad0214429a1 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:32.801688 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb6d69-62bd-4c61-814e-dad0214429a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:32.823179 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20f6469-55d5-4acf-b57a-a0bf614e3847 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:32.823518 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-9ccb6d69-62bd-4c61-814e-dad0214429a1 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:34:32.824643 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20f6469-55d5-4acf-b57a-a0bf614e3847 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:32.824749 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-9ccb6d69-62bd-4c61-814e-dad0214429a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:34:32.911770 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 106/220] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:34:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:34:32.912662 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de482ce8-af9c-4dba-8a8a-760e8fb4b92d None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:32.912957 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de482ce8-af9c-4dba-8a8a-760e8fb4b92d None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:32.913234 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de482ce8-af9c-4dba-8a8a-760e8fb4b92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:32.933862 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-de482ce8-af9c-4dba-8a8a-760e8fb4b92d None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:34:32.933862 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-de482ce8-af9c-4dba-8a8a-760e8fb4b92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:34:32.939393 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:32.952080 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:32.958123 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 115/221] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Jun 22 08:34:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:34:32.959077 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20f6469-55d5-4acf-b57a-a0bf614e3847 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:33.022420 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 107/222] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:34:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:34:33.023623 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de482ce8-af9c-4dba-8a8a-760e8fb4b92d None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:33.091958 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20f6469-55d5-4acf-b57a-a0bf614e3847 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:33.142931 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4b5a4c-fff9-4faf-985f-124c49e8b895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:33.143758 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b5a4c-fff9-4faf-985f-124c49e8b895 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:33.144048 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b5a4c-fff9-4faf-985f-124c49e8b895 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:33.145369 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b5a4c-fff9-4faf-985f-124c49e8b895 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:33.152143 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de482ce8-af9c-4dba-8a8a-760e8fb4b92d None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:33.158875 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4b5a4c-fff9-4faf-985f-124c49e8b895 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:34:33.170811 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-fb4b5a4c-fff9-4faf-985f-124c49e8b895 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:34:33.170811 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:34:33.170811 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:34:33.170811 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:34:33.170811 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:34:33.170811 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:34:33.170811 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:34:33.170811 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:34:33.170811 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:34:33.170811 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:34:33.170811 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:34:33.170811 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:34:33.170811 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:34:33.170811 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:34:33.170811 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:34:33.170811 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:34:33.171695 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:34:33.171695 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:34:33.171695 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:34:33.171695 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:34:33.171695 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:34:33.171695 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:34:33.171695 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:34:33.171695 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:34:33.171695 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:34:33.171695 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:34:33.171695 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:34:33.171695 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:34:33.171695 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:34:33.171695 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:34:33.171695 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:34:33.171695 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:34:33.172440 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:34:33.172440 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:34:33.172440 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:34:33.172440 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:34:33.172440 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:34:33.172440 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:34:33.172440 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:34:33.172440 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:34:33.172440 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:34:33.172440 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:34:33.172440 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:34:33.172440 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:34:33.172440 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 116/223] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Jun 22 08:34:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:34:33.173072 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4b5a4c-fff9-4faf-985f-124c49e8b895 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:33.199019 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33d5bc-bb68-4798-9d7f-123c2dc4ccd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:33.199828 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33d5bc-bb68-4798-9d7f-123c2dc4ccd9 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:33.200192 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33d5bc-bb68-4798-9d7f-123c2dc4ccd9 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:33.200462 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33d5bc-bb68-4798-9d7f-123c2dc4ccd9 None admin] PATH_INFO: `/v3/projects/adfd1b153ab54652bb25b1b4a02bae1d` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:33.201679 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f33d5bc-bb68-4798-9d7f-123c2dc4ccd9 None admin] RBAC: Authorizing `identity:get_project(project_id=adfd1b153ab54652bb25b1b4a02bae1d)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:33.203757 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f33d5bc-bb68-4798-9d7f-123c2dc4ccd9 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:33.205780 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 108/224] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Jun 22 08:34:33 2022] GET /identity/v3/projects/adfd1b153ab54652bb25b1b4a02bae1d => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:33.207422 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33d5bc-bb68-4798-9d7f-123c2dc4ccd9 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:33.233616 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:33.240495 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:33.304204 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4b5a4c-fff9-4faf-985f-124c49e8b895 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:33.344986 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c2716-cf8f-4639-a5ba-49224d61053c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:33.346347 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c2716-cf8f-4639-a5ba-49224d61053c None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:33.347018 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c2716-cf8f-4639-a5ba-49224d61053c None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:33.348515 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c2716-cf8f-4639-a5ba-49224d61053c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:33.351264 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33d5bc-bb68-4798-9d7f-123c2dc4ccd9 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:33.362502 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756c2716-cf8f-4639-a5ba-49224d61053c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:34:33.373315 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-756c2716-cf8f-4639-a5ba-49224d61053c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:34:33.373315 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:34:33.373315 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:34:33.373315 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:34:33.373315 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:34:33.373315 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:34:33.373315 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:34:33.373315 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:34:33.373315 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:34:33.373315 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:34:33.373315 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:34:33.373315 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:34:33.373315 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:34:33.373315 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:34:33.373315 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:34:33.373315 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:34:33.374570 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:34:33.374570 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:34:33.374570 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:34:33.374570 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:34:33.374570 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:34:33.374570 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:34:33.374570 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:34:33.374570 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:34:33.374570 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:34:33.374570 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:34:33.374570 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:34:33.374570 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:34:33.374570 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:34:33.374570 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:34:33.374570 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:34:33.374570 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:34:33.375461 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:34:33.375461 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:34:33.375461 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:34:33.375461 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:34:33.375461 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:34:33.375461 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:34:33.375461 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:34:33.375461 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:34:33.375461 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:34:33.375461 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:34:33.375461 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:34:33.375461 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:34:33.376034 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 117/225] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Jun 22 08:34:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:34:33.382921 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c2716-cf8f-4639-a5ba-49224d61053c None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:33.399671 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432aa12-7361-4f4f-94f8-328f000d9588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:33.400683 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432aa12-7361-4f4f-94f8-328f000d9588 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:33.401186 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432aa12-7361-4f4f-94f8-328f000d9588 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:33.401656 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432aa12-7361-4f4f-94f8-328f000d9588 None admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:33.402655 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4432aa12-7361-4f4f-94f8-328f000d9588 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:33.403159 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4432aa12-7361-4f4f-94f8-328f000d9588 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:33.404732 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4432aa12-7361-4f4f-94f8-328f000d9588 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:33.414638 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 109/226] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Jun 22 08:34:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:33.415870 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432aa12-7361-4f4f-94f8-328f000d9588 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:33.491228 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c2716-cf8f-4639-a5ba-49224d61053c None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:33.502535 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:33.509959 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:33.531165 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe5c12d-a944-4906-9434-3a70405412b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:33.531718 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432aa12-7361-4f4f-94f8-328f000d9588 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:33.531824 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5c12d-a944-4906-9434-3a70405412b9 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:33.532097 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5c12d-a944-4906-9434-3a70405412b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:33.532377 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5c12d-a944-4906-9434-3a70405412b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:33.533355 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe5c12d-a944-4906-9434-3a70405412b9 None admin] RBAC: Adding query filter params (role.id=5ea101070f734fa59995615179f2eff2, scope.project.id=adfd1b153ab54652bb25b1b4a02bae1d, user.id=41af391089274b1481c874f230a59c6f) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:33.533673 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe5c12d-a944-4906-9434-3a70405412b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:33.535715 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe5c12d-a944-4906-9434-3a70405412b9 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:33.541445 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 118/227] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Jun 22 08:34:33 2022] GET /identity/v3/role_assignments?user.id=41af391089274b1481c874f230a59c6f&scope.project.id=adfd1b153ab54652bb25b1b4a02bae1d&role.id=5ea101070f734fa59995615179f2eff2 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:33.542534 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe5c12d-a944-4906-9434-3a70405412b9 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:33.577320 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc7fb2-a820-40ce-87d5-0618dc83410b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:33.578508 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc7fb2-a820-40ce-87d5-0618dc83410b None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:33.578991 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc7fb2-a820-40ce-87d5-0618dc83410b None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:33.579512 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc7fb2-a820-40ce-87d5-0618dc83410b None admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:33.580465 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc7fb2-a820-40ce-87d5-0618dc83410b None admin] RBAC: Adding query filter params (name=admin) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:33.580967 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc7fb2-a820-40ce-87d5-0618dc83410b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:33.582751 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc7fb2-a820-40ce-87d5-0618dc83410b None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:33.592491 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 110/228] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Jun 22 08:34:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:33.598706 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc7fb2-a820-40ce-87d5-0618dc83410b None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:33.655983 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe5c12d-a944-4906-9434-3a70405412b9 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:33.696389 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf999a-3b19-414d-88ad-af2f5c82dfc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:33.697439 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf999a-3b19-414d-88ad-af2f5c82dfc0 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:33.697793 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf999a-3b19-414d-88ad-af2f5c82dfc0 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:33.698183 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf999a-3b19-414d-88ad-af2f5c82dfc0 None admin] PATH_INFO: `/v3/users/1fc9e1011e8a4eb38644e3a467a48897` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:33.699751 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcf999a-3b19-414d-88ad-af2f5c82dfc0 None admin] RBAC: Authorizing `identity:get_user(user_id=1fc9e1011e8a4eb38644e3a467a48897)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:33.701752 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcf999a-3b19-414d-88ad-af2f5c82dfc0 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:33.703530 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 119/229] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Jun 22 08:34:33 2022] GET /identity/v3/users/1fc9e1011e8a4eb38644e3a467a48897 => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:33.709041 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf999a-3b19-414d-88ad-af2f5c82dfc0 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:33.719678 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc7fb2-a820-40ce-87d5-0618dc83410b None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:33.758060 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60fed3-6ffb-46a0-93e0-392e912f45b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:33.759194 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60fed3-6ffb-46a0-93e0-392e912f45b9 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:33.759641 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60fed3-6ffb-46a0-93e0-392e912f45b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:33.760056 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60fed3-6ffb-46a0-93e0-392e912f45b9 None admin] PATH_INFO: `/v3/users/1fc9e1011e8a4eb38644e3a467a48897` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:33.761630 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae60fed3-6ffb-46a0-93e0-392e912f45b9 None admin] RBAC: Authorizing `identity:get_user(user_id=1fc9e1011e8a4eb38644e3a467a48897)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:33.763322 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae60fed3-6ffb-46a0-93e0-392e912f45b9 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:33.765512 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 111/230] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Jun 22 08:34:33 2022] GET /identity/v3/users/1fc9e1011e8a4eb38644e3a467a48897 => generated 283 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:33.770439 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:33.773053 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60fed3-6ffb-46a0-93e0-392e912f45b9 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:33.794454 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:33.861468 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf999a-3b19-414d-88ad-af2f5c82dfc0 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:33.901302 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9035e7ce-c0f3-4ebe-b7ad-f52a91c64b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:33.902192 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035e7ce-c0f3-4ebe-b7ad-f52a91c64b9d None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:33.902476 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035e7ce-c0f3-4ebe-b7ad-f52a91c64b9d None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:33.902744 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035e7ce-c0f3-4ebe-b7ad-f52a91c64b9d None admin] PATH_INFO: `/v3/projects/adfd1b153ab54652bb25b1b4a02bae1d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:33.904113 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9035e7ce-c0f3-4ebe-b7ad-f52a91c64b9d None admin] RBAC: Authorizing `identity:get_project(project_id=adfd1b153ab54652bb25b1b4a02bae1d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:33.905614 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9035e7ce-c0f3-4ebe-b7ad-f52a91c64b9d None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:33.908008 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 120/231] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Jun 22 08:34:33 2022] GET /identity/v3/projects/adfd1b153ab54652bb25b1b4a02bae1d => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:34:33.913375 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9035e7ce-c0f3-4ebe-b7ad-f52a91c64b9d None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:33.923761 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60fed3-6ffb-46a0-93e0-392e912f45b9 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:33.963704 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc1844-d82d-46aa-b48c-ea3ceecbfa00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:33.965229 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc1844-d82d-46aa-b48c-ea3ceecbfa00 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:33.965812 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc1844-d82d-46aa-b48c-ea3ceecbfa00 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:33.966445 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc1844-d82d-46aa-b48c-ea3ceecbfa00 None admin] PATH_INFO: `/v3/projects/adfd1b153ab54652bb25b1b4a02bae1d` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:33.967850 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dc1844-d82d-46aa-b48c-ea3ceecbfa00 None admin] RBAC: Authorizing `identity:get_project(project_id=adfd1b153ab54652bb25b1b4a02bae1d)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:33.969979 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dc1844-d82d-46aa-b48c-ea3ceecbfa00 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:33.972118 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 112/232] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Jun 22 08:34:33 2022] GET /identity/v3/projects/adfd1b153ab54652bb25b1b4a02bae1d => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:34:33.979261 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc1844-d82d-46aa-b48c-ea3ceecbfa00 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:34.086535 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:34.100563 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc1844-d82d-46aa-b48c-ea3ceecbfa00 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:34.145853 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9035e7ce-c0f3-4ebe-b7ad-f52a91c64b9d None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:34.161591 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:34.168862 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0270e765-64c7-4eca-ab56-b5845f5dc53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:34.169760 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270e765-64c7-4eca-ab56-b5845f5dc53a None admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:34.170040 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270e765-64c7-4eca-ab56-b5845f5dc53a None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:34.170388 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270e765-64c7-4eca-ab56-b5845f5dc53a None admin] PATH_INFO: `/v3/projects/adfd1b153ab54652bb25b1b4a02bae1d/users/1fc9e1011e8a4eb38644e3a467a48897/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:34.173618 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0270e765-64c7-4eca-ab56-b5845f5dc53a None admin] RBAC: Authorizing `identity:create_grant(project_id=adfd1b153ab54652bb25b1b4a02bae1d, user_id=1fc9e1011e8a4eb38644e3a467a48897, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:34.175102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0270e765-64c7-4eca-ab56-b5845f5dc53a None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:34.200668 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 113/233] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Jun 22 08:34:33 2022] PUT /identity/v3/projects/adfd1b153ab54652bb25b1b4a02bae1d/users/1fc9e1011e8a4eb38644e3a467a48897/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:34:34.219998 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d983b614-4fd4-462b-8b75-3042373cc09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:34.220993 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d983b614-4fd4-462b-8b75-3042373cc09d None admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:34.221279 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d983b614-4fd4-462b-8b75-3042373cc09d None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:34.221672 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d983b614-4fd4-462b-8b75-3042373cc09d None admin] PATH_INFO: `/v3/projects/adfd1b153ab54652bb25b1b4a02bae1d/users/1fc9e1011e8a4eb38644e3a467a48897/roles/a92b520fb33f4333aad569d98be2bd7e` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:34.224731 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d983b614-4fd4-462b-8b75-3042373cc09d None admin] RBAC: Authorizing `identity:create_grant(project_id=adfd1b153ab54652bb25b1b4a02bae1d, user_id=1fc9e1011e8a4eb38644e3a467a48897, role_id=a92b520fb33f4333aad569d98be2bd7e)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:34.226314 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d983b614-4fd4-462b-8b75-3042373cc09d None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:34.244766 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 121/234] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Jun 22 08:34:33 2022] PUT /identity/v3/projects/adfd1b153ab54652bb25b1b4a02bae1d/users/1fc9e1011e8a4eb38644e3a467a48897/roles/a92b520fb33f4333aad569d98be2bd7e => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:34:34.971774 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe251d-933c-48c4-96fc-00128af55461 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:34.972343 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe251d-933c-48c4-96fc-00128af55461 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:34.973125 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe251d-933c-48c4-96fc-00128af55461 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:34.974466 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 114/235] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:34:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:34:34.991528 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1fd0b8-10e7-4d51-a2ec-2f926a63ec9c None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:34.991817 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1fd0b8-10e7-4d51-a2ec-2f926a63ec9c None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:34.992099 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1fd0b8-10e7-4d51-a2ec-2f926a63ec9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:35.014729 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-4c1fd0b8-10e7-4d51-a2ec-2f926a63ec9c None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:34:35.015315 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f2d8f-432e-46d1-9612-1313a2644a3d None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:35.015609 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f2d8f-432e-46d1-9612-1313a2644a3d None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:35.015890 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f2d8f-432e-46d1-9612-1313a2644a3d None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:35.016097 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-4c1fd0b8-10e7-4d51-a2ec-2f926a63ec9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:34:35.017263 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 115/236] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:34:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:34:35.025441 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830cf542-937c-42f7-8ff2-2bee5b915aea None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:35.025726 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830cf542-937c-42f7-8ff2-2bee5b915aea None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:35.026007 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830cf542-937c-42f7-8ff2-2bee5b915aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:35.047645 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-830cf542-937c-42f7-8ff2-2bee5b915aea None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:34:35.049118 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-830cf542-937c-42f7-8ff2-2bee5b915aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:34:35.139629 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 122/237] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:34:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:34:35.141654 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 116/238] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:34:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:34:35.166127 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1fd0b8-10e7-4d51-a2ec-2f926a63ec9c None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:35.175273 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830cf542-937c-42f7-8ff2-2bee5b915aea None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:35.247474 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:35.287473 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830cf542-937c-42f7-8ff2-2bee5b915aea None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:35.306814 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:35.314788 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1fd0b8-10e7-4d51-a2ec-2f926a63ec9c None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:35.352133 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b0467-985a-40ff-9ee5-6f29c6644e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:35.352942 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b0467-985a-40ff-9ee5-6f29c6644e1a None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:35.353225 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b0467-985a-40ff-9ee5-6f29c6644e1a None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:35.353504 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b0467-985a-40ff-9ee5-6f29c6644e1a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:35.353606 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458a3bc0-6df2-4a6c-ad70-4127540e2ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:35.354435 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a3bc0-6df2-4a6c-ad70-4127540e2ca0 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:35.354721 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a3bc0-6df2-4a6c-ad70-4127540e2ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:35.355001 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a3bc0-6df2-4a6c-ad70-4127540e2ca0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:35.356236 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458a3bc0-6df2-4a6c-ad70-4127540e2ca0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:35.357713 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458a3bc0-6df2-4a6c-ad70-4127540e2ca0 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:35.359487 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 123/239] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:34:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:34:35.365521 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458a3bc0-6df2-4a6c-ad70-4127540e2ca0 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:35.376299 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33b0467-985a-40ff-9ee5-6f29c6644e1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:34:35.384069 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-f33b0467-985a-40ff-9ee5-6f29c6644e1a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 08:34:35.384069 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:34:35.384069 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:34:35.384069 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:34:35.384069 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:34:35.384069 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:34:35.384069 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:34:35.384069 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:34:35.384069 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:34:35.384069 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:34:35.384069 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:34:35.384069 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:34:35.384069 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:34:35.384069 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:34:35.384069 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:34:35.384069 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:34:35.384941 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:34:35.384941 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:34:35.384941 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:34:35.384941 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:34:35.384941 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:34:35.384941 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:34:35.384941 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:34:35.384941 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:34:35.384941 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:34:35.384941 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:34:35.384941 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:34:35.384941 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:34:35.384941 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:34:35.384941 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:34:35.384941 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:34:35.384941 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:34:35.385709 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:34:35.385709 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:34:35.385709 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:34:35.385709 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:34:35.385709 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:34:35.385709 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:34:35.385709 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:34:35.385709 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:34:35.385709 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:34:35.385709 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:34:35.385709 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 08:34:35.385709 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:34:35.385709 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 117/240] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Jun 22 08:34:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:34:35.390826 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b0467-985a-40ff-9ee5-6f29c6644e1a None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:35.470969 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458a3bc0-6df2-4a6c-ad70-4127540e2ca0 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:35.515872 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11daa12-ca39-447e-bf5b-185f8424a7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:35.516567 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11daa12-ca39-447e-bf5b-185f8424a7a2 None admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:35.516919 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11daa12-ca39-447e-bf5b-185f8424a7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:35.517207 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11daa12-ca39-447e-bf5b-185f8424a7a2 None admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:35.518107 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11daa12-ca39-447e-bf5b-185f8424a7a2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:35.519890 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11daa12-ca39-447e-bf5b-185f8424a7a2 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:35.540126 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b0467-985a-40ff-9ee5-6f29c6644e1a None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:35.543145 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 124/241] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Jun 22 08:34:35 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 08:34:35.588558 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:35.602356 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc0c9d-d32d-4edf-b453-e3bb4a2d69a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:35.603057 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc0c9d-d32d-4edf-b453-e3bb4a2d69a0 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:35.603338 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc0c9d-d32d-4edf-b453-e3bb4a2d69a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:35.603612 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc0c9d-d32d-4edf-b453-e3bb4a2d69a0 None admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:35.604509 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dc0c9d-d32d-4edf-b453-e3bb4a2d69a0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:35.604822 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dc0c9d-d32d-4edf-b453-e3bb4a2d69a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:35.606297 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dc0c9d-d32d-4edf-b453-e3bb4a2d69a0 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:35.616143 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 118/242] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Jun 22 08:34:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:34:35.621651 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11daa12-ca39-447e-bf5b-185f8424a7a2 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:35.650543 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:35.753662 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11daa12-ca39-447e-bf5b-185f8424a7a2 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:35.800237 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c576c83f-17d6-4541-b6b6-99a268e27840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:35.801603 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576c83f-17d6-4541-b6b6-99a268e27840 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:35.801887 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576c83f-17d6-4541-b6b6-99a268e27840 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:35.802200 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576c83f-17d6-4541-b6b6-99a268e27840 None admin] PATH_INFO: `/v3/users/274a3b23d29242708eca1798a05ba828` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:35.820105 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c576c83f-17d6-4541-b6b6-99a268e27840 None admin] RBAC: Authorizing `identity:get_user(user_id=274a3b23d29242708eca1798a05ba828)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:35.821606 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c576c83f-17d6-4541-b6b6-99a268e27840 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:35.823736 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 125/243] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Jun 22 08:34:35 2022] GET /identity/v3/users/274a3b23d29242708eca1798a05ba828 => generated 297 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:35.828832 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc0c9d-d32d-4edf-b453-e3bb4a2d69a0 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:35.960731 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc0c9d-d32d-4edf-b453-e3bb4a2d69a0 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:36.001298 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7dc1ee-8ba4-4cef-bd99-ff48cb1a67e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:36.002062 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7dc1ee-8ba4-4cef-bd99-ff48cb1a67e3 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:36.002310 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7dc1ee-8ba4-4cef-bd99-ff48cb1a67e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:36.002589 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7dc1ee-8ba4-4cef-bd99-ff48cb1a67e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:36.065789 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:36.076883 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7dc1ee-8ba4-4cef-bd99-ff48cb1a67e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:36.078564 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7dc1ee-8ba4-4cef-bd99-ff48cb1a67e3 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:36.199391 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 119/244] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Jun 22 08:34:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:34:36.204996 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c576c83f-17d6-4541-b6b6-99a268e27840 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:36.315124 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:36.342733 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c576c83f-17d6-4541-b6b6-99a268e27840 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:36.385715 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f61aa-4e96-4f8b-bb84-7e86b12efd16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:36.386626 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f61aa-4e96-4f8b-bb84-7e86b12efd16 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:36.386912 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f61aa-4e96-4f8b-bb84-7e86b12efd16 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:36.387196 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f61aa-4e96-4f8b-bb84-7e86b12efd16 None admin] PATH_INFO: `/v3/projects/adfd1b153ab54652bb25b1b4a02bae1d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:36.389084 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54f61aa-4e96-4f8b-bb84-7e86b12efd16 None admin] RBAC: Authorizing `identity:get_project(project_id=adfd1b153ab54652bb25b1b4a02bae1d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:36.390602 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54f61aa-4e96-4f8b-bb84-7e86b12efd16 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:36.392859 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 126/245] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Jun 22 08:34:36 2022] GET /identity/v3/projects/adfd1b153ab54652bb25b1b4a02bae1d => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:36.399160 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7dc1ee-8ba4-4cef-bd99-ff48cb1a67e3 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:36.515109 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:36.529509 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d7aa1e-4d2d-41d6-a363-35e460e0b349 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:36.529978 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d7aa1e-4d2d-41d6-a363-35e460e0b349 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:36.530352 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d7aa1e-4d2d-41d6-a363-35e460e0b349 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:36.531617 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7dc1ee-8ba4-4cef-bd99-ff48cb1a67e3 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:36.532205 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 127/246] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:34:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:34:36.544167 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ef525-a338-4cad-8a29-c8be1aa420f7 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:36.544467 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ef525-a338-4cad-8a29-c8be1aa420f7 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:36.544725 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ef525-a338-4cad-8a29-c8be1aa420f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:36.577849 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecae3d6-523c-42c1-a374-730e7472fe04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:36.578543 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecae3d6-523c-42c1-a374-730e7472fe04 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:36.578827 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecae3d6-523c-42c1-a374-730e7472fe04 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:36.579102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecae3d6-523c-42c1-a374-730e7472fe04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:36.579939 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecae3d6-523c-42c1-a374-730e7472fe04 None admin] RBAC: Adding query filter params (role.id=78088ffb8c224af39e594570dd740336, scope.project.id=adfd1b153ab54652bb25b1b4a02bae1d, user.id=274a3b23d29242708eca1798a05ba828) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:36.580320 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecae3d6-523c-42c1-a374-730e7472fe04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:36.582272 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecae3d6-523c-42c1-a374-730e7472fe04 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:36.587264 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-2a0ef525-a338-4cad-8a29-c8be1aa420f7 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:34:36.588492 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-2a0ef525-a338-4cad-8a29-c8be1aa420f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:34:36.594631 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 120/247] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Jun 22 08:34:36 2022] GET /identity/v3/role_assignments?user.id=274a3b23d29242708eca1798a05ba828&scope.project.id=adfd1b153ab54652bb25b1b4a02bae1d&role.id=78088ffb8c224af39e594570dd740336 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:36.700635 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 128/248] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:34:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:34:36.747650 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecae3d6-523c-42c1-a374-730e7472fe04 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:36.906582 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecae3d6-523c-42c1-a374-730e7472fe04 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:36.952769 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bfb7ad-78b3-4838-82fb-9717a18c1cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:36.953577 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bfb7ad-78b3-4838-82fb-9717a18c1cf1 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:36.953859 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bfb7ad-78b3-4838-82fb-9717a18c1cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:36.954157 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bfb7ad-78b3-4838-82fb-9717a18c1cf1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:36.958562 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dda593-a94f-41d1-89bf-d00980f386cb None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:36.958859 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dda593-a94f-41d1-89bf-d00980f386cb None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:36.959153 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dda593-a94f-41d1-89bf-d00980f386cb None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:36.961908 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 129/249] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:34:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:34:36.965170 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bfb7ad-78b3-4838-82fb-9717a18c1cf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:34:36.965977 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c38356-c04f-4e0f-9a00-7fde80f65b01 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:36.966304 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c38356-c04f-4e0f-9a00-7fde80f65b01 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:36.966593 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c38356-c04f-4e0f-9a00-7fde80f65b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:36.973784 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-02bfb7ad-78b3-4838-82fb-9717a18c1cf1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:34:36.973784 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:34:36.973784 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:34:36.973784 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:34:36.973784 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:34:36.973784 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:34:36.973784 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:34:36.973784 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:34:36.973784 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:34:36.973784 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:34:36.973784 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:34:36.973784 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:34:36.973784 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:34:36.973784 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:34:36.973784 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:34:36.973784 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:34:36.974683 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:34:36.974683 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:34:36.974683 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:34:36.974683 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:34:36.974683 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:34:36.974683 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:34:36.974683 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:34:36.974683 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:34:36.974683 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:34:36.974683 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:34:36.974683 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:34:36.974683 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:34:36.974683 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:34:36.974683 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:34:36.974683 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:34:36.974683 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:34:36.975460 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:34:36.975460 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:34:36.975460 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:34:36.975460 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:34:36.975460 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:34:36.975460 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:34:36.975460 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:34:36.975460 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:34:36.975460 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:34:36.975460 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:34:36.975460 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:34:36.975460 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:34:36.975460 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 121/250] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Jun 22 08:34:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:34:36.983006 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bfb7ad-78b3-4838-82fb-9717a18c1cf1 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:37.015497 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-b3c38356-c04f-4e0f-9a00-7fde80f65b01 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:34:37.016689 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-b3c38356-c04f-4e0f-9a00-7fde80f65b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:34:37.026327 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:37.187546 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 130/251] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:34:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:34:37.188807 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ec154-eb7a-493d-a8bc-5ff131c6d57c None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:37.189100 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ec154-eb7a-493d-a8bc-5ff131c6d57c None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:37.189688 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ec154-eb7a-493d-a8bc-5ff131c6d57c None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:37.191783 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 131/252] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:34:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:34:37.197887 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d523f22-0f07-440d-a94e-c56c18185969 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:37.198212 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d523f22-0f07-440d-a94e-c56c18185969 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:37.198489 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d523f22-0f07-440d-a94e-c56c18185969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:37.204813 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bfb7ad-78b3-4838-82fb-9717a18c1cf1 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:37.238961 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-1d523f22-0f07-440d-a94e-c56c18185969 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:34:37.240142 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-1d523f22-0f07-440d-a94e-c56c18185969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:34:37.242997 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:37.291795 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035202e6-8ca1-4d5f-9d70-0ec9f847e0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:37.292476 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035202e6-8ca1-4d5f-9d70-0ec9f847e0d6 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:37.292767 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035202e6-8ca1-4d5f-9d70-0ec9f847e0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:37.293045 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035202e6-8ca1-4d5f-9d70-0ec9f847e0d6 None admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:37.293796 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035202e6-8ca1-4d5f-9d70-0ec9f847e0d6 None admin] RBAC: Adding query filter params (name=member) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:37.294118 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035202e6-8ca1-4d5f-9d70-0ec9f847e0d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:37.295680 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035202e6-8ca1-4d5f-9d70-0ec9f847e0d6 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:37.307658 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 122/253] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Jun 22 08:34:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:37.313688 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035202e6-8ca1-4d5f-9d70-0ec9f847e0d6 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:37.375686 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 132/254] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:34:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:34:37.376368 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d523f22-0f07-440d-a94e-c56c18185969 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:37.444698 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:37.484968 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035202e6-8ca1-4d5f-9d70-0ec9f847e0d6 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:37.546721 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce27322-14fc-4700-8660-4e810cc913ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:37.547522 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce27322-14fc-4700-8660-4e810cc913ab None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:37.547806 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce27322-14fc-4700-8660-4e810cc913ab None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:37.548084 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce27322-14fc-4700-8660-4e810cc913ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:37.554313 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d523f22-0f07-440d-a94e-c56c18185969 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:37.570861 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce27322-14fc-4700-8660-4e810cc913ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:34:37.583694 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-9ce27322-14fc-4700-8660-4e810cc913ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:34:37.583694 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:34:37.583694 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:34:37.583694 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:34:37.583694 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:34:37.583694 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:34:37.583694 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:34:37.583694 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:34:37.583694 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:34:37.583694 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:34:37.583694 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:34:37.583694 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:34:37.583694 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:34:37.583694 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:34:37.583694 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:34:37.583694 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:34:37.584605 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:34:37.584605 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:34:37.584605 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:34:37.584605 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:34:37.584605 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:34:37.584605 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:34:37.584605 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:34:37.584605 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:34:37.584605 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:34:37.584605 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:34:37.584605 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:34:37.584605 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:34:37.584605 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:34:37.584605 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:34:37.584605 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:34:37.584605 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:34:37.585375 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:34:37.585375 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:34:37.585375 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:34:37.585375 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:34:37.585375 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:34:37.585375 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:34:37.585375 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:34:37.585375 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:34:37.585375 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:34:37.585375 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:34:37.585375 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:34:37.585375 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:34:37.585375 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 123/255] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Jun 22 08:34:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:34:37.586012 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce27322-14fc-4700-8660-4e810cc913ab None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:37.622286 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f24b209-b4bd-4531-bfc9-a0978c7fdd5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:37.623161 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24b209-b4bd-4531-bfc9-a0978c7fdd5b None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:37.623439 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24b209-b4bd-4531-bfc9-a0978c7fdd5b None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:37.623711 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24b209-b4bd-4531-bfc9-a0978c7fdd5b None admin] PATH_INFO: `/v3/users/41af391089274b1481c874f230a59c6f` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:37.625045 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f24b209-b4bd-4531-bfc9-a0978c7fdd5b None admin] RBAC: Authorizing `identity:get_user(user_id=41af391089274b1481c874f230a59c6f)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:37.627244 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f24b209-b4bd-4531-bfc9-a0978c7fdd5b None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:37.628903 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 133/256] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Jun 22 08:34:37 2022] GET /identity/v3/users/41af391089274b1481c874f230a59c6f => generated 297 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:37.629656 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f24b209-b4bd-4531-bfc9-a0978c7fdd5b None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:37.647583 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:37.771533 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce27322-14fc-4700-8660-4e810cc913ab None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:37.787775 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f24b209-b4bd-4531-bfc9-a0978c7fdd5b None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:37.828119 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b289b-e08e-4366-9fb5-3364fa3d420f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:37.829212 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b289b-e08e-4366-9fb5-3364fa3d420f None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:37.830808 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b289b-e08e-4366-9fb5-3364fa3d420f None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:37.831471 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b289b-e08e-4366-9fb5-3364fa3d420f None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:37.833715 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68b289b-e08e-4366-9fb5-3364fa3d420f None admin] RBAC: Adding query filter params (name=admin) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:37.834342 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68b289b-e08e-4366-9fb5-3364fa3d420f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:37.836086 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68b289b-e08e-4366-9fb5-3364fa3d420f None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:37.846772 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e489fb1-9e69-47b3-a7dc-7694528386b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:37.847874 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e489fb1-9e69-47b3-a7dc-7694528386b1 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:37.848322 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e489fb1-9e69-47b3-a7dc-7694528386b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:37.848738 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e489fb1-9e69-47b3-a7dc-7694528386b1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:37.855623 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 134/257] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Jun 22 08:34:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:37.856096 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:37.857507 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b289b-e08e-4366-9fb5-3364fa3d420f None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:37.874166 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e489fb1-9e69-47b3-a7dc-7694528386b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:34:37.883921 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-4e489fb1-9e69-47b3-a7dc-7694528386b1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:34:37.883921 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:34:37.883921 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:34:37.883921 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:34:37.883921 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:34:37.883921 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:34:37.883921 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:34:37.883921 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:34:37.883921 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:34:37.883921 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:34:37.883921 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:34:37.883921 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:34:37.883921 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:34:37.883921 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:34:37.883921 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:34:37.883921 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:34:37.884964 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:34:37.884964 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:34:37.884964 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:34:37.884964 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:34:37.884964 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:34:37.884964 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:34:37.884964 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:34:37.884964 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:34:37.884964 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:34:37.884964 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:34:37.884964 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:34:37.884964 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:34:37.884964 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:34:37.884964 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:34:37.884964 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:34:37.884964 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:34:37.885938 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:34:37.885938 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:34:37.885938 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:34:37.885938 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:34:37.885938 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:34:37.885938 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:34:37.885938 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:34:37.885938 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:34:37.885938 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:34:37.885938 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:34:37.885938 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:34:37.885938 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:34:37.896589 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 124/258] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Jun 22 08:34:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:34:37.899578 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e489fb1-9e69-47b3-a7dc-7694528386b1 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:38.009343 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:38.060468 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e489fb1-9e69-47b3-a7dc-7694528386b1 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:38.075654 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b289b-e08e-4366-9fb5-3364fa3d420f None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:38.122846 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a816dcd-095a-4e83-b6b0-fa097948f835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:38.123759 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a816dcd-095a-4e83-b6b0-fa097948f835 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:38.124048 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a816dcd-095a-4e83-b6b0-fa097948f835 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:38.124327 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a816dcd-095a-4e83-b6b0-fa097948f835 None admin] PATH_INFO: `/v3/projects/adfd1b153ab54652bb25b1b4a02bae1d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:38.127469 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a816dcd-095a-4e83-b6b0-fa097948f835 None admin] RBAC: Authorizing `identity:get_project(project_id=adfd1b153ab54652bb25b1b4a02bae1d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:38.129543 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a816dcd-095a-4e83-b6b0-fa097948f835 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:38.136541 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 135/259] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Jun 22 08:34:37 2022] GET /identity/v3/projects/adfd1b153ab54652bb25b1b4a02bae1d => generated 302 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:38.137585 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a816dcd-095a-4e83-b6b0-fa097948f835 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:38.150043 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9fa8a8-d94c-4d5e-a564-b0db8dc47ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:38.151296 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9fa8a8-d94c-4d5e-a564-b0db8dc47ee2 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:38.151736 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9fa8a8-d94c-4d5e-a564-b0db8dc47ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:38.152163 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9fa8a8-d94c-4d5e-a564-b0db8dc47ee2 None admin] PATH_INFO: `/v3/users/1fc9e1011e8a4eb38644e3a467a48897` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:38.153602 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9fa8a8-d94c-4d5e-a564-b0db8dc47ee2 None admin] RBAC: Authorizing `identity:get_user(user_id=1fc9e1011e8a4eb38644e3a467a48897)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:38.155301 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9fa8a8-d94c-4d5e-a564-b0db8dc47ee2 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:38.157109 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 125/260] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Jun 22 08:34:37 2022] GET /identity/v3/users/1fc9e1011e8a4eb38644e3a467a48897 => generated 283 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:38.158261 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9fa8a8-d94c-4d5e-a564-b0db8dc47ee2 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:38.231998 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:38.311604 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a816dcd-095a-4e83-b6b0-fa097948f835 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:38.350203 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff359d-9526-42c4-a2af-7897b07a4d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:38.351224 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff359d-9526-42c4-a2af-7897b07a4d75 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:38.351657 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff359d-9526-42c4-a2af-7897b07a4d75 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:38.352079 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff359d-9526-42c4-a2af-7897b07a4d75 None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:38.352975 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff359d-9526-42c4-a2af-7897b07a4d75 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:38.353465 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff359d-9526-42c4-a2af-7897b07a4d75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:38.354424 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9fa8a8-d94c-4d5e-a564-b0db8dc47ee2 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:38.355198 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff359d-9526-42c4-a2af-7897b07a4d75 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:38.358447 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:38.366680 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 136/261] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Jun 22 08:34:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:38.368025 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff359d-9526-42c4-a2af-7897b07a4d75 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:38.479402 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff359d-9526-42c4-a2af-7897b07a4d75 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:38.483715 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e74b66-d3f7-448a-86db-6b2c4746048d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:38.484638 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e74b66-d3f7-448a-86db-6b2c4746048d None admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:38.484921 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e74b66-d3f7-448a-86db-6b2c4746048d None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:38.485196 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e74b66-d3f7-448a-86db-6b2c4746048d None admin] PATH_INFO: `/v3/projects/adfd1b153ab54652bb25b1b4a02bae1d/users/41af391089274b1481c874f230a59c6f/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:38.487276 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e74b66-d3f7-448a-86db-6b2c4746048d None admin] RBAC: Authorizing `identity:create_grant(project_id=adfd1b153ab54652bb25b1b4a02bae1d, user_id=41af391089274b1481c874f230a59c6f, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:38.489389 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e74b66-d3f7-448a-86db-6b2c4746048d None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:38.517400 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bd126f-40a0-4104-94c4-b9dc0426fdea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:38.518415 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd126f-40a0-4104-94c4-b9dc0426fdea None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:38.518913 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd126f-40a0-4104-94c4-b9dc0426fdea None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:38.519398 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd126f-40a0-4104-94c4-b9dc0426fdea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:38.523793 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 126/262] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Jun 22 08:34:38 2022] PUT /identity/v3/projects/adfd1b153ab54652bb25b1b4a02bae1d/users/41af391089274b1481c874f230a59c6f/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:34:38.526166 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e74b66-d3f7-448a-86db-6b2c4746048d None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:38.638923 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bd126f-40a0-4104-94c4-b9dc0426fdea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:38.640918 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bd126f-40a0-4104-94c4-b9dc0426fdea None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:38.643702 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:38.755112 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e74b66-d3f7-448a-86db-6b2c4746048d None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:38.791889 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a244dc89-18cc-4098-a25f-e65d9fff2bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:38.793156 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244dc89-18cc-4098-a25f-e65d9fff2bdd None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:38.793156 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244dc89-18cc-4098-a25f-e65d9fff2bdd None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:38.793353 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244dc89-18cc-4098-a25f-e65d9fff2bdd None admin] PATH_INFO: `/v3/users/1fc9e1011e8a4eb38644e3a467a48897` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:38.794399 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:38.800153 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a244dc89-18cc-4098-a25f-e65d9fff2bdd None admin] RBAC: Authorizing `identity:get_user(user_id=1fc9e1011e8a4eb38644e3a467a48897)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:38.802364 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a244dc89-18cc-4098-a25f-e65d9fff2bdd None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:38.804292 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 127/263] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Jun 22 08:34:38 2022] GET /identity/v3/users/1fc9e1011e8a4eb38644e3a467a48897 => generated 283 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:38.809986 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a244dc89-18cc-4098-a25f-e65d9fff2bdd None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:38.822659 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 137/264] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Jun 22 08:34:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:34:38.828190 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bd126f-40a0-4104-94c4-b9dc0426fdea None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:38.946957 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a244dc89-18cc-4098-a25f-e65d9fff2bdd None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:38.980372 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:38.982923 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bd126f-40a0-4104-94c4-b9dc0426fdea None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:38.992658 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a871a5-5407-4b1d-90b5-e491e19775a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:38.993849 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a871a5-5407-4b1d-90b5-e491e19775a7 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:38.994173 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a871a5-5407-4b1d-90b5-e491e19775a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:38.994461 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a871a5-5407-4b1d-90b5-e491e19775a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:39.036519 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21ea4a9-7895-434c-a6e0-e28888d62ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:39.037667 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ea4a9-7895-434c-a6e0-e28888d62ae8 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:39.037954 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ea4a9-7895-434c-a6e0-e28888d62ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:39.038265 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ea4a9-7895-434c-a6e0-e28888d62ae8 None admin] PATH_INFO: `/v3/projects/adfd1b153ab54652bb25b1b4a02bae1d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:39.040231 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21ea4a9-7895-434c-a6e0-e28888d62ae8 None admin] RBAC: Authorizing `identity:get_project(project_id=adfd1b153ab54652bb25b1b4a02bae1d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:39.041699 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21ea4a9-7895-434c-a6e0-e28888d62ae8 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:39.044948 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 138/265] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Jun 22 08:34:38 2022] GET /identity/v3/projects/adfd1b153ab54652bb25b1b4a02bae1d => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:34:39.050279 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029a925-ebaa-4442-ab6a-2c74f37d4ba5 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:39.051494 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029a925-ebaa-4442-ab6a-2c74f37d4ba5 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:39.052149 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029a925-ebaa-4442-ab6a-2c74f37d4ba5 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:39.053681 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 139/266] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:34:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:34:39.059667 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671ea0d-0023-483c-bf9b-4b25d5f74d29 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:39.059954 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671ea0d-0023-483c-bf9b-4b25d5f74d29 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:39.060234 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671ea0d-0023-483c-bf9b-4b25d5f74d29 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:39.061680 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 140/267] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:34:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:34:39.066852 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9671ea0d-0023-483c-bf9b-4b25d5f74d29 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:39.083191 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:39.099215 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a871a5-5407-4b1d-90b5-e491e19775a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:39.101701 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a871a5-5407-4b1d-90b5-e491e19775a7 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:39.195531 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9671ea0d-0023-483c-bf9b-4b25d5f74d29 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:39.227312 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 128/268] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Jun 22 08:34:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:34:39.228945 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63629a-0480-468d-a892-7bbc41837876 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:39.229455 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63629a-0480-468d-a892-7bbc41837876 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:39.229930 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63629a-0480-468d-a892-7bbc41837876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:39.236558 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ee46c9-2ede-4e4b-ad58-010fdfbb93e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:39.237223 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee46c9-2ede-4e4b-ad58-010fdfbb93e6 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:39.237507 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee46c9-2ede-4e4b-ad58-010fdfbb93e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:39.237793 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee46c9-2ede-4e4b-ad58-010fdfbb93e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:39.239292 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ee46c9-2ede-4e4b-ad58-010fdfbb93e6 None admin] RBAC: Adding query filter params (role.id=c7518e0f532945af80c33860f2ac506d, scope.project.id=adfd1b153ab54652bb25b1b4a02bae1d, user.id=1fc9e1011e8a4eb38644e3a467a48897) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:39.239602 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ee46c9-2ede-4e4b-ad58-010fdfbb93e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:39.241119 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ee46c9-2ede-4e4b-ad58-010fdfbb93e6 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:39.248905 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 141/269] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Jun 22 08:34:39 2022] GET /identity/v3/role_assignments?user.id=1fc9e1011e8a4eb38644e3a467a48897&scope.project.id=adfd1b153ab54652bb25b1b4a02bae1d&role.id=c7518e0f532945af80c33860f2ac506d => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:39.250601 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58cc1e0-713c-46ad-ba7a-6202aed1fb83 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:39.250601 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58cc1e0-713c-46ad-ba7a-6202aed1fb83 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:39.250601 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58cc1e0-713c-46ad-ba7a-6202aed1fb83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:39.265567 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-0d63629a-0480-468d-a892-7bbc41837876 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:34:39.267675 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-0d63629a-0480-468d-a892-7bbc41837876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:34:39.271828 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-e58cc1e0-713c-46ad-ba7a-6202aed1fb83 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:34:39.274227 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-e58cc1e0-713c-46ad-ba7a-6202aed1fb83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:34:39.305769 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:39.351345 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 129/270] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:34:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:34:39.352727 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6bc30-4468-43ef-9b40-9538380823ae None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:39.353015 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6bc30-4468-43ef-9b40-9538380823ae None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:39.353291 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6bc30-4468-43ef-9b40-9538380823ae None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:39.354600 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 130/271] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:34:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:34:39.359031 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa6bc30-4468-43ef-9b40-9538380823ae None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:39.362623 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 142/272] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:34:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:34:39.365453 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce9699-287f-4827-86d7-694142aab1ad None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:39.365745 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce9699-287f-4827-86d7-694142aab1ad None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:39.366024 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce9699-287f-4827-86d7-694142aab1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:39.385162 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-72ce9699-287f-4827-86d7-694142aab1ad None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:34:39.390263 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-72ce9699-287f-4827-86d7-694142aab1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:34:39.390646 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:39.496144 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 143/273] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:34:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:34:39.498749 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce9699-287f-4827-86d7-694142aab1ad None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:39.523733 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa6bc30-4468-43ef-9b40-9538380823ae None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:39.567911 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f4bd9d-28d8-4bc5-802d-eef59dda9394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:39.568784 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4bd9d-28d8-4bc5-802d-eef59dda9394 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:39.569072 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4bd9d-28d8-4bc5-802d-eef59dda9394 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:39.569355 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4bd9d-28d8-4bc5-802d-eef59dda9394 None admin] PATH_INFO: `/v3/projects/adfd1b153ab54652bb25b1b4a02bae1d` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:39.570650 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f4bd9d-28d8-4bc5-802d-eef59dda9394 None admin] RBAC: Authorizing `identity:get_project(project_id=adfd1b153ab54652bb25b1b4a02bae1d)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:39.572036 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f4bd9d-28d8-4bc5-802d-eef59dda9394 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:39.573923 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 131/274] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Jun 22 08:34:39 2022] GET /identity/v3/projects/adfd1b153ab54652bb25b1b4a02bae1d => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:39.579693 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f4bd9d-28d8-4bc5-802d-eef59dda9394 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:39.603239 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:39.614070 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce9699-287f-4827-86d7-694142aab1ad None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:39.651655 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf0a9be-b974-4ec2-9fab-18902a58cd35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:39.652457 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0a9be-b974-4ec2-9fab-18902a58cd35 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:39.652736 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0a9be-b974-4ec2-9fab-18902a58cd35 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:39.653012 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0a9be-b974-4ec2-9fab-18902a58cd35 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:39.664057 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf0a9be-b974-4ec2-9fab-18902a58cd35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:34:39.671702 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-6bf0a9be-b974-4ec2-9fab-18902a58cd35 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:34:39.671702 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:34:39.671702 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:34:39.671702 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:34:39.671702 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:34:39.671702 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:34:39.671702 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:34:39.671702 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:34:39.671702 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:34:39.671702 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:34:39.671702 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:34:39.671702 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:34:39.671702 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:34:39.671702 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:34:39.671702 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:34:39.671702 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:34:39.672540 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:34:39.672540 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:34:39.672540 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:34:39.672540 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:34:39.672540 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:34:39.672540 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:34:39.672540 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:34:39.672540 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:34:39.672540 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:34:39.672540 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:34:39.672540 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:34:39.672540 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:34:39.672540 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:34:39.672540 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:34:39.672540 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:34:39.672540 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:34:39.678537 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:34:39.678537 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:34:39.678537 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:34:39.678537 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:34:39.678537 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:34:39.678537 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:34:39.678537 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:34:39.678537 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:34:39.678537 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:34:39.678537 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:34:39.678537 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:34:39.678537 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:34:39.678537 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 144/275] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Jun 22 08:34:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:34:39.678537 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf0a9be-b974-4ec2-9fab-18902a58cd35 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:39.687506 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:39.698750 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f4bd9d-28d8-4bc5-802d-eef59dda9394 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:39.736002 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da48bfbb-c274-4d1f-a103-0b60cb82d482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:39.736793 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48bfbb-c274-4d1f-a103-0b60cb82d482 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:39.737080 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48bfbb-c274-4d1f-a103-0b60cb82d482 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:39.737357 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48bfbb-c274-4d1f-a103-0b60cb82d482 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:39.739062 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da48bfbb-c274-4d1f-a103-0b60cb82d482 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:39.740520 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da48bfbb-c274-4d1f-a103-0b60cb82d482 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:39.742336 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 132/276] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:34:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:39.747657 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da48bfbb-c274-4d1f-a103-0b60cb82d482 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:39.781846 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf0a9be-b974-4ec2-9fab-18902a58cd35 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:39.820128 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd4fe76-0a21-44be-a435-5c6ce4397ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:39.820917 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4fe76-0a21-44be-a435-5c6ce4397ecf None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:39.821195 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4fe76-0a21-44be-a435-5c6ce4397ecf None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:39.821466 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4fe76-0a21-44be-a435-5c6ce4397ecf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:39.832027 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd4fe76-0a21-44be-a435-5c6ce4397ecf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:34:39.839778 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-fbd4fe76-0a21-44be-a435-5c6ce4397ecf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 08:34:39.839778 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:34:39.839778 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:34:39.839778 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:34:39.839778 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:34:39.839778 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:34:39.839778 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:34:39.839778 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:34:39.839778 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:34:39.839778 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:34:39.839778 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:34:39.839778 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:34:39.839778 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:34:39.839778 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:34:39.839778 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:34:39.839778 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:34:39.840676 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:34:39.840676 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:34:39.840676 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:34:39.840676 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:34:39.840676 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:34:39.840676 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:34:39.840676 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:34:39.840676 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:34:39.840676 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:34:39.840676 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:34:39.840676 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:34:39.840676 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:34:39.840676 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:34:39.840676 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:34:39.840676 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:34:39.840676 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:34:39.841735 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:34:39.841735 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:34:39.841735 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:34:39.841735 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:34:39.841735 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:34:39.841735 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:34:39.841735 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:34:39.841735 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:34:39.841735 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:34:39.841735 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:34:39.841735 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 08:34:39.841735 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:34:39.841735 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 145/277] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Jun 22 08:34:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:34:39.846710 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd4fe76-0a21-44be-a435-5c6ce4397ecf None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:39.858654 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da48bfbb-c274-4d1f-a103-0b60cb82d482 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:39.860685 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:39.895532 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056ed4e-c95b-4576-bef9-3ec41bc1e8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:39.896367 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056ed4e-c95b-4576-bef9-3ec41bc1e8fa None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:39.896477 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056ed4e-c95b-4576-bef9-3ec41bc1e8fa None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:39.896737 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056ed4e-c95b-4576-bef9-3ec41bc1e8fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:39.897575 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f056ed4e-c95b-4576-bef9-3ec41bc1e8fa None admin] RBAC: Adding query filter params (role.id=a92b520fb33f4333aad569d98be2bd7e, scope.project.id=adfd1b153ab54652bb25b1b4a02bae1d, user.id=1fc9e1011e8a4eb38644e3a467a48897) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:39.897890 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f056ed4e-c95b-4576-bef9-3ec41bc1e8fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:39.899382 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f056ed4e-c95b-4576-bef9-3ec41bc1e8fa None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:39.914115 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 133/278] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Jun 22 08:34:39 2022] GET /identity/v3/role_assignments?user.id=1fc9e1011e8a4eb38644e3a467a48897&scope.project.id=adfd1b153ab54652bb25b1b4a02bae1d&role.id=a92b520fb33f4333aad569d98be2bd7e => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:39.914115 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056ed4e-c95b-4576-bef9-3ec41bc1e8fa None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:39.951184 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:39.965737 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd4fe76-0a21-44be-a435-5c6ce4397ecf None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:40.010872 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10838882-16ba-4c7a-8393-633ae62d86bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:40.011482 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10838882-16ba-4c7a-8393-633ae62d86bb None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:40.011767 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10838882-16ba-4c7a-8393-633ae62d86bb None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:40.012043 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10838882-16ba-4c7a-8393-633ae62d86bb None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:40.012832 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10838882-16ba-4c7a-8393-633ae62d86bb None admin] RBAC: Adding query filter params (name=member) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:40.013142 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10838882-16ba-4c7a-8393-633ae62d86bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:40.014638 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10838882-16ba-4c7a-8393-633ae62d86bb None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:40.025609 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 146/279] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Jun 22 08:34:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:40.026660 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10838882-16ba-4c7a-8393-633ae62d86bb None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:40.064940 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056ed4e-c95b-4576-bef9-3ec41bc1e8fa None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:40.108973 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb57808-3af3-4403-a5ea-3d9e3549a362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:40.108973 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb57808-3af3-4403-a5ea-3d9e3549a362 None admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:40.108973 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb57808-3af3-4403-a5ea-3d9e3549a362 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:40.108973 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb57808-3af3-4403-a5ea-3d9e3549a362 None admin] PATH_INFO: `/v3/users` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:40.109751 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb57808-3af3-4403-a5ea-3d9e3549a362 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:40.109751 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb57808-3af3-4403-a5ea-3d9e3549a362 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:40.118050 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:40.140372 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 134/280] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Jun 22 08:34:39 2022] POST /identity/v3/users => generated 293 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:34:40.141267 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb57808-3af3-4403-a5ea-3d9e3549a362 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:40.162727 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10838882-16ba-4c7a-8393-633ae62d86bb None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:40.205945 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b1910-83a1-4cbe-9abd-6ed122a332f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:40.207822 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b1910-83a1-4cbe-9abd-6ed122a332f8 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:40.208321 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b1910-83a1-4cbe-9abd-6ed122a332f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:40.208786 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b1910-83a1-4cbe-9abd-6ed122a332f8 None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:40.209799 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72b1910-83a1-4cbe-9abd-6ed122a332f8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:40.210559 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72b1910-83a1-4cbe-9abd-6ed122a332f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:40.212442 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72b1910-83a1-4cbe-9abd-6ed122a332f8 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:40.224423 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 147/281] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Jun 22 08:34:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:40.231302 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b1910-83a1-4cbe-9abd-6ed122a332f8 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:40.263136 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:40.299879 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb57808-3af3-4403-a5ea-3d9e3549a362 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:40.344619 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c4654-3744-4294-adb2-799ed3812436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:40.345497 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c4654-3744-4294-adb2-799ed3812436 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:40.345780 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c4654-3744-4294-adb2-799ed3812436 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:40.346060 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c4654-3744-4294-adb2-799ed3812436 None admin] PATH_INFO: `/v3/users/b69bed9743df4e6ea8c7a830286b522c` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:40.363354 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740c4654-3744-4294-adb2-799ed3812436 None admin] RBAC: Authorizing `identity:get_user(user_id=b69bed9743df4e6ea8c7a830286b522c)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:40.366575 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740c4654-3744-4294-adb2-799ed3812436 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:40.366575 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 135/282] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Jun 22 08:34:40 2022] GET /identity/v3/users/b69bed9743df4e6ea8c7a830286b522c => generated 293 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:40.372951 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c4654-3744-4294-adb2-799ed3812436 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:40.385387 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b1910-83a1-4cbe-9abd-6ed122a332f8 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:40.429510 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014ca7d8-9249-45d8-9d06-61a14e0107b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:40.430722 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ca7d8-9249-45d8-9d06-61a14e0107b5 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:40.431019 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ca7d8-9249-45d8-9d06-61a14e0107b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:40.431333 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ca7d8-9249-45d8-9d06-61a14e0107b5 None admin] PATH_INFO: `/v3/users/274a3b23d29242708eca1798a05ba828` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:40.432623 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014ca7d8-9249-45d8-9d06-61a14e0107b5 None admin] RBAC: Authorizing `identity:get_user(user_id=274a3b23d29242708eca1798a05ba828)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:40.434106 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014ca7d8-9249-45d8-9d06-61a14e0107b5 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:40.435791 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 148/283] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Jun 22 08:34:40 2022] GET /identity/v3/users/274a3b23d29242708eca1798a05ba828 => generated 297 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:40.441488 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014ca7d8-9249-45d8-9d06-61a14e0107b5 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:40.445078 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:40.512723 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c4654-3744-4294-adb2-799ed3812436 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:40.556668 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b357739c-8f50-4991-b1fb-f37096eeb2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:40.557707 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b357739c-8f50-4991-b1fb-f37096eeb2ba None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:40.558239 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b357739c-8f50-4991-b1fb-f37096eeb2ba None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:40.558759 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b357739c-8f50-4991-b1fb-f37096eeb2ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:40.559847 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b357739c-8f50-4991-b1fb-f37096eeb2ba None admin] RBAC: Adding query filter params (role.id=5ea101070f734fa59995615179f2eff2, user.id=b69bed9743df4e6ea8c7a830286b522c, scope.system=all) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:40.561023 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b357739c-8f50-4991-b1fb-f37096eeb2ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:40.562584 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b357739c-8f50-4991-b1fb-f37096eeb2ba None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:40.565537 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:40.574105 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 136/284] 10.222.0.42 () {56 vars in 1308 bytes} [Wed Jun 22 08:34:40 2022] GET /identity/v3/role_assignments?user.id=b69bed9743df4e6ea8c7a830286b522c&scope.system=all&role.id=5ea101070f734fa59995615179f2eff2 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:40.579762 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014ca7d8-9249-45d8-9d06-61a14e0107b5 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:40.624258 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200ed64-d993-42f6-a87f-bdd6a3842fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:40.625217 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200ed64-d993-42f6-a87f-bdd6a3842fc3 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:40.625509 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200ed64-d993-42f6-a87f-bdd6a3842fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:40.625790 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200ed64-d993-42f6-a87f-bdd6a3842fc3 None admin] PATH_INFO: `/v3/projects/adfd1b153ab54652bb25b1b4a02bae1d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:40.627465 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5200ed64-d993-42f6-a87f-bdd6a3842fc3 None admin] RBAC: Authorizing `identity:get_project(project_id=adfd1b153ab54652bb25b1b4a02bae1d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:40.629643 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5200ed64-d993-42f6-a87f-bdd6a3842fc3 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:40.631796 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 149/285] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Jun 22 08:34:40 2022] GET /identity/v3/projects/adfd1b153ab54652bb25b1b4a02bae1d => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:34:40.637832 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b357739c-8f50-4991-b1fb-f37096eeb2ba None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:40.761636 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b357739c-8f50-4991-b1fb-f37096eeb2ba None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:40.801542 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a047d06a-e72b-4ed2-a99a-2434dddf421b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:40.802796 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a047d06a-e72b-4ed2-a99a-2434dddf421b None admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:40.803259 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a047d06a-e72b-4ed2-a99a-2434dddf421b None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:40.803747 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a047d06a-e72b-4ed2-a99a-2434dddf421b None admin] PATH_INFO: `/v3/projects/adfd1b153ab54652bb25b1b4a02bae1d/users/274a3b23d29242708eca1798a05ba828/roles/78088ffb8c224af39e594570dd740336` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:40.805970 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a047d06a-e72b-4ed2-a99a-2434dddf421b None admin] RBAC: Authorizing `identity:create_grant(project_id=adfd1b153ab54652bb25b1b4a02bae1d, user_id=274a3b23d29242708eca1798a05ba828, role_id=78088ffb8c224af39e594570dd740336)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:40.807716 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a047d06a-e72b-4ed2-a99a-2434dddf421b None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:40.828797 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 137/286] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Jun 22 08:34:40 2022] PUT /identity/v3/projects/adfd1b153ab54652bb25b1b4a02bae1d/users/274a3b23d29242708eca1798a05ba828/roles/78088ffb8c224af39e594570dd740336 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:34:41.048370 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5852c88-49a3-482d-a55b-be2b77b77e77 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:41.049077 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5852c88-49a3-482d-a55b-be2b77b77e77 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:41.049569 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5852c88-49a3-482d-a55b-be2b77b77e77 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:41.051782 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 150/287] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:34:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:34:41.057336 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04db231-3d5d-4552-9045-b728e287ce12 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:41.057939 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04db231-3d5d-4552-9045-b728e287ce12 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:41.058459 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04db231-3d5d-4552-9045-b728e287ce12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:41.078590 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-c04db231-3d5d-4552-9045-b728e287ce12 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:34:41.080113 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-c04db231-3d5d-4552-9045-b728e287ce12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:34:41.146347 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:41.163544 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 138/288] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:34:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:34:41.199014 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5852c88-49a3-482d-a55b-be2b77b77e77 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:41.304114 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:41.349161 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5852c88-49a3-482d-a55b-be2b77b77e77 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:41.392941 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b7dfbc-c3c3-4a0a-ae52-50268319b283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:41.393755 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7dfbc-c3c3-4a0a-ae52-50268319b283 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:41.394097 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7dfbc-c3c3-4a0a-ae52-50268319b283 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:41.394372 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7dfbc-c3c3-4a0a-ae52-50268319b283 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:41.409873 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b7dfbc-c3c3-4a0a-ae52-50268319b283 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:34:41.417585 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-b3b7dfbc-c3c3-4a0a-ae52-50268319b283 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:34:41.417585 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:34:41.417585 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:34:41.417585 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:34:41.417585 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:34:41.417585 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:34:41.417585 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:34:41.417585 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:34:41.417585 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:34:41.417585 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:34:41.417585 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:34:41.417585 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:34:41.417585 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:34:41.417585 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:34:41.417585 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:34:41.417585 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:34:41.418488 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:34:41.418488 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:34:41.418488 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:34:41.418488 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:34:41.418488 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:34:41.418488 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:34:41.418488 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:34:41.418488 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:34:41.418488 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:34:41.418488 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:34:41.418488 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:34:41.418488 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:34:41.418488 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:34:41.418488 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:34:41.418488 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:34:41.418488 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:34:41.419282 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:34:41.419282 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:34:41.419282 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:34:41.419282 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:34:41.419282 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:34:41.419282 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:34:41.419282 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:34:41.419282 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:34:41.419282 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:34:41.419282 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:34:41.419282 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:34:41.419282 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:34:41.419282 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 151/289] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Jun 22 08:34:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:34:41.426904 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04db231-3d5d-4552-9045-b728e287ce12 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:41.577529 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04db231-3d5d-4552-9045-b728e287ce12 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:41.617686 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f144dff-5d66-4aaa-8ab2-c4087ae5a5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:41.618303 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f144dff-5d66-4aaa-8ab2-c4087ae5a5ed None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:41.618593 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f144dff-5d66-4aaa-8ab2-c4087ae5a5ed None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:41.618876 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f144dff-5d66-4aaa-8ab2-c4087ae5a5ed None admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:41.619648 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f144dff-5d66-4aaa-8ab2-c4087ae5a5ed None admin] RBAC: Adding query filter params (name=member) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:41.619959 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f144dff-5d66-4aaa-8ab2-c4087ae5a5ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:41.621360 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f144dff-5d66-4aaa-8ab2-c4087ae5a5ed None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:41.631492 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 139/290] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Jun 22 08:34:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:41.636580 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b7dfbc-c3c3-4a0a-ae52-50268319b283 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:41.819802 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b7dfbc-c3c3-4a0a-ae52-50268319b283 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:41.868357 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:41.876160 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02dc7e2-1eaa-45d8-9029-3e4347e56123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:41.877057 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02dc7e2-1eaa-45d8-9029-3e4347e56123 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:41.877339 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02dc7e2-1eaa-45d8-9029-3e4347e56123 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:41.877616 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02dc7e2-1eaa-45d8-9029-3e4347e56123 None admin] PATH_INFO: `/v3/users/41af391089274b1481c874f230a59c6f` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:41.879482 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02dc7e2-1eaa-45d8-9029-3e4347e56123 None admin] RBAC: Authorizing `identity:get_user(user_id=41af391089274b1481c874f230a59c6f)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:41.880950 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02dc7e2-1eaa-45d8-9029-3e4347e56123 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:41.882822 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 152/291] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Jun 22 08:34:41 2022] GET /identity/v3/users/41af391089274b1481c874f230a59c6f => generated 297 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:41.888313 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f144dff-5d66-4aaa-8ab2-c4087ae5a5ed None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:41.947897 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:42.009365 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f144dff-5d66-4aaa-8ab2-c4087ae5a5ed None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:42.045290 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17fdf40-ed30-4de3-a3b9-2ed4fde8a048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:42.045967 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17fdf40-ed30-4de3-a3b9-2ed4fde8a048 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:42.046283 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17fdf40-ed30-4de3-a3b9-2ed4fde8a048 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:42.046562 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17fdf40-ed30-4de3-a3b9-2ed4fde8a048 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:42.127937 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17fdf40-ed30-4de3-a3b9-2ed4fde8a048 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:42.130182 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17fdf40-ed30-4de3-a3b9-2ed4fde8a048 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:42.202655 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:42.274215 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 140/292] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Jun 22 08:34:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:34:42.283193 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02dc7e2-1eaa-45d8-9029-3e4347e56123 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:42.419187 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02dc7e2-1eaa-45d8-9029-3e4347e56123 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:42.456575 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ac74f-76f7-4a8a-861d-59179d2e6630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:42.457455 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ac74f-76f7-4a8a-861d-59179d2e6630 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:42.457739 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ac74f-76f7-4a8a-861d-59179d2e6630 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:42.458017 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ac74f-76f7-4a8a-861d-59179d2e6630 None admin] PATH_INFO: `/v3/projects/adfd1b153ab54652bb25b1b4a02bae1d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:42.459298 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306ac74f-76f7-4a8a-861d-59179d2e6630 None admin] RBAC: Authorizing `identity:get_project(project_id=adfd1b153ab54652bb25b1b4a02bae1d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:42.460787 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306ac74f-76f7-4a8a-861d-59179d2e6630 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:42.462760 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 153/293] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Jun 22 08:34:42 2022] GET /identity/v3/projects/adfd1b153ab54652bb25b1b4a02bae1d => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:42.468615 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17fdf40-ed30-4de3-a3b9-2ed4fde8a048 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:42.592904 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17fdf40-ed30-4de3-a3b9-2ed4fde8a048 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:42.647817 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa12591-b886-4038-aa25-ec2dc7ec43ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:42.648481 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa12591-b886-4038-aa25-ec2dc7ec43ee None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:42.648766 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa12591-b886-4038-aa25-ec2dc7ec43ee None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:42.649043 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa12591-b886-4038-aa25-ec2dc7ec43ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:42.649881 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa12591-b886-4038-aa25-ec2dc7ec43ee None admin] RBAC: Adding query filter params (role.id=5ea101070f734fa59995615179f2eff2, scope.project.id=adfd1b153ab54652bb25b1b4a02bae1d, user.id=41af391089274b1481c874f230a59c6f) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:42.650225 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa12591-b886-4038-aa25-ec2dc7ec43ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:42.651654 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa12591-b886-4038-aa25-ec2dc7ec43ee None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:42.663785 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 141/294] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Jun 22 08:34:42 2022] GET /identity/v3/role_assignments?user.id=41af391089274b1481c874f230a59c6f&scope.project.id=adfd1b153ab54652bb25b1b4a02bae1d&role.id=5ea101070f734fa59995615179f2eff2 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:43.019650 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d8195-d5df-418a-b92b-f203a237de1b None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:43.020303 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d8195-d5df-418a-b92b-f203a237de1b None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:43.020514 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d8195-d5df-418a-b92b-f203a237de1b None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:43.022279 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 154/295] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:34:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:34:43.029247 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb6a49-961a-433d-ace1-4d0721eceb96 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:43.029546 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb6a49-961a-433d-ace1-4d0721eceb96 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:43.029836 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb6a49-961a-433d-ace1-4d0721eceb96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:43.048255 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-24eb6a49-961a-433d-ace1-4d0721eceb96 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:34:43.049454 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-24eb6a49-961a-433d-ace1-4d0721eceb96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:34:43.064478 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:43.130622 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 142/296] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:34:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:34:43.157127 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d8195-d5df-418a-b92b-f203a237de1b None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:43.164498 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c0c60-961f-4176-b0bd-88092bd54e69 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:43.164792 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c0c60-961f-4176-b0bd-88092bd54e69 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:43.165075 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c0c60-961f-4176-b0bd-88092bd54e69 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:43.166694 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 143/297] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:34:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:34:43.172786 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0054dd-78a1-4134-8b1f-689b7e8f7901 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:43.173256 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0054dd-78a1-4134-8b1f-689b7e8f7901 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:43.174097 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0054dd-78a1-4134-8b1f-689b7e8f7901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:43.194177 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-3c0054dd-78a1-4134-8b1f-689b7e8f7901 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:34:43.195361 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-3c0054dd-78a1-4134-8b1f-689b7e8f7901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:34:43.239930 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:43.279424 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d8195-d5df-418a-b92b-f203a237de1b None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:43.285500 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 144/298] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:34:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:34:43.287481 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9676ea1-44fe-422b-8553-da59354f5eb1 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:43.287986 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9676ea1-44fe-422b-8553-da59354f5eb1 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:43.288470 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9676ea1-44fe-422b-8553-da59354f5eb1 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:43.294132 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 145/299] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:34:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:34:43.295743 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e1ce6-0196-4638-95f3-a68e238a067d None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:43.296241 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e1ce6-0196-4638-95f3-a68e238a067d None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:43.296737 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e1ce6-0196-4638-95f3-a68e238a067d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:43.315770 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-058e1ce6-0196-4638-95f3-a68e238a067d None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:34:43.317858 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-058e1ce6-0196-4638-95f3-a68e238a067d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:34:43.321222 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f22bcfd-f910-413f-a5f9-95fb0f800473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:43.322034 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f22bcfd-f910-413f-a5f9-95fb0f800473 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:43.322375 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f22bcfd-f910-413f-a5f9-95fb0f800473 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:43.322652 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f22bcfd-f910-413f-a5f9-95fb0f800473 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:43.335610 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f22bcfd-f910-413f-a5f9-95fb0f800473 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:34:43.344093 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-4f22bcfd-f910-413f-a5f9-95fb0f800473 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 08:34:43.344093 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:34:43.344093 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:34:43.344093 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:34:43.344093 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:34:43.344093 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:34:43.344093 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:34:43.344093 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:34:43.344093 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:34:43.344093 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:34:43.344093 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:34:43.344093 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:34:43.344093 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:34:43.344093 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:34:43.344093 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:34:43.344093 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:34:43.345055 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:34:43.345055 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:34:43.345055 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:34:43.345055 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:34:43.345055 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:34:43.345055 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:34:43.345055 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:34:43.345055 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:34:43.345055 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:34:43.345055 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:34:43.345055 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:34:43.345055 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:34:43.345055 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:34:43.345055 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:34:43.345055 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:34:43.345055 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:34:43.345846 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:34:43.345846 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:34:43.345846 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:34:43.345846 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:34:43.345846 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:34:43.345846 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:34:43.345846 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:34:43.345846 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:34:43.345846 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:34:43.345846 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:34:43.345846 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 08:34:43.345846 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:34:43.345846 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 155/300] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Jun 22 08:34:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:34:43.347230 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f22bcfd-f910-413f-a5f9-95fb0f800473 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:43.394050 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 146/301] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:34:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:34:43.403270 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e1ce6-0196-4638-95f3-a68e238a067d None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:43.414650 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:43.465843 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f22bcfd-f910-413f-a5f9-95fb0f800473 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:43.494490 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:43.504882 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf79a7-6713-4dfd-88ea-30a3086c1064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:43.505700 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf79a7-6713-4dfd-88ea-30a3086c1064 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:43.505986 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf79a7-6713-4dfd-88ea-30a3086c1064 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:43.506295 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf79a7-6713-4dfd-88ea-30a3086c1064 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:43.519878 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e1ce6-0196-4638-95f3-a68e238a067d None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:43.521204 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edf79a7-6713-4dfd-88ea-30a3086c1064 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:34:43.531467 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-9edf79a7-6713-4dfd-88ea-30a3086c1064 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:34:43.531467 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:34:43.531467 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:34:43.531467 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:34:43.531467 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:34:43.531467 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:34:43.531467 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:34:43.531467 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:34:43.531467 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:34:43.531467 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:34:43.531467 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:34:43.531467 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:34:43.531467 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:34:43.531467 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:34:43.531467 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:34:43.531467 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:34:43.532331 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:34:43.532331 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:34:43.532331 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:34:43.532331 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:34:43.532331 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:34:43.532331 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:34:43.532331 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:34:43.532331 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:34:43.532331 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:34:43.532331 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:34:43.532331 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:34:43.532331 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:34:43.532331 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:34:43.532331 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:34:43.532331 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:34:43.532331 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:34:43.533131 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:34:43.533131 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:34:43.533131 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:34:43.533131 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:34:43.533131 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:34:43.533131 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:34:43.533131 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:34:43.533131 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:34:43.533131 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:34:43.533131 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:34:43.533131 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:34:43.533131 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:34:43.537499 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 156/302] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Jun 22 08:34:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:34:43.537499 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf79a7-6713-4dfd-88ea-30a3086c1064 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:43.562699 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ca255-2938-4166-9e42-c97e5579ccb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:43.563376 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ca255-2938-4166-9e42-c97e5579ccb8 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:43.563665 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ca255-2938-4166-9e42-c97e5579ccb8 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:43.563944 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ca255-2938-4166-9e42-c97e5579ccb8 None admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:43.564697 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ca255-2938-4166-9e42-c97e5579ccb8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:43.565003 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ca255-2938-4166-9e42-c97e5579ccb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:43.566410 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ca255-2938-4166-9e42-c97e5579ccb8 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:43.574532 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 147/303] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Jun 22 08:34:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:43.575404 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ca255-2938-4166-9e42-c97e5579ccb8 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:43.641062 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:43.658967 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf79a7-6713-4dfd-88ea-30a3086c1064 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:43.678274 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ca255-2938-4166-9e42-c97e5579ccb8 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:43.696622 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4e083-a5a9-4eb0-afdd-74542a858d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:43.697407 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4e083-a5a9-4eb0-afdd-74542a858d5d None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:43.697686 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4e083-a5a9-4eb0-afdd-74542a858d5d None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:43.697958 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4e083-a5a9-4eb0-afdd-74542a858d5d None admin] PATH_INFO: `/v3/domains/default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:43.699163 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be4e083-a5a9-4eb0-afdd-74542a858d5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:43.700606 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be4e083-a5a9-4eb0-afdd-74542a858d5d None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:43.702233 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 157/304] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:34:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:43.703383 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9636fd-c8c9-4834-a52c-5f8be439b509 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:43.703663 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9636fd-c8c9-4834-a52c-5f8be439b509 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:43.703939 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9636fd-c8c9-4834-a52c-5f8be439b509 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:43.706272 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 158/305] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:34:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:34:43.706272 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9636fd-c8c9-4834-a52c-5f8be439b509 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:43.712954 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c59f2-a30d-453a-8bd2-b01e336c32ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:43.713624 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c59f2-a30d-453a-8bd2-b01e336c32ed None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:43.713910 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c59f2-a30d-453a-8bd2-b01e336c32ed None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:43.714224 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c59f2-a30d-453a-8bd2-b01e336c32ed None admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:43.714980 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c59f2-a30d-453a-8bd2-b01e336c32ed None admin] RBAC: Adding query filter params (name=member) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:43.715291 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c59f2-a30d-453a-8bd2-b01e336c32ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:43.716679 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c59f2-a30d-453a-8bd2-b01e336c32ed None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:43.725438 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 148/306] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Jun 22 08:34:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:43.726318 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c59f2-a30d-453a-8bd2-b01e336c32ed None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:43.763983 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:43.810068 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9636fd-c8c9-4834-a52c-5f8be439b509 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:43.825806 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c59f2-a30d-453a-8bd2-b01e336c32ed None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:43.843767 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633ad028-26e1-407a-ae77-ab8058cbdd8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:43.844650 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ad028-26e1-407a-ae77-ab8058cbdd8b None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:43.844943 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ad028-26e1-407a-ae77-ab8058cbdd8b None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:43.845217 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ad028-26e1-407a-ae77-ab8058cbdd8b None admin] PATH_INFO: `/v3/users/a59c2c35a9a349d498ea445234363b52` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:43.853201 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:43.859190 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da2182-151a-485e-b607-6503ad0df3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:43.859864 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da2182-151a-485e-b607-6503ad0df3ad None admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:43.860149 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da2182-151a-485e-b607-6503ad0df3ad None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:43.860429 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da2182-151a-485e-b607-6503ad0df3ad None admin] PATH_INFO: `/v3/groups` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:43.861122 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da2182-151a-485e-b607-6503ad0df3ad None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:43.861839 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633ad028-26e1-407a-ae77-ab8058cbdd8b None admin] RBAC: Authorizing `identity:get_user(user_id=a59c2c35a9a349d498ea445234363b52)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:43.863096 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da2182-151a-485e-b607-6503ad0df3ad None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:43.863851 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633ad028-26e1-407a-ae77-ab8058cbdd8b None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:43.865710 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 159/307] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Jun 22 08:34:43 2022] GET /identity/v3/users/a59c2c35a9a349d498ea445234363b52 => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:43.867090 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7bd0a3-6dc5-40fd-99d7-36182bf6cb45 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:43.867383 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7bd0a3-6dc5-40fd-99d7-36182bf6cb45 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:43.868088 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7bd0a3-6dc5-40fd-99d7-36182bf6cb45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:43.880081 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 149/308] 10.222.0.42 () {60 vars in 1134 bytes} [Wed Jun 22 08:34:43 2022] POST /identity/v3/groups => generated 229 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:34:43.880980 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da2182-151a-485e-b607-6503ad0df3ad None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:43.885547 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-9f7bd0a3-6dc5-40fd-99d7-36182bf6cb45 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:34:43.886920 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-9f7bd0a3-6dc5-40fd-99d7-36182bf6cb45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:34:43.974331 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 160/309] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:34:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:34:43.974331 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7bd0a3-6dc5-40fd-99d7-36182bf6cb45 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:44.016891 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da2182-151a-485e-b607-6503ad0df3ad None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:44.030436 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:44.058350 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b6d98-8933-4750-87ee-159c335e6cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:44.059327 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b6d98-8933-4750-87ee-159c335e6cc6 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:44.059619 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b6d98-8933-4750-87ee-159c335e6cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:44.059900 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b6d98-8933-4750-87ee-159c335e6cc6 None admin] PATH_INFO: `/v3/users/b69bed9743df4e6ea8c7a830286b522c` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:44.061185 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3b6d98-8933-4750-87ee-159c335e6cc6 None admin] RBAC: Authorizing `identity:get_user(user_id=b69bed9743df4e6ea8c7a830286b522c)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:44.062696 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3b6d98-8933-4750-87ee-159c335e6cc6 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:44.064508 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 150/310] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Jun 22 08:34:43 2022] GET /identity/v3/users/b69bed9743df4e6ea8c7a830286b522c => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:44.065114 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b6d98-8933-4750-87ee-159c335e6cc6 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:44.098536 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7bd0a3-6dc5-40fd-99d7-36182bf6cb45 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:44.130580 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:44.133675 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0cbc77-2214-48a5-95ff-f10efcbc3bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:44.134444 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0cbc77-2214-48a5-95ff-f10efcbc3bd4 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:44.134701 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0cbc77-2214-48a5-95ff-f10efcbc3bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:44.135090 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0cbc77-2214-48a5-95ff-f10efcbc3bd4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:44.135816 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0cbc77-2214-48a5-95ff-f10efcbc3bd4 None admin] RBAC: Adding query filter params (role.id=78088ffb8c224af39e594570dd740336, user.id=a59c2c35a9a349d498ea445234363b52, scope.system=all) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:44.136136 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0cbc77-2214-48a5-95ff-f10efcbc3bd4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:44.137581 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0cbc77-2214-48a5-95ff-f10efcbc3bd4 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:44.143521 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 161/311] 10.222.0.42 () {56 vars in 1308 bytes} [Wed Jun 22 08:34:43 2022] GET /identity/v3/role_assignments?user.id=a59c2c35a9a349d498ea445234363b52&scope.system=all&role.id=78088ffb8c224af39e594570dd740336 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:44.144877 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0cbc77-2214-48a5-95ff-f10efcbc3bd4 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:44.190385 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b6d98-8933-4750-87ee-159c335e6cc6 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:44.238259 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24404c4c-3478-4f80-9e8b-39c1777a3510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:44.239117 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24404c4c-3478-4f80-9e8b-39c1777a3510 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:44.239405 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24404c4c-3478-4f80-9e8b-39c1777a3510 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:44.239684 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24404c4c-3478-4f80-9e8b-39c1777a3510 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:44.256907 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24404c4c-3478-4f80-9e8b-39c1777a3510 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:34:44.267084 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-24404c4c-3478-4f80-9e8b-39c1777a3510 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 08:34:44.267084 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:34:44.267084 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:34:44.267084 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:34:44.267084 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:34:44.267084 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:34:44.267084 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:34:44.267084 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:34:44.267084 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:34:44.267084 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:34:44.267084 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:34:44.267084 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:34:44.267084 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:34:44.267084 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:34:44.267084 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:34:44.267084 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:34:44.268014 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:34:44.268014 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:34:44.268014 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:34:44.268014 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:34:44.268014 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:34:44.268014 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:34:44.268014 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:34:44.268014 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:34:44.268014 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:34:44.268014 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:34:44.268014 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:34:44.268014 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:34:44.268014 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:34:44.268014 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:34:44.268014 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:34:44.268014 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:34:44.268789 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:34:44.268789 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:34:44.268789 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:34:44.268789 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:34:44.268789 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:34:44.268789 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:34:44.268789 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:34:44.268789 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:34:44.268789 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:34:44.268789 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:34:44.268789 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 08:34:44.268789 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:34:44.268789 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 151/312] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Jun 22 08:34:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:34:44.275333 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24404c4c-3478-4f80-9e8b-39c1777a3510 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:44.283501 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0cbc77-2214-48a5-95ff-f10efcbc3bd4 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:44.294591 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:44.335507 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ebe72-014e-4b82-91b0-fa192d776603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:44.336338 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ebe72-014e-4b82-91b0-fa192d776603 None admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:44.336626 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ebe72-014e-4b82-91b0-fa192d776603 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:44.336904 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ebe72-014e-4b82-91b0-fa192d776603 None admin] PATH_INFO: `/v3/system/users/b69bed9743df4e6ea8c7a830286b522c/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:44.338520 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106ebe72-014e-4b82-91b0-fa192d776603 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b69bed9743df4e6ea8c7a830286b522c, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:44.340047 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106ebe72-014e-4b82-91b0-fa192d776603 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:44.352332 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 162/313] 10.222.0.42 () {58 vars in 1334 bytes} [Wed Jun 22 08:34:44 2022] PUT /identity/v3/system/users/b69bed9743df4e6ea8c7a830286b522c/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:34:44.422536 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24404c4c-3478-4f80-9e8b-39c1777a3510 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:44.444774 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:44.466172 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031458e-9883-4af9-8f6d-b27e5561ad50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:44.466864 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031458e-9883-4af9-8f6d-b27e5561ad50 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:44.467148 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031458e-9883-4af9-8f6d-b27e5561ad50 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:44.467429 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031458e-9883-4af9-8f6d-b27e5561ad50 None admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:44.468263 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1031458e-9883-4af9-8f6d-b27e5561ad50 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:44.468580 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1031458e-9883-4af9-8f6d-b27e5561ad50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:44.470067 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1031458e-9883-4af9-8f6d-b27e5561ad50 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:44.481615 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 152/314] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Jun 22 08:34:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:34:44.487108 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ebe72-014e-4b82-91b0-fa192d776603 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:44.605162 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ebe72-014e-4b82-91b0-fa192d776603 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:44.644057 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee3581-6014-4484-8fae-5f4d37604a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:44.645258 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee3581-6014-4484-8fae-5f4d37604a6a None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:44.645569 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee3581-6014-4484-8fae-5f4d37604a6a None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:44.645836 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee3581-6014-4484-8fae-5f4d37604a6a None admin] PATH_INFO: `/v3/users/274a3b23d29242708eca1798a05ba828` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:44.647116 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffee3581-6014-4484-8fae-5f4d37604a6a None admin] RBAC: Authorizing `identity:get_user(user_id=274a3b23d29242708eca1798a05ba828)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:44.648630 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffee3581-6014-4484-8fae-5f4d37604a6a None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:44.654219 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 163/315] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Jun 22 08:34:44 2022] GET /identity/v3/users/274a3b23d29242708eca1798a05ba828 => generated 297 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:44.659186 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031458e-9883-4af9-8f6d-b27e5561ad50 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:44.773437 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031458e-9883-4af9-8f6d-b27e5561ad50 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:44.809495 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fa89b1-5a53-4034-b5c8-bde58d97e2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:44.810199 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa89b1-5a53-4034-b5c8-bde58d97e2aa None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:44.810537 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa89b1-5a53-4034-b5c8-bde58d97e2aa None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:44.810822 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa89b1-5a53-4034-b5c8-bde58d97e2aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:44.864653 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:44.886362 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fa89b1-5a53-4034-b5c8-bde58d97e2aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:44.887838 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fa89b1-5a53-4034-b5c8-bde58d97e2aa None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:45.002354 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 153/316] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Jun 22 08:34:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:34:45.008437 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee3581-6014-4484-8fae-5f4d37604a6a None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:45.054906 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:45.117912 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee3581-6014-4484-8fae-5f4d37604a6a None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:45.154932 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1666e6ec-61e8-4c72-95d3-1dc76cdedb0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:45.155804 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1666e6ec-61e8-4c72-95d3-1dc76cdedb0d None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:45.156088 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1666e6ec-61e8-4c72-95d3-1dc76cdedb0d None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:45.156363 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1666e6ec-61e8-4c72-95d3-1dc76cdedb0d None admin] PATH_INFO: `/v3/projects/adfd1b153ab54652bb25b1b4a02bae1d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:45.157572 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1666e6ec-61e8-4c72-95d3-1dc76cdedb0d None admin] RBAC: Authorizing `identity:get_project(project_id=adfd1b153ab54652bb25b1b4a02bae1d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:45.159045 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1666e6ec-61e8-4c72-95d3-1dc76cdedb0d None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:45.161298 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 164/317] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Jun 22 08:34:45 2022] GET /identity/v3/projects/adfd1b153ab54652bb25b1b4a02bae1d => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:45.167138 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fa89b1-5a53-4034-b5c8-bde58d97e2aa None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:45.258331 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:45.285871 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fa89b1-5a53-4034-b5c8-bde58d97e2aa None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:45.347909 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c9fdb-8c13-4e0e-bd93-8af470e7e15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:45.348947 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c9fdb-8c13-4e0e-bd93-8af470e7e15b None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:45.349455 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c9fdb-8c13-4e0e-bd93-8af470e7e15b None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:45.349939 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c9fdb-8c13-4e0e-bd93-8af470e7e15b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:45.351016 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11c9fdb-8c13-4e0e-bd93-8af470e7e15b None admin] RBAC: Adding query filter params (role.id=78088ffb8c224af39e594570dd740336, scope.project.id=adfd1b153ab54652bb25b1b4a02bae1d, user.id=274a3b23d29242708eca1798a05ba828) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:45.351536 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11c9fdb-8c13-4e0e-bd93-8af470e7e15b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:45.353168 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11c9fdb-8c13-4e0e-bd93-8af470e7e15b None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:45.366205 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 154/318] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Jun 22 08:34:45 2022] GET /identity/v3/role_assignments?user.id=274a3b23d29242708eca1798a05ba828&scope.project.id=adfd1b153ab54652bb25b1b4a02bae1d&role.id=78088ffb8c224af39e594570dd740336 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:46.072665 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da57622-0a59-4947-b423-93c39f7850f7 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:46.073180 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da57622-0a59-4947-b423-93c39f7850f7 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:46.073254 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da57622-0a59-4947-b423-93c39f7850f7 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:46.074792 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 165/319] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:34:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:34:46.079737 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7651df-76b6-4765-8627-bb8006023bd3 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:46.080149 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7651df-76b6-4765-8627-bb8006023bd3 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:46.080371 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7651df-76b6-4765-8627-bb8006023bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:46.097167 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-1f7651df-76b6-4765-8627-bb8006023bd3 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:34:46.098405 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-1f7651df-76b6-4765-8627-bb8006023bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:34:46.171190 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 155/320] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:34:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:34:46.193966 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da57622-0a59-4947-b423-93c39f7850f7 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:46.241515 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e13553-e74a-488f-aa8b-ca5cad90c73b None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:46.241806 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e13553-e74a-488f-aa8b-ca5cad90c73b None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:46.242102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e13553-e74a-488f-aa8b-ca5cad90c73b None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:46.243988 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 156/321] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:34:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:34:46.252887 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e52d0-e06e-4f48-94fb-eaac15c84a0f None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:46.252887 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e52d0-e06e-4f48-94fb-eaac15c84a0f None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:46.252887 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e52d0-e06e-4f48-94fb-eaac15c84a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:46.270566 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-672e52d0-e06e-4f48-94fb-eaac15c84a0f None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:34:46.271757 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-672e52d0-e06e-4f48-94fb-eaac15c84a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:34:46.305822 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da57622-0a59-4947-b423-93c39f7850f7 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:46.313524 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:46.344302 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 157/322] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:34:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:34:46.345224 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bfaf2a-8691-4253-90e9-21f9790eb889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:46.346268 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bfaf2a-8691-4253-90e9-21f9790eb889 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:46.346730 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bfaf2a-8691-4253-90e9-21f9790eb889 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:46.347707 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bfaf2a-8691-4253-90e9-21f9790eb889 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:46.349056 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bfaf2a-8691-4253-90e9-21f9790eb889 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:46.350711 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bfaf2a-8691-4253-90e9-21f9790eb889 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:46.352804 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 166/323] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:34:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:34:46.358179 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672e52d0-e06e-4f48-94fb-eaac15c84a0f None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:46.363314 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:46.367733 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bfaf2a-8691-4253-90e9-21f9790eb889 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:46.471332 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672e52d0-e06e-4f48-94fb-eaac15c84a0f None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:46.474329 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bfaf2a-8691-4253-90e9-21f9790eb889 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:46.510424 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9ec2ea-c614-4c2e-b79a-97f596358081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:46.511100 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ec2ea-c614-4c2e-b79a-97f596358081 None admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:46.511383 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ec2ea-c614-4c2e-b79a-97f596358081 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:46.511659 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ec2ea-c614-4c2e-b79a-97f596358081 None admin] PATH_INFO: `/v3/groups` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:46.512352 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9ec2ea-c614-4c2e-b79a-97f596358081 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:46.512636 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf46558-6863-4653-855c-769cc9375410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:46.513439 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf46558-6863-4653-855c-769cc9375410 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:46.513723 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf46558-6863-4653-855c-769cc9375410 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:46.513810 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9ec2ea-c614-4c2e-b79a-97f596358081 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:46.513999 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf46558-6863-4653-855c-769cc9375410 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:46.525558 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf46558-6863-4653-855c-769cc9375410 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:34:46.528891 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 158/324] 10.222.0.42 () {60 vars in 1134 bytes} [Wed Jun 22 08:34:46 2022] POST /identity/v3/groups => generated 226 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 08:34:46.530194 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc11850-0016-4e35-93de-9862bdd161d3 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:46.530488 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc11850-0016-4e35-93de-9862bdd161d3 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:46.530766 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc11850-0016-4e35-93de-9862bdd161d3 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:46.532180 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 159/325] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:34:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:34:46.535899 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-9bf46558-6863-4653-855c-769cc9375410 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 08:34:46.535899 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:34:46.535899 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:34:46.535899 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:34:46.535899 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:34:46.535899 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:34:46.535899 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:34:46.535899 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:34:46.535899 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:34:46.535899 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:34:46.535899 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:34:46.535899 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:34:46.535899 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:34:46.535899 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:34:46.535899 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:34:46.535899 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:34:46.536868 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:34:46.536868 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:34:46.536868 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:34:46.536868 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:34:46.536868 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:34:46.536868 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:34:46.536868 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:34:46.536868 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:34:46.536868 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:34:46.536868 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:34:46.536868 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:34:46.536868 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:34:46.536868 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:34:46.536868 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:34:46.536868 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:34:46.536868 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:34:46.537651 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:34:46.537651 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:34:46.537651 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:34:46.537651 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:34:46.537651 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:34:46.537651 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:34:46.537651 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:34:46.537651 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:34:46.537651 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:34:46.537651 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:34:46.537651 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 08:34:46.537651 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:34:46.537651 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 167/326] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Jun 22 08:34:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:34:46.540019 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8401854-c1d4-425b-bff1-865bfb6b5aa4 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:46.540315 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8401854-c1d4-425b-bff1-865bfb6b5aa4 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:46.540596 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8401854-c1d4-425b-bff1-865bfb6b5aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:46.543651 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf46558-6863-4653-855c-769cc9375410 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:46.559672 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-f8401854-c1d4-425b-bff1-865bfb6b5aa4 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:34:46.560914 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-f8401854-c1d4-425b-bff1-865bfb6b5aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:34:46.584110 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:46.633282 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:46.643515 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 160/327] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:34:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:34:46.669563 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8401854-c1d4-425b-bff1-865bfb6b5aa4 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:46.669874 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf46558-6863-4653-855c-769cc9375410 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:46.708133 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24508349-9af2-4c60-a433-6e25eb649367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:46.709440 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24508349-9af2-4c60-a433-6e25eb649367 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:46.709440 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24508349-9af2-4c60-a433-6e25eb649367 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:46.709440 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24508349-9af2-4c60-a433-6e25eb649367 None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:46.710631 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24508349-9af2-4c60-a433-6e25eb649367 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:46.710631 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24508349-9af2-4c60-a433-6e25eb649367 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:46.711922 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24508349-9af2-4c60-a433-6e25eb649367 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:46.721091 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 168/328] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Jun 22 08:34:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:34:46.727323 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24508349-9af2-4c60-a433-6e25eb649367 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:46.794442 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8401854-c1d4-425b-bff1-865bfb6b5aa4 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:46.838674 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dac0f9-c3b0-4280-9612-fa9ad1bbc230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:46.839486 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dac0f9-c3b0-4280-9612-fa9ad1bbc230 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:46.839777 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dac0f9-c3b0-4280-9612-fa9ad1bbc230 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:46.840059 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dac0f9-c3b0-4280-9612-fa9ad1bbc230 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:46.842211 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:46.849671 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24508349-9af2-4c60-a433-6e25eb649367 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:46.856676 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dac0f9-c3b0-4280-9612-fa9ad1bbc230 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:34:46.866221 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-d5dac0f9-c3b0-4280-9612-fa9ad1bbc230 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:34:46.866221 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:34:46.866221 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:34:46.866221 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:34:46.866221 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:34:46.866221 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:34:46.866221 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:34:46.866221 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:34:46.866221 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:34:46.866221 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:34:46.866221 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:34:46.866221 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:34:46.866221 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:34:46.866221 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:34:46.866221 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:34:46.866221 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:34:46.867299 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:34:46.867299 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:34:46.867299 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:34:46.867299 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:34:46.867299 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:34:46.867299 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:34:46.867299 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:34:46.867299 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:34:46.867299 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:34:46.867299 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:34:46.867299 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:34:46.867299 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:34:46.867299 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:34:46.867299 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:34:46.867299 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:34:46.867299 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:34:46.868495 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:34:46.868495 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:34:46.868495 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:34:46.868495 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:34:46.868495 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:34:46.868495 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:34:46.868495 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:34:46.868495 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:34:46.868495 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:34:46.868495 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:34:46.868495 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:34:46.868495 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:34:46.868495 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 161/329] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Jun 22 08:34:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:34:46.877787 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dac0f9-c3b0-4280-9612-fa9ad1bbc230 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:46.894158 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2deb7c-a72a-47a5-a213-a66bc97babfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:46.895271 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2deb7c-a72a-47a5-a213-a66bc97babfe None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:46.895564 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2deb7c-a72a-47a5-a213-a66bc97babfe None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:46.895844 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2deb7c-a72a-47a5-a213-a66bc97babfe None admin] PATH_INFO: `/v3/users/a59c2c35a9a349d498ea445234363b52` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:46.897140 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2deb7c-a72a-47a5-a213-a66bc97babfe None admin] RBAC: Authorizing `identity:get_user(user_id=a59c2c35a9a349d498ea445234363b52)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:46.898699 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2deb7c-a72a-47a5-a213-a66bc97babfe None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:46.900382 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 169/330] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Jun 22 08:34:46 2022] GET /identity/v3/users/a59c2c35a9a349d498ea445234363b52 => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:34:46.908798 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2deb7c-a72a-47a5-a213-a66bc97babfe None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:46.955408 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:47.025215 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dac0f9-c3b0-4280-9612-fa9ad1bbc230 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:47.044563 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2deb7c-a72a-47a5-a213-a66bc97babfe None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:47.081576 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16787b4c-4b7c-4d47-932a-307fd4928bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:47.083602 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16787b4c-4b7c-4d47-932a-307fd4928bf7 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:47.084042 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16787b4c-4b7c-4d47-932a-307fd4928bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:47.084468 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16787b4c-4b7c-4d47-932a-307fd4928bf7 None admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:47.086059 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16787b4c-4b7c-4d47-932a-307fd4928bf7 None admin] RBAC: Adding query filter params (name=member) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:47.086571 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16787b4c-4b7c-4d47-932a-307fd4928bf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:47.088383 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16787b4c-4b7c-4d47-932a-307fd4928bf7 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:47.091159 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5007c-a62f-4171-8438-4867e3866e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:47.092621 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5007c-a62f-4171-8438-4867e3866e42 None admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:47.093179 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5007c-a62f-4171-8438-4867e3866e42 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:47.093664 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5007c-a62f-4171-8438-4867e3866e42 None admin] PATH_INFO: `/v3/system/users/a59c2c35a9a349d498ea445234363b52/roles/78088ffb8c224af39e594570dd740336` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:47.095882 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc5007c-a62f-4171-8438-4867e3866e42 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a59c2c35a9a349d498ea445234363b52, role_id=78088ffb8c224af39e594570dd740336)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:47.102115 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 162/331] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Jun 22 08:34:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:47.102620 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc5007c-a62f-4171-8438-4867e3866e42 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:47.105156 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16787b4c-4b7c-4d47-932a-307fd4928bf7 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:47.117388 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 170/332] 10.222.0.42 () {58 vars in 1334 bytes} [Wed Jun 22 08:34:46 2022] PUT /identity/v3/system/users/a59c2c35a9a349d498ea445234363b52/roles/78088ffb8c224af39e594570dd740336 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 08:34:47.243819 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16787b4c-4b7c-4d47-932a-307fd4928bf7 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:47.278523 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:47.294563 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f8be0-f14e-48ce-8f35-c1f4d53bfe7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:47.295573 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f8be0-f14e-48ce-8f35-c1f4d53bfe7a None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:47.295857 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f8be0-f14e-48ce-8f35-c1f4d53bfe7a None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:47.296129 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f8be0-f14e-48ce-8f35-c1f4d53bfe7a None admin] PATH_INFO: `/v3/users/b69bed9743df4e6ea8c7a830286b522c` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:47.297372 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278f8be0-f14e-48ce-8f35-c1f4d53bfe7a None admin] RBAC: Authorizing `identity:get_user(user_id=b69bed9743df4e6ea8c7a830286b522c)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:47.298853 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278f8be0-f14e-48ce-8f35-c1f4d53bfe7a None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:47.301755 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 163/333] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Jun 22 08:34:47 2022] GET /identity/v3/users/b69bed9743df4e6ea8c7a830286b522c => generated 293 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:47.307761 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5007c-a62f-4171-8438-4867e3866e42 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:47.343864 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:47.427732 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5007c-a62f-4171-8438-4867e3866e42 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:47.465174 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f300ff5-0b98-4be6-9303-35017b437776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:47.466203 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f300ff5-0b98-4be6-9303-35017b437776 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:47.466668 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f300ff5-0b98-4be6-9303-35017b437776 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:47.467122 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f300ff5-0b98-4be6-9303-35017b437776 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:47.468157 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f300ff5-0b98-4be6-9303-35017b437776 None admin] RBAC: Adding query filter params (role.id=5ea101070f734fa59995615179f2eff2, user.id=b69bed9743df4e6ea8c7a830286b522c, scope.system=all) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:47.468650 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f300ff5-0b98-4be6-9303-35017b437776 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:47.470395 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f300ff5-0b98-4be6-9303-35017b437776 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:47.484307 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 171/334] 10.222.0.42 () {56 vars in 1308 bytes} [Wed Jun 22 08:34:47 2022] GET /identity/v3/role_assignments?user.id=b69bed9743df4e6ea8c7a830286b522c&scope.system=all&role.id=5ea101070f734fa59995615179f2eff2 => generated 510 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:49.154102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe8bc0-66db-4752-9a58-a05956cd203d None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:49.154102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe8bc0-66db-4752-9a58-a05956cd203d None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:49.154102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe8bc0-66db-4752-9a58-a05956cd203d None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:49.155499 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 164/335] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:34:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:34:49.161026 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb9da35-a392-47ae-b01b-a31b92f0a723 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:49.161899 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb9da35-a392-47ae-b01b-a31b92f0a723 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:49.162418 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb9da35-a392-47ae-b01b-a31b92f0a723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:49.182875 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-0fb9da35-a392-47ae-b01b-a31b92f0a723 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:34:49.184420 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-0fb9da35-a392-47ae-b01b-a31b92f0a723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:34:49.280160 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 172/336] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:34:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:34:49.318180 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fe8bc0-66db-4752-9a58-a05956cd203d None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:49.447898 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fe8bc0-66db-4752-9a58-a05956cd203d None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:49.485677 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3fd2fd-9f71-455f-9b35-637c53c45841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:49.486520 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3fd2fd-9f71-455f-9b35-637c53c45841 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:49.486802 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3fd2fd-9f71-455f-9b35-637c53c45841 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:49.487079 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3fd2fd-9f71-455f-9b35-637c53c45841 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:49.502862 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3fd2fd-9f71-455f-9b35-637c53c45841 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:34:49.520273 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-5d3fd2fd-9f71-455f-9b35-637c53c45841 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:34:49.520273 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:34:49.520273 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:34:49.520273 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:34:49.520273 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:34:49.520273 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:34:49.520273 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:34:49.520273 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:34:49.520273 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:34:49.520273 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:34:49.520273 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:34:49.520273 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:34:49.520273 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:34:49.520273 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:34:49.520273 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:34:49.520273 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:34:49.521191 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:34:49.521191 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:34:49.521191 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:34:49.521191 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:34:49.521191 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:34:49.521191 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:34:49.521191 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:34:49.521191 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:34:49.521191 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:34:49.521191 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:34:49.521191 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:34:49.521191 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:34:49.521191 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:34:49.521191 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:34:49.521191 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:34:49.521191 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:34:49.522003 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:34:49.522003 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:34:49.522003 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:34:49.522003 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:34:49.522003 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:34:49.522003 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:34:49.522003 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:34:49.522003 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:34:49.522003 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:34:49.522003 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:34:49.522003 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:34:49.522003 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:34:49.522003 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 165/337] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Jun 22 08:34:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:34:49.529078 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb9da35-a392-47ae-b01b-a31b92f0a723 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:49.552890 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:49.618598 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44f097-fa6c-42dd-91c7-9a8f83e4a75b None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:49.618938 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44f097-fa6c-42dd-91c7-9a8f83e4a75b None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:49.619158 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44f097-fa6c-42dd-91c7-9a8f83e4a75b None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:49.620679 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 166/338] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:34:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:34:49.629184 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f7c86-85aa-4788-93e9-9169b7e3fff2 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:49.629184 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f7c86-85aa-4788-93e9-9169b7e3fff2 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:49.629184 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f7c86-85aa-4788-93e9-9169b7e3fff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:49.658531 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb9da35-a392-47ae-b01b-a31b92f0a723 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:49.665386 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-828f7c86-85aa-4788-93e9-9169b7e3fff2 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:34:49.666908 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-828f7c86-85aa-4788-93e9-9169b7e3fff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:34:49.732962 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f90c7-cd20-47ec-8e8b-58a3b3a95de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:49.733568 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f90c7-cd20-47ec-8e8b-58a3b3a95de6 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:49.733852 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f90c7-cd20-47ec-8e8b-58a3b3a95de6 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:49.734190 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f90c7-cd20-47ec-8e8b-58a3b3a95de6 None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:49.734983 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994f90c7-cd20-47ec-8e8b-58a3b3a95de6 None admin] RBAC: Adding query filter params (name=member) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:49.738101 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994f90c7-cd20-47ec-8e8b-58a3b3a95de6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:49.738101 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994f90c7-cd20-47ec-8e8b-58a3b3a95de6 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:49.752785 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 173/339] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Jun 22 08:34:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:49.764412 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:49.764584 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f90c7-cd20-47ec-8e8b-58a3b3a95de6 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:49.843794 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 167/340] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:34:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 22 08:34:49.892060 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f7c86-85aa-4788-93e9-9169b7e3fff2 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:49.904777 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:49.946006 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f90c7-cd20-47ec-8e8b-58a3b3a95de6 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:49.999943 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83699c0-0cc2-4ee6-8a5e-15a9ec25c7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:50.000761 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83699c0-0cc2-4ee6-8a5e-15a9ec25c7c3 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:50.001077 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83699c0-0cc2-4ee6-8a5e-15a9ec25c7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:50.001363 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83699c0-0cc2-4ee6-8a5e-15a9ec25c7c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:50.125739 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83699c0-0cc2-4ee6-8a5e-15a9ec25c7c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:50.127269 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83699c0-0cc2-4ee6-8a5e-15a9ec25c7c3 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:50.150444 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f7c86-85aa-4788-93e9-9169b7e3fff2 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:50.220786 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:50.226130 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595d6e12-ca4e-43d6-b2f6-a45d5b2970fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:50.227670 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d6e12-ca4e-43d6-b2f6-a45d5b2970fd None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:50.228097 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d6e12-ca4e-43d6-b2f6-a45d5b2970fd None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:50.228514 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d6e12-ca4e-43d6-b2f6-a45d5b2970fd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:50.240654 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595d6e12-ca4e-43d6-b2f6-a45d5b2970fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:34:50.244591 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 174/341] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Jun 22 08:34:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 22 08:34:50.246001 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d301bbb-c1ff-450e-971c-ca6157753c4b None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:50.246318 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d301bbb-c1ff-450e-971c-ca6157753c4b None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:50.246596 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d301bbb-c1ff-450e-971c-ca6157753c4b None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:50.248031 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 175/342] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:34:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:34:50.249369 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d1689-c9e6-44bb-8311-d2af72a9f302 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:50.249657 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d1689-c9e6-44bb-8311-d2af72a9f302 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:50.249936 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d1689-c9e6-44bb-8311-d2af72a9f302 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:50.250626 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-595d6e12-ca4e-43d6-b2f6-a45d5b2970fd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:34:50.250626 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:34:50.250626 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:34:50.250626 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:34:50.250626 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:34:50.250626 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:34:50.250626 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:34:50.250626 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:34:50.250626 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:34:50.250626 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:34:50.250626 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:34:50.250626 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:34:50.250626 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:34:50.250626 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:34:50.250626 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:34:50.250626 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:34:50.251619 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:34:50.251619 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:34:50.251619 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:34:50.251619 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:34:50.251619 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:34:50.251619 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:34:50.251619 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:34:50.251619 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:34:50.251619 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:34:50.251619 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:34:50.251619 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:34:50.251619 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:34:50.251619 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:34:50.251619 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:34:50.251619 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:34:50.251619 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:34:50.252370 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:34:50.252370 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:34:50.252370 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:34:50.252370 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:34:50.252370 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:34:50.252370 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:34:50.252370 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:34:50.252370 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:34:50.252370 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:34:50.252370 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:34:50.252370 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:34:50.252370 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:34:50.253496 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 176/343] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:34:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:34:50.253496 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d1689-c9e6-44bb-8311-d2af72a9f302 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:50.259358 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 168/344] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Jun 22 08:34:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:34:50.260845 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb1104-f67f-4a73-a48d-f4782551d980 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:50.261326 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb1104-f67f-4a73-a48d-f4782551d980 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:50.261912 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb1104-f67f-4a73-a48d-f4782551d980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:50.283145 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-6cdb1104-f67f-4a73-a48d-f4782551d980 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:34:50.285199 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-6cdb1104-f67f-4a73-a48d-f4782551d980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:34:50.325961 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:50.384886 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 169/345] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:34:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:34:50.387344 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc7deb-af0b-42eb-ac26-a5dca5995402 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:50.387870 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc7deb-af0b-42eb-ac26-a5dca5995402 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:50.388324 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc7deb-af0b-42eb-ac26-a5dca5995402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:50.393413 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d1689-c9e6-44bb-8311-d2af72a9f302 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:50.411086 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-98dc7deb-af0b-42eb-ac26-a5dca5995402 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:34:50.414395 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-98dc7deb-af0b-42eb-ac26-a5dca5995402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:34:50.453858 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d061c7-c799-4cd5-adc3-7d250307086a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:50.455218 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d061c7-c799-4cd5-adc3-7d250307086a None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:50.455513 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d061c7-c799-4cd5-adc3-7d250307086a None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:50.456043 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d061c7-c799-4cd5-adc3-7d250307086a None admin] PATH_INFO: `/v3/projects/68c923ae1ea74d589e86978e4dd415c2` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:50.457976 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d061c7-c799-4cd5-adc3-7d250307086a None admin] RBAC: Authorizing `identity:get_project(project_id=68c923ae1ea74d589e86978e4dd415c2)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:50.460480 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d061c7-c799-4cd5-adc3-7d250307086a None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:50.466266 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 177/346] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Jun 22 08:34:50 2022] GET /identity/v3/projects/68c923ae1ea74d589e86978e4dd415c2 => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:50.466266 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d061c7-c799-4cd5-adc3-7d250307086a None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:50.527582 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 170/347] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:34:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:34:50.529019 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc7deb-af0b-42eb-ac26-a5dca5995402 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:50.564453 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:50.635815 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d061c7-c799-4cd5-adc3-7d250307086a None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:50.650598 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:50.656514 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc7deb-af0b-42eb-ac26-a5dca5995402 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:50.683481 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c1734b-f1cd-439c-bd92-1d21c8055517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:50.687591 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1734b-f1cd-439c-bd92-1d21c8055517 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:50.690549 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1734b-f1cd-439c-bd92-1d21c8055517 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:50.693310 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1734b-f1cd-439c-bd92-1d21c8055517 None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:50.696552 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c1734b-f1cd-439c-bd92-1d21c8055517 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:50.697199 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c1734b-f1cd-439c-bd92-1d21c8055517 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:50.699556 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c1734b-f1cd-439c-bd92-1d21c8055517 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:50.700439 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ccfbc-22ec-470c-a84d-15e3088d9036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:50.701254 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ccfbc-22ec-470c-a84d-15e3088d9036 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:50.701540 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ccfbc-22ec-470c-a84d-15e3088d9036 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:50.701815 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ccfbc-22ec-470c-a84d-15e3088d9036 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:50.712347 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 178/348] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Jun 22 08:34:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:50.713574 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c1734b-f1cd-439c-bd92-1d21c8055517 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:50.719772 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380ccfbc-22ec-470c-a84d-15e3088d9036 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:34:50.737148 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-380ccfbc-22ec-470c-a84d-15e3088d9036 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:34:50.737148 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:34:50.737148 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:34:50.737148 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:34:50.737148 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:34:50.737148 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:34:50.737148 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:34:50.737148 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:34:50.737148 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:34:50.737148 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:34:50.737148 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:34:50.737148 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:34:50.737148 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:34:50.737148 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:34:50.737148 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:34:50.737148 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:34:50.738290 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:34:50.738290 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:34:50.738290 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:34:50.738290 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:34:50.738290 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:34:50.738290 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:34:50.738290 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:34:50.738290 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:34:50.738290 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:34:50.738290 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:34:50.738290 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:34:50.738290 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:34:50.738290 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:34:50.738290 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:34:50.738290 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:34:50.738290 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:34:50.739888 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:34:50.739888 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:34:50.739888 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:34:50.739888 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:34:50.739888 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:34:50.739888 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:34:50.739888 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:34:50.739888 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:34:50.739888 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:34:50.739888 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:34:50.739888 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:34:50.739888 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:34:50.739888 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 171/349] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Jun 22 08:34:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:34:50.741404 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ccfbc-22ec-470c-a84d-15e3088d9036 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:50.843447 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c1734b-f1cd-439c-bd92-1d21c8055517 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:50.853572 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ccfbc-22ec-470c-a84d-15e3088d9036 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:50.854360 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:50.885170 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d27b692-78b8-45c4-889a-6d6fbedd0a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:50.886341 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27b692-78b8-45c4-889a-6d6fbedd0a25 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:50.886612 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27b692-78b8-45c4-889a-6d6fbedd0a25 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:50.887000 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27b692-78b8-45c4-889a-6d6fbedd0a25 None admin] PATH_INFO: `/v3/groups/5405b78cebff4a2096483c4afbfa37e1` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:50.895485 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7750f47-544c-42c0-8ad6-5eaa58901925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:50.896261 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d27b692-78b8-45c4-889a-6d6fbedd0a25 None admin] RBAC: Authorizing `identity:get_group(group_id=5405b78cebff4a2096483c4afbfa37e1)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:50.896720 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7750f47-544c-42c0-8ad6-5eaa58901925 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:50.897144 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7750f47-544c-42c0-8ad6-5eaa58901925 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:50.897616 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7750f47-544c-42c0-8ad6-5eaa58901925 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:50.898138 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d27b692-78b8-45c4-889a-6d6fbedd0a25 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:50.904723 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 179/350] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Jun 22 08:34:50 2022] GET /identity/v3/groups/5405b78cebff4a2096483c4afbfa37e1 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:50.904723 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d27b692-78b8-45c4-889a-6d6fbedd0a25 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:50.916909 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7750f47-544c-42c0-8ad6-5eaa58901925 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:34:50.926408 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-a7750f47-544c-42c0-8ad6-5eaa58901925 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 08:34:50.926408 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:34:50.926408 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:34:50.926408 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:34:50.926408 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:34:50.926408 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:34:50.926408 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:34:50.926408 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:34:50.926408 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:34:50.926408 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:34:50.926408 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:34:50.926408 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:34:50.926408 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:34:50.926408 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:34:50.926408 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:34:50.926408 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:34:50.927333 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:34:50.927333 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:34:50.927333 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:34:50.927333 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:34:50.927333 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:34:50.927333 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:34:50.927333 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:34:50.927333 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:34:50.927333 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:34:50.927333 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:34:50.927333 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:34:50.927333 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:34:50.927333 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:34:50.927333 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:34:50.927333 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:34:50.927333 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:34:50.928115 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:34:50.928115 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:34:50.928115 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:34:50.928115 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:34:50.928115 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:34:50.928115 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:34:50.928115 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:34:50.928115 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:34:50.928115 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:34:50.928115 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:34:50.928115 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 08:34:50.928115 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:34:50.931071 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 172/351] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Jun 22 08:34:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:34:50.932300 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7750f47-544c-42c0-8ad6-5eaa58901925 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:50.958533 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:51.047961 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d27b692-78b8-45c4-889a-6d6fbedd0a25 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:51.051898 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7750f47-544c-42c0-8ad6-5eaa58901925 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:51.088379 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f54c5a-827f-4860-a022-43f82e371280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:51.089140 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f54c5a-827f-4860-a022-43f82e371280 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:51.089444 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f54c5a-827f-4860-a022-43f82e371280 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:51.089721 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f54c5a-827f-4860-a022-43f82e371280 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:51.092178 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e7c7d6-14de-42b8-bbd0-9ce93156ba5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:51.093191 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e7c7d6-14de-42b8-bbd0-9ce93156ba5a None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:51.093828 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e7c7d6-14de-42b8-bbd0-9ce93156ba5a None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:51.094341 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e7c7d6-14de-42b8-bbd0-9ce93156ba5a None admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:51.095527 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e7c7d6-14de-42b8-bbd0-9ce93156ba5a None admin] RBAC: Adding query filter params (name=member) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:51.096075 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e7c7d6-14de-42b8-bbd0-9ce93156ba5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:51.097771 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e7c7d6-14de-42b8-bbd0-9ce93156ba5a None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:51.109742 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 173/352] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Jun 22 08:34:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:51.110933 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e7c7d6-14de-42b8-bbd0-9ce93156ba5a None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:51.147053 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:51.184575 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f54c5a-827f-4860-a022-43f82e371280 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:51.186386 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f54c5a-827f-4860-a022-43f82e371280 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:51.217948 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:51.248036 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e7c7d6-14de-42b8-bbd0-9ce93156ba5a None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:51.304741 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca9c2c-bf67-4c19-8bac-dcb169b321e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:51.305433 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca9c2c-bf67-4c19-8bac-dcb169b321e2 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:51.305707 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca9c2c-bf67-4c19-8bac-dcb169b321e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:51.305989 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca9c2c-bf67-4c19-8bac-dcb169b321e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:51.306917 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcca9c2c-bf67-4c19-8bac-dcb169b321e2 None admin] RBAC: Adding query filter params (group.id=5405b78cebff4a2096483c4afbfa37e1, role.id=5ea101070f734fa59995615179f2eff2, scope.project.id=68c923ae1ea74d589e86978e4dd415c2) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:51.307180 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcca9c2c-bf67-4c19-8bac-dcb169b321e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:51.308661 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcca9c2c-bf67-4c19-8bac-dcb169b321e2 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:51.323026 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 174/353] 10.222.0.42 () {56 vars in 1376 bytes} [Wed Jun 22 08:34:51 2022] GET /identity/v3/role_assignments?group.id=5405b78cebff4a2096483c4afbfa37e1&scope.project.id=68c923ae1ea74d589e86978e4dd415c2&role.id=5ea101070f734fa59995615179f2eff2 => generated 260 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:51.324555 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca9c2c-bf67-4c19-8bac-dcb169b321e2 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:51.332430 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 180/354] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Jun 22 08:34:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:34:51.337217 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637b1aa-ad8b-4481-bd27-46c11bda82a6 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:51.337217 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637b1aa-ad8b-4481-bd27-46c11bda82a6 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:51.337217 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637b1aa-ad8b-4481-bd27-46c11bda82a6 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:51.337217 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 181/355] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:34:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:34:51.337818 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2637b1aa-ad8b-4481-bd27-46c11bda82a6 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:51.441088 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:51.478317 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca9c2c-bf67-4c19-8bac-dcb169b321e2 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:51.486872 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2637b1aa-ad8b-4481-bd27-46c11bda82a6 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:51.525618 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a3ffe-e01d-4645-809b-099344565f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:51.526374 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a3ffe-e01d-4645-809b-099344565f61 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:51.526671 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a3ffe-e01d-4645-809b-099344565f61 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:51.526945 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a3ffe-e01d-4645-809b-099344565f61 None admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:51.527730 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925a3ffe-e01d-4645-809b-099344565f61 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:51.528043 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925a3ffe-e01d-4645-809b-099344565f61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:51.529464 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925a3ffe-e01d-4645-809b-099344565f61 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:51.539698 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 175/356] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Jun 22 08:34:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:51.540724 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a3ffe-e01d-4645-809b-099344565f61 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:51.542275 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ba538-6d27-44c7-8e34-dccd7e796378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:51.543261 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ba538-6d27-44c7-8e34-dccd7e796378 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:51.544083 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:51.544593 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ba538-6d27-44c7-8e34-dccd7e796378 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:51.546459 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ba538-6d27-44c7-8e34-dccd7e796378 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:51.638718 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ba538-6d27-44c7-8e34-dccd7e796378 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:51.640747 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ba538-6d27-44c7-8e34-dccd7e796378 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:51.682636 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a3ffe-e01d-4645-809b-099344565f61 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:51.733184 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b33b87d-96ce-443b-9389-a2e70f3d3bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:51.733986 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b33b87d-96ce-443b-9389-a2e70f3d3bea None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:51.734311 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b33b87d-96ce-443b-9389-a2e70f3d3bea None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:51.734584 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b33b87d-96ce-443b-9389-a2e70f3d3bea None admin] PATH_INFO: `/v3/projects/68c923ae1ea74d589e86978e4dd415c2` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:51.735830 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b33b87d-96ce-443b-9389-a2e70f3d3bea None admin] RBAC: Authorizing `identity:get_project(project_id=68c923ae1ea74d589e86978e4dd415c2)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:51.737922 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b33b87d-96ce-443b-9389-a2e70f3d3bea None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:51.739722 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 176/357] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Jun 22 08:34:51 2022] GET /identity/v3/projects/68c923ae1ea74d589e86978e4dd415c2 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:51.740922 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23754e55-6bcb-46e4-ac81-1eb13ec73a68 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:51.741208 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23754e55-6bcb-46e4-ac81-1eb13ec73a68 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:51.741483 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23754e55-6bcb-46e4-ac81-1eb13ec73a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:51.747955 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:51.764708 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-23754e55-6bcb-46e4-ac81-1eb13ec73a68 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:34:51.766236 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-23754e55-6bcb-46e4-ac81-1eb13ec73a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:34:51.812155 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 182/358] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Jun 22 08:34:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:34:51.813034 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ba538-6d27-44c7-8e34-dccd7e796378 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:51.848082 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:51.855508 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 177/359] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:34:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:34:51.857561 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf18f5-1725-42f8-bdfe-3346f47fee11 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:51.857844 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf18f5-1725-42f8-bdfe-3346f47fee11 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:51.858309 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf18f5-1725-42f8-bdfe-3346f47fee11 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:51.860678 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 178/360] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:34:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:34:51.861155 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caf18f5-1725-42f8-bdfe-3346f47fee11 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:51.952874 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ba538-6d27-44c7-8e34-dccd7e796378 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:52.001804 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0904cc8a-eadb-457f-a9de-4e3827ce8ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:52.003457 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904cc8a-eadb-457f-a9de-4e3827ce8ff4 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:52.003934 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904cc8a-eadb-457f-a9de-4e3827ce8ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:52.004341 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904cc8a-eadb-457f-a9de-4e3827ce8ff4 None admin] PATH_INFO: `/v3/users/a59c2c35a9a349d498ea445234363b52` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:52.006897 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0904cc8a-eadb-457f-a9de-4e3827ce8ff4 None admin] RBAC: Authorizing `identity:get_user(user_id=a59c2c35a9a349d498ea445234363b52)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:52.008967 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0904cc8a-eadb-457f-a9de-4e3827ce8ff4 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:52.011442 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 183/361] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Jun 22 08:34:51 2022] GET /identity/v3/users/a59c2c35a9a349d498ea445234363b52 => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:52.012614 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0904cc8a-eadb-457f-a9de-4e3827ce8ff4 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:52.024701 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caf18f5-1725-42f8-bdfe-3346f47fee11 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:52.076330 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d63717-720e-4b97-aa58-cb086cb2e960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:52.077236 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d63717-720e-4b97-aa58-cb086cb2e960 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:52.077524 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d63717-720e-4b97-aa58-cb086cb2e960 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:52.078509 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d63717-720e-4b97-aa58-cb086cb2e960 None admin] PATH_INFO: `/v3/groups/5405b78cebff4a2096483c4afbfa37e1` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:52.080505 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d63717-720e-4b97-aa58-cb086cb2e960 None admin] RBAC: Authorizing `identity:get_group(group_id=5405b78cebff4a2096483c4afbfa37e1)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:52.080755 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:52.083626 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d63717-720e-4b97-aa58-cb086cb2e960 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:52.085869 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 179/362] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Jun 22 08:34:51 2022] GET /identity/v3/groups/5405b78cebff4a2096483c4afbfa37e1 => generated 226 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:52.087554 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012349d-b608-4588-9656-322090e06128 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:52.087872 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012349d-b608-4588-9656-322090e06128 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:52.088151 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012349d-b608-4588-9656-322090e06128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:52.124247 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-8012349d-b608-4588-9656-322090e06128 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:34:52.125706 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-8012349d-b608-4588-9656-322090e06128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:34:52.161129 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0904cc8a-eadb-457f-a9de-4e3827ce8ff4 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:52.204780 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a1758-fc3b-4d6f-a565-57d0b1eeca6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:52.205958 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a1758-fc3b-4d6f-a565-57d0b1eeca6e None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:52.206425 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a1758-fc3b-4d6f-a565-57d0b1eeca6e None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:52.206710 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a1758-fc3b-4d6f-a565-57d0b1eeca6e None admin] PATH_INFO: `/v3/projects/adfd1b153ab54652bb25b1b4a02bae1d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:52.208054 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095a1758-fc3b-4d6f-a565-57d0b1eeca6e None admin] RBAC: Authorizing `identity:get_project(project_id=adfd1b153ab54652bb25b1b4a02bae1d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:52.209553 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095a1758-fc3b-4d6f-a565-57d0b1eeca6e None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:52.211383 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 184/363] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Jun 22 08:34:52 2022] GET /identity/v3/projects/adfd1b153ab54652bb25b1b4a02bae1d => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:52.212118 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:52.212270 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a1758-fc3b-4d6f-a565-57d0b1eeca6e None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:52.218532 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 180/364] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:34:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:34:52.219542 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8012349d-b608-4588-9656-322090e06128 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:52.348372 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8012349d-b608-4588-9656-322090e06128 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:52.379255 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a1758-fc3b-4d6f-a565-57d0b1eeca6e None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:52.387909 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f486c1fe-bbd2-4386-af2b-310f38742275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:52.388827 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486c1fe-bbd2-4386-af2b-310f38742275 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:52.389258 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486c1fe-bbd2-4386-af2b-310f38742275 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:52.389774 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486c1fe-bbd2-4386-af2b-310f38742275 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:52.390875 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f486c1fe-bbd2-4386-af2b-310f38742275 None admin] RBAC: Adding query filter params (role.id=78088ffb8c224af39e594570dd740336, user.id=a59c2c35a9a349d498ea445234363b52, scope.system=all) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:52.391405 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f486c1fe-bbd2-4386-af2b-310f38742275 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:52.392093 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:52.394010 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f486c1fe-bbd2-4386-af2b-310f38742275 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:52.409846 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 181/365] 10.222.0.42 () {56 vars in 1308 bytes} [Wed Jun 22 08:34:52 2022] GET /identity/v3/role_assignments?user.id=a59c2c35a9a349d498ea445234363b52&scope.system=all&role.id=78088ffb8c224af39e594570dd740336 => generated 510 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:52.411072 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f486c1fe-bbd2-4386-af2b-310f38742275 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:52.426776 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1503fc-a10d-4a46-800c-fff8f2a3f812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:52.427631 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1503fc-a10d-4a46-800c-fff8f2a3f812 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:52.427913 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1503fc-a10d-4a46-800c-fff8f2a3f812 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:52.428191 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1503fc-a10d-4a46-800c-fff8f2a3f812 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:52.440528 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1503fc-a10d-4a46-800c-fff8f2a3f812 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:34:52.449557 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-5e1503fc-a10d-4a46-800c-fff8f2a3f812 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:34:52.449557 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:34:52.449557 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:34:52.449557 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:34:52.449557 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:34:52.449557 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:34:52.449557 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:34:52.449557 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:34:52.449557 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:34:52.449557 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:34:52.449557 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:34:52.449557 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:34:52.449557 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:34:52.449557 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:34:52.449557 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:34:52.449557 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:34:52.450581 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:34:52.450581 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:34:52.450581 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:34:52.450581 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:34:52.450581 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:34:52.450581 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:34:52.450581 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:34:52.450581 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:34:52.450581 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:34:52.450581 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:34:52.450581 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:34:52.450581 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:34:52.450581 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:34:52.450581 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:34:52.450581 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:34:52.450581 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:34:52.451384 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:34:52.451384 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:34:52.451384 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:34:52.451384 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:34:52.451384 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:34:52.451384 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:34:52.451384 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:34:52.451384 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:34:52.451384 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:34:52.451384 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:34:52.451384 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:34:52.451384 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:34:52.451384 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 185/366] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Jun 22 08:34:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:34:52.452077 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1503fc-a10d-4a46-800c-fff8f2a3f812 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:52.505047 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:52.557416 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f486c1fe-bbd2-4386-af2b-310f38742275 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:52.578693 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1503fc-a10d-4a46-800c-fff8f2a3f812 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:52.605379 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f439c98-65a7-46dd-a02b-0f93cecdaf86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:52.606054 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f439c98-65a7-46dd-a02b-0f93cecdaf86 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:52.606388 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f439c98-65a7-46dd-a02b-0f93cecdaf86 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:52.606670 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f439c98-65a7-46dd-a02b-0f93cecdaf86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:52.607660 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f439c98-65a7-46dd-a02b-0f93cecdaf86 None admin] RBAC: Adding query filter params (group.id=5405b78cebff4a2096483c4afbfa37e1, role.id=a92b520fb33f4333aad569d98be2bd7e, scope.project.id=68c923ae1ea74d589e86978e4dd415c2) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:52.607982 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f439c98-65a7-46dd-a02b-0f93cecdaf86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:52.609652 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f439c98-65a7-46dd-a02b-0f93cecdaf86 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:52.621490 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 182/367] 10.222.0.42 () {56 vars in 1376 bytes} [Wed Jun 22 08:34:52 2022] GET /identity/v3/role_assignments?group.id=5405b78cebff4a2096483c4afbfa37e1&scope.project.id=68c923ae1ea74d589e86978e4dd415c2&role.id=a92b520fb33f4333aad569d98be2bd7e => generated 260 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:52.621490 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f439c98-65a7-46dd-a02b-0f93cecdaf86 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:52.628892 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3548a4e3-f57f-462a-82a0-21ae9812141a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:52.630240 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548a4e3-f57f-462a-82a0-21ae9812141a None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:52.630732 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548a4e3-f57f-462a-82a0-21ae9812141a None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:52.631353 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548a4e3-f57f-462a-82a0-21ae9812141a None admin] PATH_INFO: `/v3/groups/5405b78cebff4a2096483c4afbfa37e1` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:52.633352 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3548a4e3-f57f-462a-82a0-21ae9812141a None admin] RBAC: Authorizing `identity:get_group(group_id=5405b78cebff4a2096483c4afbfa37e1)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:52.635193 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3548a4e3-f57f-462a-82a0-21ae9812141a None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:52.637339 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 186/368] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Jun 22 08:34:52 2022] GET /identity/v3/groups/5405b78cebff4a2096483c4afbfa37e1 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:52.638424 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3548a4e3-f57f-462a-82a0-21ae9812141a None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:52.686665 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:52.765724 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3548a4e3-f57f-462a-82a0-21ae9812141a None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:52.811105 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f439c98-65a7-46dd-a02b-0f93cecdaf86 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:52.833621 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb89db-a63c-4154-9fd7-6c51e7db8756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:52.835079 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb89db-a63c-4154-9fd7-6c51e7db8756 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:52.835563 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb89db-a63c-4154-9fd7-6c51e7db8756 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:52.836258 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb89db-a63c-4154-9fd7-6c51e7db8756 None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:52.837582 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eb89db-a63c-4154-9fd7-6c51e7db8756 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:52.839024 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eb89db-a63c-4154-9fd7-6c51e7db8756 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:52.841990 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eb89db-a63c-4154-9fd7-6c51e7db8756 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:52.849634 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:52.855091 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 187/369] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Jun 22 08:34:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:52.856010 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb89db-a63c-4154-9fd7-6c51e7db8756 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:52.893849 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf62875-1b7a-49cd-8622-b7fe383a8f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:52.895177 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf62875-1b7a-49cd-8622-b7fe383a8f6e None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:52.896784 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf62875-1b7a-49cd-8622-b7fe383a8f6e None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:52.897602 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf62875-1b7a-49cd-8622-b7fe383a8f6e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:52.914515 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf62875-1b7a-49cd-8622-b7fe383a8f6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:34:52.928059 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-ecf62875-1b7a-49cd-8622-b7fe383a8f6e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:34:52.928059 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:34:52.928059 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:34:52.928059 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:34:52.928059 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:34:52.928059 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:34:52.928059 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:34:52.928059 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:34:52.928059 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:34:52.928059 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:34:52.928059 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:34:52.928059 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:34:52.928059 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:34:52.928059 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:34:52.928059 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:34:52.928059 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:34:52.929091 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:34:52.929091 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:34:52.929091 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:34:52.929091 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:34:52.929091 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:34:52.929091 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:34:52.929091 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:34:52.929091 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:34:52.929091 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:34:52.929091 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:34:52.929091 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:34:52.929091 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:34:52.929091 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:34:52.929091 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:34:52.929091 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:34:52.929091 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:34:52.929985 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:34:52.929985 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:34:52.929985 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:34:52.929985 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:34:52.929985 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:34:52.929985 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:34:52.929985 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:34:52.929985 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:34:52.929985 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:34:52.929985 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:34:52.929985 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:34:52.929985 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:34:52.933246 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 183/370] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Jun 22 08:34:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:34:52.935301 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf62875-1b7a-49cd-8622-b7fe383a8f6e None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:53.043940 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb89db-a63c-4154-9fd7-6c51e7db8756 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:53.046408 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:53.056860 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf62875-1b7a-49cd-8622-b7fe383a8f6e None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:53.092965 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fea70a-de6a-41b3-b573-188cd0735177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:53.093631 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fea70a-de6a-41b3-b573-188cd0735177 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:53.093920 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fea70a-de6a-41b3-b573-188cd0735177 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:53.094237 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fea70a-de6a-41b3-b573-188cd0735177 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:53.095082 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fea70a-de6a-41b3-b573-188cd0735177 None admin] RBAC: Adding query filter params (group.id=5405b78cebff4a2096483c4afbfa37e1, role.id=5ea101070f734fa59995615179f2eff2, scope.project.id=adfd1b153ab54652bb25b1b4a02bae1d) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:53.095399 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fea70a-de6a-41b3-b573-188cd0735177 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:53.099362 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fea70a-de6a-41b3-b573-188cd0735177 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:53.102032 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf498de-e775-4865-b0fb-df046cd1c32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:53.102807 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf498de-e775-4865-b0fb-df046cd1c32e None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:53.103092 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf498de-e775-4865-b0fb-df046cd1c32e None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:53.103368 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf498de-e775-4865-b0fb-df046cd1c32e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:53.116142 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 188/371] 10.222.0.42 () {56 vars in 1376 bytes} [Wed Jun 22 08:34:52 2022] GET /identity/v3/role_assignments?group.id=5405b78cebff4a2096483c4afbfa37e1&scope.project.id=adfd1b153ab54652bb25b1b4a02bae1d&role.id=5ea101070f734fa59995615179f2eff2 => generated 260 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:53.116142 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fea70a-de6a-41b3-b573-188cd0735177 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:53.208781 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:53.249582 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf498de-e775-4865-b0fb-df046cd1c32e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:53.251132 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf498de-e775-4865-b0fb-df046cd1c32e None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:53.333186 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fea70a-de6a-41b3-b573-188cd0735177 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:53.401522 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c3da3-f69a-48a1-ba23-5798a00c39c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:53.403122 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c3da3-f69a-48a1-ba23-5798a00c39c0 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:53.403421 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c3da3-f69a-48a1-ba23-5798a00c39c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:53.403742 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c3da3-f69a-48a1-ba23-5798a00c39c0 None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:53.404553 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438c3da3-f69a-48a1-ba23-5798a00c39c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:53.404875 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438c3da3-f69a-48a1-ba23-5798a00c39c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:53.406417 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438c3da3-f69a-48a1-ba23-5798a00c39c0 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:53.431870 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 189/372] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Jun 22 08:34:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:53.438151 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c3da3-f69a-48a1-ba23-5798a00c39c0 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:53.461710 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 184/373] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Jun 22 08:34:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:34:53.467502 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf498de-e775-4865-b0fb-df046cd1c32e None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:53.486725 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:53.570913 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:53.595373 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf498de-e775-4865-b0fb-df046cd1c32e None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:53.601565 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c3da3-f69a-48a1-ba23-5798a00c39c0 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:53.637114 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f0df57-15e9-4d82-80b6-dfdc9733a23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:53.638424 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0df57-15e9-4d82-80b6-dfdc9733a23d None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:53.638940 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0df57-15e9-4d82-80b6-dfdc9733a23d None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:53.639390 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0df57-15e9-4d82-80b6-dfdc9733a23d None admin] PATH_INFO: `/v3/projects/adfd1b153ab54652bb25b1b4a02bae1d` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:53.640885 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f0df57-15e9-4d82-80b6-dfdc9733a23d None admin] RBAC: Authorizing `identity:get_project(project_id=adfd1b153ab54652bb25b1b4a02bae1d)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:53.642875 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f0df57-15e9-4d82-80b6-dfdc9733a23d None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:53.650184 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 185/374] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Jun 22 08:34:53 2022] GET /identity/v3/projects/adfd1b153ab54652bb25b1b4a02bae1d => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:34:53.651926 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f0df57-15e9-4d82-80b6-dfdc9733a23d None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:53.654748 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a20444-231b-4068-befb-aaf5e4992668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:53.655523 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a20444-231b-4068-befb-aaf5e4992668 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:53.656039 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a20444-231b-4068-befb-aaf5e4992668 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:53.656298 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a20444-231b-4068-befb-aaf5e4992668 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:53.740898 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a20444-231b-4068-befb-aaf5e4992668 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:53.742614 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a20444-231b-4068-befb-aaf5e4992668 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:53.771566 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:53.782143 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f0df57-15e9-4d82-80b6-dfdc9733a23d None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:53.825796 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca8741-8ba3-4104-88f8-aeaff6a96c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:53.827063 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca8741-8ba3-4104-88f8-aeaff6a96c55 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:53.827624 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca8741-8ba3-4104-88f8-aeaff6a96c55 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:53.828070 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca8741-8ba3-4104-88f8-aeaff6a96c55 None admin] PATH_INFO: `/v3/groups/5405b78cebff4a2096483c4afbfa37e1` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:53.829523 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ca8741-8ba3-4104-88f8-aeaff6a96c55 None admin] RBAC: Authorizing `identity:get_group(group_id=5405b78cebff4a2096483c4afbfa37e1)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:53.831286 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ca8741-8ba3-4104-88f8-aeaff6a96c55 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:53.833659 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 186/375] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Jun 22 08:34:53 2022] GET /identity/v3/groups/5405b78cebff4a2096483c4afbfa37e1 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:34:53.835198 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac081c23-2d57-4ee4-bfe9-57e95aca09fd None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:53.835668 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac081c23-2d57-4ee4-bfe9-57e95aca09fd None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:53.836202 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac081c23-2d57-4ee4-bfe9-57e95aca09fd None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:53.837897 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 187/376] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:34:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:34:53.843695 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111ef4e-642b-4847-b860-d029bbe37fce None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:53.844316 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111ef4e-642b-4847-b860-d029bbe37fce None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:53.844910 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111ef4e-642b-4847-b860-d029bbe37fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:53.866093 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-6111ef4e-642b-4847-b860-d029bbe37fce None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:34:53.866289 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 190/377] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Jun 22 08:34:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 22 08:34:53.867182 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a20444-231b-4068-befb-aaf5e4992668 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:53.868005 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-6111ef4e-642b-4847-b860-d029bbe37fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:34:53.882652 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:53.967811 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 188/378] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:34:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:34:53.969138 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6111ef4e-642b-4847-b860-d029bbe37fce None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:53.991943 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a20444-231b-4068-befb-aaf5e4992668 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:54.026388 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:54.041359 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ab86e-bb16-4e65-86f2-697cbb624261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:54.042405 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ab86e-bb16-4e65-86f2-697cbb624261 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:54.042855 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ab86e-bb16-4e65-86f2-697cbb624261 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:54.043294 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ab86e-bb16-4e65-86f2-697cbb624261 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:54.044363 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070ab86e-bb16-4e65-86f2-697cbb624261 None admin] RBAC: Adding query filter params (group.id=5405b78cebff4a2096483c4afbfa37e1, role.id=a92b520fb33f4333aad569d98be2bd7e, scope.project.id=adfd1b153ab54652bb25b1b4a02bae1d) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:54.044867 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070ab86e-bb16-4e65-86f2-697cbb624261 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:54.046672 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070ab86e-bb16-4e65-86f2-697cbb624261 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:54.055209 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 191/379] 10.222.0.42 () {56 vars in 1376 bytes} [Wed Jun 22 08:34:53 2022] GET /identity/v3/role_assignments?group.id=5405b78cebff4a2096483c4afbfa37e1&scope.project.id=adfd1b153ab54652bb25b1b4a02bae1d&role.id=a92b520fb33f4333aad569d98be2bd7e => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:54.056382 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ab86e-bb16-4e65-86f2-697cbb624261 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:54.106387 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6111ef4e-642b-4847-b860-d029bbe37fce None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:54.163273 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f9fa15-69b2-450c-befa-e4510b5a65e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:54.165350 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9fa15-69b2-450c-befa-e4510b5a65e0 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:54.166110 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9fa15-69b2-450c-befa-e4510b5a65e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:54.166875 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9fa15-69b2-450c-befa-e4510b5a65e0 None admin] PATH_INFO: `/v3/projects/272f01980f584e4888194eeac35f8209` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:54.169330 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f9fa15-69b2-450c-befa-e4510b5a65e0 None admin] RBAC: Authorizing `identity:get_project(project_id=272f01980f584e4888194eeac35f8209)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:54.174469 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f9fa15-69b2-450c-befa-e4510b5a65e0 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:54.174469 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 189/380] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Jun 22 08:34:53 2022] GET /identity/v3/projects/272f01980f584e4888194eeac35f8209 => generated 344 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:54.180189 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f9fa15-69b2-450c-befa-e4510b5a65e0 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:54.215394 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:54.229257 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ab86e-bb16-4e65-86f2-697cbb624261 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:54.306619 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac093eb1-9e86-4703-95ef-b1eeeebbc00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:54.308827 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac093eb1-9e86-4703-95ef-b1eeeebbc00d None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:54.309479 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac093eb1-9e86-4703-95ef-b1eeeebbc00d None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:54.309978 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac093eb1-9e86-4703-95ef-b1eeeebbc00d None admin] PATH_INFO: `/v3/roles/member` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:54.326900 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac093eb1-9e86-4703-95ef-b1eeeebbc00d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:34:54.339507 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-ac093eb1-9e86-4703-95ef-b1eeeebbc00d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:34:54.339507 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:34:54.339507 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:34:54.339507 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:34:54.339507 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:34:54.339507 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:34:54.339507 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:34:54.339507 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:34:54.339507 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:34:54.339507 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:34:54.339507 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:34:54.339507 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:34:54.339507 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:34:54.339507 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:34:54.339507 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:34:54.339507 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:34:54.340625 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:34:54.340625 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:34:54.340625 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:34:54.340625 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:34:54.340625 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:34:54.340625 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:34:54.340625 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:34:54.340625 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:34:54.340625 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:34:54.340625 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:34:54.340625 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:34:54.340625 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:34:54.340625 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:34:54.340625 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:34:54.340625 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:34:54.340625 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:34:54.341601 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:34:54.341601 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:34:54.341601 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:34:54.341601 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:34:54.341601 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:34:54.341601 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:34:54.341601 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:34:54.341601 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:34:54.341601 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:34:54.341601 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:34:54.341601 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:34:54.341601 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:34:54.345126 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 192/381] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Jun 22 08:34:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:34:54.352035 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac093eb1-9e86-4703-95ef-b1eeeebbc00d None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:54.388427 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f9fa15-69b2-450c-befa-e4510b5a65e0 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:54.422460 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:54.467753 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314972ef-df21-4560-8f3c-64cbef8572ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:54.468639 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314972ef-df21-4560-8f3c-64cbef8572ac None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:54.468923 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314972ef-df21-4560-8f3c-64cbef8572ac None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:54.469201 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314972ef-df21-4560-8f3c-64cbef8572ac None admin] PATH_INFO: `/v3/groups/c0a02128e2164122b27fa4674b070ce8` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:54.482802 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314972ef-df21-4560-8f3c-64cbef8572ac None admin] RBAC: Authorizing `identity:get_group(group_id=c0a02128e2164122b27fa4674b070ce8)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:54.484268 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314972ef-df21-4560-8f3c-64cbef8572ac None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:54.486373 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 190/382] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Jun 22 08:34:54 2022] GET /identity/v3/groups/c0a02128e2164122b27fa4674b070ce8 => generated 229 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:54.490912 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac093eb1-9e86-4703-95ef-b1eeeebbc00d None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:54.492644 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314972ef-df21-4560-8f3c-64cbef8572ac None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:54.532086 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da971e43-421e-4902-8838-71672ddf7920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:54.533208 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da971e43-421e-4902-8838-71672ddf7920 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:54.533686 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da971e43-421e-4902-8838-71672ddf7920 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:54.534814 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da971e43-421e-4902-8838-71672ddf7920 None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:54.535801 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da971e43-421e-4902-8838-71672ddf7920 None admin] RBAC: Adding query filter params (name=member) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:54.536296 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da971e43-421e-4902-8838-71672ddf7920 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:54.538140 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da971e43-421e-4902-8838-71672ddf7920 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:54.547834 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 193/383] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Jun 22 08:34:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:34:54.554759 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da971e43-421e-4902-8838-71672ddf7920 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:54.600851 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:54.623496 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314972ef-df21-4560-8f3c-64cbef8572ac None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:54.665928 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5dad61-cc1b-4bfd-867d-b63b177ecb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:54.666747 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5dad61-cc1b-4bfd-867d-b63b177ecb91 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:54.667033 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5dad61-cc1b-4bfd-867d-b63b177ecb91 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:54.667312 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5dad61-cc1b-4bfd-867d-b63b177ecb91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:54.668162 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5dad61-cc1b-4bfd-867d-b63b177ecb91 None admin] RBAC: Adding query filter params (group.id=c0a02128e2164122b27fa4674b070ce8, role.id=c7518e0f532945af80c33860f2ac506d, scope.project.id=272f01980f584e4888194eeac35f8209) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:54.668466 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5dad61-cc1b-4bfd-867d-b63b177ecb91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:54.669929 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5dad61-cc1b-4bfd-867d-b63b177ecb91 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:54.676889 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 191/384] 10.222.0.42 () {56 vars in 1376 bytes} [Wed Jun 22 08:34:54 2022] GET /identity/v3/role_assignments?group.id=c0a02128e2164122b27fa4674b070ce8&scope.project.id=272f01980f584e4888194eeac35f8209&role.id=c7518e0f532945af80c33860f2ac506d => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:34:54.694732 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da971e43-421e-4902-8838-71672ddf7920 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:54.708434 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:54.739496 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c9d65a-c151-4667-ab62-2841733b69a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:54.740774 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9d65a-c151-4667-ab62-2841733b69a5 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:54.741275 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9d65a-c151-4667-ab62-2841733b69a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:54.741757 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9d65a-c151-4667-ab62-2841733b69a5 None admin] PATH_INFO: `/v3/groups/5405b78cebff4a2096483c4afbfa37e1` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:54.744795 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c9d65a-c151-4667-ab62-2841733b69a5 None admin] RBAC: Authorizing `identity:get_group(group_id=5405b78cebff4a2096483c4afbfa37e1)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:54.747213 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c9d65a-c151-4667-ab62-2841733b69a5 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:54.751433 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 194/385] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Jun 22 08:34:54 2022] GET /identity/v3/groups/5405b78cebff4a2096483c4afbfa37e1 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:54.764070 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5dad61-cc1b-4bfd-867d-b63b177ecb91 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:54.903459 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5dad61-cc1b-4bfd-867d-b63b177ecb91 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:54.951765 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a514dd6-f310-4804-8b83-2f0026586262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:54.952652 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a514dd6-f310-4804-8b83-2f0026586262 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:54.952939 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a514dd6-f310-4804-8b83-2f0026586262 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:54.953263 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a514dd6-f310-4804-8b83-2f0026586262 None admin] PATH_INFO: `/v3/projects/68c923ae1ea74d589e86978e4dd415c2` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:54.954606 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a514dd6-f310-4804-8b83-2f0026586262 None admin] RBAC: Authorizing `identity:get_project(project_id=68c923ae1ea74d589e86978e4dd415c2)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:54.956714 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a514dd6-f310-4804-8b83-2f0026586262 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:54.958818 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 192/386] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Jun 22 08:34:54 2022] GET /identity/v3/projects/68c923ae1ea74d589e86978e4dd415c2 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:54.964659 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c9d65a-c151-4667-ab62-2841733b69a5 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:55.103742 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c9d65a-c151-4667-ab62-2841733b69a5 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:55.141569 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e991fd0-2130-4fe5-9e82-99e515d377a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:55.142557 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e991fd0-2130-4fe5-9e82-99e515d377a7 None admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:55.142846 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e991fd0-2130-4fe5-9e82-99e515d377a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:55.143131 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e991fd0-2130-4fe5-9e82-99e515d377a7 None admin] PATH_INFO: `/v3/projects/68c923ae1ea74d589e86978e4dd415c2/groups/5405b78cebff4a2096483c4afbfa37e1/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:55.146168 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e991fd0-2130-4fe5-9e82-99e515d377a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=68c923ae1ea74d589e86978e4dd415c2, group_id=5405b78cebff4a2096483c4afbfa37e1, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:55.147628 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e991fd0-2130-4fe5-9e82-99e515d377a7 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:55.164074 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 195/387] 10.222.0.42 () {58 vars in 1442 bytes} [Wed Jun 22 08:34:54 2022] PUT /identity/v3/projects/68c923ae1ea74d589e86978e4dd415c2/groups/5405b78cebff4a2096483c4afbfa37e1/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:34:55.618933 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b16523b-b4f5-45c2-ac7d-ab9d98f93edb None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:55.619416 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b16523b-b4f5-45c2-ac7d-ab9d98f93edb None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:55.619844 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b16523b-b4f5-45c2-ac7d-ab9d98f93edb None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:55.622853 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 193/388] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:34:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:34:55.629793 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb894b-6f13-4790-966e-3e0ed5842372 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:55.630515 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb894b-6f13-4790-966e-3e0ed5842372 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:55.631032 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb894b-6f13-4790-966e-3e0ed5842372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:55.676584 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-e8cb894b-6f13-4790-966e-3e0ed5842372 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:34:55.678845 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-e8cb894b-6f13-4790-966e-3e0ed5842372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:34:55.748302 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:55.838427 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 196/389] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:34:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:34:55.873146 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b16523b-b4f5-45c2-ac7d-ab9d98f93edb None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:55.901666 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:56.054486 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b16523b-b4f5-45c2-ac7d-ab9d98f93edb None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:56.097520 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd86f71f-2e0d-4cba-8fa2-7cf39c0b1f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:56.098485 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86f71f-2e0d-4cba-8fa2-7cf39c0b1f95 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:56.098768 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86f71f-2e0d-4cba-8fa2-7cf39c0b1f95 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:56.099044 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86f71f-2e0d-4cba-8fa2-7cf39c0b1f95 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:56.112819 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd86f71f-2e0d-4cba-8fa2-7cf39c0b1f95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:34:56.121390 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-dd86f71f-2e0d-4cba-8fa2-7cf39c0b1f95 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:34:56.121390 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:34:56.121390 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:34:56.121390 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:34:56.121390 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:34:56.121390 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:34:56.121390 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:34:56.121390 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:34:56.121390 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:34:56.121390 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:34:56.121390 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:34:56.121390 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:34:56.121390 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:34:56.121390 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:34:56.121390 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:34:56.121390 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:34:56.122412 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:34:56.122412 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:34:56.122412 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:34:56.122412 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:34:56.122412 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:34:56.122412 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:34:56.122412 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:34:56.122412 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:34:56.122412 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:34:56.122412 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:34:56.122412 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:34:56.122412 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:34:56.122412 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:34:56.122412 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:34:56.122412 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:34:56.122412 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:34:56.123326 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:34:56.123326 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:34:56.123326 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:34:56.123326 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:34:56.123326 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:34:56.123326 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:34:56.123326 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:34:56.123326 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:34:56.123326 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:34:56.123326 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:34:56.123326 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:34:56.123326 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:34:56.123326 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 194/390] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Jun 22 08:34:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:34:56.134031 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb894b-6f13-4790-966e-3e0ed5842372 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:56.142917 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b48cf3-515d-4d78-8a84-d2c5b81da614 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:56.142917 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b48cf3-515d-4d78-8a84-d2c5b81da614 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:56.143171 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b48cf3-515d-4d78-8a84-d2c5b81da614 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:56.147669 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 195/391] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:34:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:34:56.150944 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc447dc-902f-408e-b21c-147e7d03d756 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:56.151232 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc447dc-902f-408e-b21c-147e7d03d756 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:56.151511 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc447dc-902f-408e-b21c-147e7d03d756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:56.178917 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-8dc447dc-902f-408e-b21c-147e7d03d756 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:34:56.180129 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-8dc447dc-902f-408e-b21c-147e7d03d756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:34:56.281199 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:56.289377 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 196/392] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:34:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:34:56.342951 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb894b-6f13-4790-966e-3e0ed5842372 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:56.361978 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc447dc-902f-408e-b21c-147e7d03d756 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:56.440110 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0caa2-d1a6-4b13-b4c6-5c35a1cea890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:56.441404 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0caa2-d1a6-4b13-b4c6-5c35a1cea890 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:56.441747 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0caa2-d1a6-4b13-b4c6-5c35a1cea890 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:56.442161 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0caa2-d1a6-4b13-b4c6-5c35a1cea890 None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:56.443027 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a0caa2-d1a6-4b13-b4c6-5c35a1cea890 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:56.443348 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a0caa2-d1a6-4b13-b4c6-5c35a1cea890 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:56.444746 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a0caa2-d1a6-4b13-b4c6-5c35a1cea890 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:56.461315 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 197/393] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Jun 22 08:34:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:56.467024 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0caa2-d1a6-4b13-b4c6-5c35a1cea890 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:56.498728 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc447dc-902f-408e-b21c-147e7d03d756 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:56.503481 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:56.537432 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6195587d-e1ed-498d-b617-f16a4d39e1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:56.538359 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6195587d-e1ed-498d-b617-f16a4d39e1b8 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:56.538645 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6195587d-e1ed-498d-b617-f16a4d39e1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:56.538967 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6195587d-e1ed-498d-b617-f16a4d39e1b8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:56.550629 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6195587d-e1ed-498d-b617-f16a4d39e1b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:34:56.558951 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-6195587d-e1ed-498d-b617-f16a4d39e1b8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:34:56.558951 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:34:56.558951 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:34:56.558951 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:34:56.558951 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:34:56.558951 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:34:56.558951 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:34:56.558951 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:34:56.558951 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:34:56.558951 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:34:56.558951 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:34:56.558951 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:34:56.558951 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:34:56.558951 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:34:56.558951 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:34:56.558951 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:34:56.559858 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:34:56.559858 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:34:56.559858 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:34:56.559858 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:34:56.559858 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:34:56.559858 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:34:56.559858 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:34:56.559858 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:34:56.559858 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:34:56.559858 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:34:56.559858 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:34:56.559858 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:34:56.559858 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:34:56.559858 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:34:56.559858 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:34:56.559858 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:34:56.560625 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:34:56.560625 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:34:56.560625 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:34:56.560625 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:34:56.560625 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:34:56.560625 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:34:56.560625 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:34:56.560625 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:34:56.560625 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:34:56.560625 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:34:56.560625 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:34:56.560625 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:34:56.564613 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 197/394] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Jun 22 08:34:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:34:56.567188 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6195587d-e1ed-498d-b617-f16a4d39e1b8 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:56.590354 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0caa2-d1a6-4b13-b4c6-5c35a1cea890 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:56.626151 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0511a-2da9-42d0-8fda-0d43a2b4deda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:56.627442 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0511a-2da9-42d0-8fda-0d43a2b4deda None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:56.628543 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0511a-2da9-42d0-8fda-0d43a2b4deda None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:56.629048 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0511a-2da9-42d0-8fda-0d43a2b4deda None admin] PATH_INFO: `/v3/groups/5405b78cebff4a2096483c4afbfa37e1` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:56.630555 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c0511a-2da9-42d0-8fda-0d43a2b4deda None admin] RBAC: Authorizing `identity:get_group(group_id=5405b78cebff4a2096483c4afbfa37e1)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:56.632671 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c0511a-2da9-42d0-8fda-0d43a2b4deda None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:56.634648 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 198/395] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Jun 22 08:34:56 2022] GET /identity/v3/groups/5405b78cebff4a2096483c4afbfa37e1 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:34:56.635382 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:56.645459 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0511a-2da9-42d0-8fda-0d43a2b4deda None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:56.674138 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6195587d-e1ed-498d-b617-f16a4d39e1b8 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:56.719022 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be3e1f1-84ef-42b3-82b7-fc25e8c0ec9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:56.719619 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3e1f1-84ef-42b3-82b7-fc25e8c0ec9f None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:56.719906 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3e1f1-84ef-42b3-82b7-fc25e8c0ec9f None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:56.720188 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3e1f1-84ef-42b3-82b7-fc25e8c0ec9f None admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:56.720943 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be3e1f1-84ef-42b3-82b7-fc25e8c0ec9f None admin] RBAC: Adding query filter params (name=member) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:56.721294 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be3e1f1-84ef-42b3-82b7-fc25e8c0ec9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:56.723369 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be3e1f1-84ef-42b3-82b7-fc25e8c0ec9f None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:56.737801 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 198/396] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Jun 22 08:34:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:56.739080 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be3e1f1-84ef-42b3-82b7-fc25e8c0ec9f None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:56.770644 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:56.780525 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0511a-2da9-42d0-8fda-0d43a2b4deda None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:56.844111 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be3e1f1-84ef-42b3-82b7-fc25e8c0ec9f None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:56.847504 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a5198-6741-47cf-b286-c09f301b38bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:56.848587 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a5198-6741-47cf-b286-c09f301b38bf None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:56.849143 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a5198-6741-47cf-b286-c09f301b38bf None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:56.849614 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a5198-6741-47cf-b286-c09f301b38bf None admin] PATH_INFO: `/v3/projects/68c923ae1ea74d589e86978e4dd415c2` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:56.853344 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5a5198-6741-47cf-b286-c09f301b38bf None admin] RBAC: Authorizing `identity:get_project(project_id=68c923ae1ea74d589e86978e4dd415c2)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:56.855203 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5a5198-6741-47cf-b286-c09f301b38bf None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:56.857598 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 199/397] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Jun 22 08:34:56 2022] GET /identity/v3/projects/68c923ae1ea74d589e86978e4dd415c2 => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:56.863383 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a5198-6741-47cf-b286-c09f301b38bf None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:56.870416 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:56.882435 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f097d-3272-404e-b0f9-7997e4258f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:56.883425 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f097d-3272-404e-b0f9-7997e4258f62 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:56.883783 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f097d-3272-404e-b0f9-7997e4258f62 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:56.884130 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f097d-3272-404e-b0f9-7997e4258f62 None admin] PATH_INFO: `/v3/groups/5405b78cebff4a2096483c4afbfa37e1` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:56.885694 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1f097d-3272-404e-b0f9-7997e4258f62 None admin] RBAC: Authorizing `identity:get_group(group_id=5405b78cebff4a2096483c4afbfa37e1)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:56.886962 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1f097d-3272-404e-b0f9-7997e4258f62 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:56.898121 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 199/398] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Jun 22 08:34:56 2022] GET /identity/v3/groups/5405b78cebff4a2096483c4afbfa37e1 => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:56.898121 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f097d-3272-404e-b0f9-7997e4258f62 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:57.018219 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f097d-3272-404e-b0f9-7997e4258f62 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:57.021339 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a5198-6741-47cf-b286-c09f301b38bf None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:57.060277 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34adcd88-43a0-4656-afe3-0ac1640fabec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:57.061181 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34adcd88-43a0-4656-afe3-0ac1640fabec None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:57.061468 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34adcd88-43a0-4656-afe3-0ac1640fabec None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:57.061751 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34adcd88-43a0-4656-afe3-0ac1640fabec None admin] PATH_INFO: `/v3/projects/adfd1b153ab54652bb25b1b4a02bae1d` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:57.063510 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34adcd88-43a0-4656-afe3-0ac1640fabec None admin] RBAC: Authorizing `identity:get_project(project_id=adfd1b153ab54652bb25b1b4a02bae1d)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:57.065454 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34adcd88-43a0-4656-afe3-0ac1640fabec None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:57.070145 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 200/399] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Jun 22 08:34:56 2022] GET /identity/v3/projects/adfd1b153ab54652bb25b1b4a02bae1d => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:34:57.071768 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508cb8bf-0965-4786-b5a9-d2dc4e055e8a None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:57.072295 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508cb8bf-0965-4786-b5a9-d2dc4e055e8a None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:57.072805 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508cb8bf-0965-4786-b5a9-d2dc4e055e8a None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:57.074755 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 201/400] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:34:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:34:57.075591 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe997263-5025-453f-9e93-2aad53fc49e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:57.075883 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508cb8bf-0965-4786-b5a9-d2dc4e055e8a None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:57.076576 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe997263-5025-453f-9e93-2aad53fc49e7 None admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:57.076868 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe997263-5025-453f-9e93-2aad53fc49e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:57.077145 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe997263-5025-453f-9e93-2aad53fc49e7 None admin] PATH_INFO: `/v3/projects/68c923ae1ea74d589e86978e4dd415c2/groups/5405b78cebff4a2096483c4afbfa37e1/roles/a92b520fb33f4333aad569d98be2bd7e` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:57.079456 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe997263-5025-453f-9e93-2aad53fc49e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=68c923ae1ea74d589e86978e4dd415c2, group_id=5405b78cebff4a2096483c4afbfa37e1, role_id=a92b520fb33f4333aad569d98be2bd7e)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:57.082720 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe997263-5025-453f-9e93-2aad53fc49e7 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:57.102521 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 200/401] 10.222.0.42 () {58 vars in 1442 bytes} [Wed Jun 22 08:34:56 2022] PUT /identity/v3/projects/68c923ae1ea74d589e86978e4dd415c2/groups/5405b78cebff4a2096483c4afbfa37e1/roles/a92b520fb33f4333aad569d98be2bd7e => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:34:57.104754 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c54f7d-b816-4cff-a7ce-0c718586db5e None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:57.105359 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c54f7d-b816-4cff-a7ce-0c718586db5e None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:57.105892 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c54f7d-b816-4cff-a7ce-0c718586db5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:57.132462 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-84c54f7d-b816-4cff-a7ce-0c718586db5e None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:34:57.134782 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-84c54f7d-b816-4cff-a7ce-0c718586db5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:34:57.156071 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:57.170523 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:57.224558 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508cb8bf-0965-4786-b5a9-d2dc4e055e8a None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:57.229953 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 201/402] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:34:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:34:57.264116 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c54f7d-b816-4cff-a7ce-0c718586db5e None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:57.265204 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c3ff8-d9db-4a99-b6ff-c0abaf7c12cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:57.266750 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c3ff8-d9db-4a99-b6ff-c0abaf7c12cd None admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:57.267181 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c3ff8-d9db-4a99-b6ff-c0abaf7c12cd None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:57.267593 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c3ff8-d9db-4a99-b6ff-c0abaf7c12cd None admin] PATH_INFO: `/v3/projects/adfd1b153ab54652bb25b1b4a02bae1d/groups/5405b78cebff4a2096483c4afbfa37e1/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:57.271943 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40c3ff8-d9db-4a99-b6ff-c0abaf7c12cd None admin] RBAC: Authorizing `identity:create_grant(project_id=adfd1b153ab54652bb25b1b4a02bae1d, group_id=5405b78cebff4a2096483c4afbfa37e1, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:57.273661 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40c3ff8-d9db-4a99-b6ff-c0abaf7c12cd None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:57.298699 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 202/403] 10.222.0.42 () {58 vars in 1442 bytes} [Wed Jun 22 08:34:57 2022] PUT /identity/v3/projects/adfd1b153ab54652bb25b1b4a02bae1d/groups/5405b78cebff4a2096483c4afbfa37e1/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:34:57.407719 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c54f7d-b816-4cff-a7ce-0c718586db5e None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:57.449404 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6affa5e7-729c-4ff7-8d8d-e2d92923982b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:57.450627 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6affa5e7-729c-4ff7-8d8d-e2d92923982b None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:57.451095 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6affa5e7-729c-4ff7-8d8d-e2d92923982b None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:57.451563 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6affa5e7-729c-4ff7-8d8d-e2d92923982b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:57.465625 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6affa5e7-729c-4ff7-8d8d-e2d92923982b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:34:57.475420 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-6affa5e7-729c-4ff7-8d8d-e2d92923982b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:34:57.475420 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:34:57.475420 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:34:57.475420 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:34:57.475420 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:34:57.475420 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:34:57.475420 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:34:57.475420 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:34:57.475420 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:34:57.475420 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:34:57.475420 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:34:57.475420 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:34:57.475420 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:34:57.475420 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:34:57.475420 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:34:57.475420 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:34:57.476414 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:34:57.476414 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:34:57.476414 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:34:57.476414 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:34:57.476414 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:34:57.476414 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:34:57.476414 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:34:57.476414 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:34:57.476414 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:34:57.476414 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:34:57.476414 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:34:57.476414 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:34:57.476414 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:34:57.476414 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:34:57.476414 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:34:57.476414 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:34:57.477276 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:34:57.477276 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:34:57.477276 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:34:57.477276 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:34:57.477276 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:34:57.477276 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:34:57.477276 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:34:57.477276 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:34:57.477276 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:34:57.477276 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:34:57.477276 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:34:57.477276 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:34:57.479878 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 202/404] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Jun 22 08:34:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:34:57.485837 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c3ff8-d9db-4a99-b6ff-c0abaf7c12cd None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:57.598027 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c3ff8-d9db-4a99-b6ff-c0abaf7c12cd None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:57.616297 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:57.638908 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ec374-f134-49a8-a2f8-52f405e8c164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:57.639906 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ec374-f134-49a8-a2f8-52f405e8c164 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:57.640481 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ec374-f134-49a8-a2f8-52f405e8c164 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:57.640772 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ec374-f134-49a8-a2f8-52f405e8c164 None admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:57.641551 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ec374-f134-49a8-a2f8-52f405e8c164 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:57.641870 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ec374-f134-49a8-a2f8-52f405e8c164 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:57.643858 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ec374-f134-49a8-a2f8-52f405e8c164 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:57.653488 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 203/405] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Jun 22 08:34:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:34:57.658783 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6affa5e7-729c-4ff7-8d8d-e2d92923982b None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:57.683808 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd8490-69d4-46cd-b25a-316619e89735 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:57.683808 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd8490-69d4-46cd-b25a-316619e89735 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:57.683808 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd8490-69d4-46cd-b25a-316619e89735 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:57.683808 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 204/406] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:34:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:34:57.691154 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:57.694512 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0dd59-bedd-46ab-90d2-4b4b111ed37a None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:57.694803 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0dd59-bedd-46ab-90d2-4b4b111ed37a None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:57.695088 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0dd59-bedd-46ab-90d2-4b4b111ed37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:57.722700 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-96e0dd59-bedd-46ab-90d2-4b4b111ed37a None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:34:57.723919 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-96e0dd59-bedd-46ab-90d2-4b4b111ed37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:34:57.864630 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 205/407] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:34:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:34:57.871905 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6affa5e7-729c-4ff7-8d8d-e2d92923982b None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:57.891973 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e0dd59-bedd-46ab-90d2-4b4b111ed37a None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:57.911586 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee2713-ca9b-4c94-9d80-73be2e0f0881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:57.916347 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee2713-ca9b-4c94-9d80-73be2e0f0881 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:57.916347 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee2713-ca9b-4c94-9d80-73be2e0f0881 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:57.916347 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee2713-ca9b-4c94-9d80-73be2e0f0881 None admin] PATH_INFO: `/v3/groups/5405b78cebff4a2096483c4afbfa37e1` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:57.916347 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdee2713-ca9b-4c94-9d80-73be2e0f0881 None admin] RBAC: Authorizing `identity:get_group(group_id=5405b78cebff4a2096483c4afbfa37e1)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:57.916347 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdee2713-ca9b-4c94-9d80-73be2e0f0881 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:57.917762 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 203/408] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Jun 22 08:34:57 2022] GET /identity/v3/groups/5405b78cebff4a2096483c4afbfa37e1 => generated 226 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:57.923158 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee2713-ca9b-4c94-9d80-73be2e0f0881 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:58.080933 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:58.090121 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e0dd59-bedd-46ab-90d2-4b4b111ed37a None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:58.116370 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:58.128790 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee2713-ca9b-4c94-9d80-73be2e0f0881 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:58.130168 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3862249-7799-4287-8a4c-8f64c141ff41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:58.131284 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3862249-7799-4287-8a4c-8f64c141ff41 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:58.131832 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3862249-7799-4287-8a4c-8f64c141ff41 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:58.132122 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3862249-7799-4287-8a4c-8f64c141ff41 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:58.144252 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3862249-7799-4287-8a4c-8f64c141ff41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:34:58.152637 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-e3862249-7799-4287-8a4c-8f64c141ff41 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:34:58.152637 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:34:58.152637 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:34:58.152637 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:34:58.152637 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:34:58.152637 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:34:58.152637 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:34:58.152637 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:34:58.152637 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:34:58.152637 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:34:58.152637 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:34:58.152637 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:34:58.152637 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:34:58.152637 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:34:58.152637 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:34:58.152637 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:34:58.153543 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:34:58.153543 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:34:58.153543 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:34:58.153543 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:34:58.153543 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:34:58.153543 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:34:58.153543 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:34:58.153543 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:34:58.153543 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:34:58.153543 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:34:58.153543 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:34:58.153543 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:34:58.153543 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:34:58.153543 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:34:58.153543 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:34:58.153543 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:34:58.154352 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:34:58.154352 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:34:58.154352 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:34:58.154352 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:34:58.154352 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:34:58.154352 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:34:58.154352 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:34:58.154352 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:34:58.154352 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:34:58.154352 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:34:58.154352 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:34:58.154352 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:34:58.154352 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 206/409] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Jun 22 08:34:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:34:58.164091 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3862249-7799-4287-8a4c-8f64c141ff41 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:58.209312 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab76e7f5-cda1-49a4-bfd3-e9c90a84c42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:58.210209 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76e7f5-cda1-49a4-bfd3-e9c90a84c42b None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:58.210497 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76e7f5-cda1-49a4-bfd3-e9c90a84c42b None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:58.210833 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76e7f5-cda1-49a4-bfd3-e9c90a84c42b None admin] PATH_INFO: `/v3/projects/adfd1b153ab54652bb25b1b4a02bae1d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:58.212464 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab76e7f5-cda1-49a4-bfd3-e9c90a84c42b None admin] RBAC: Authorizing `identity:get_project(project_id=adfd1b153ab54652bb25b1b4a02bae1d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:58.214758 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab76e7f5-cda1-49a4-bfd3-e9c90a84c42b None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:58.216497 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 204/410] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Jun 22 08:34:57 2022] GET /identity/v3/projects/adfd1b153ab54652bb25b1b4a02bae1d => generated 302 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:58.223024 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab76e7f5-cda1-49a4-bfd3-e9c90a84c42b None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:58.369442 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab76e7f5-cda1-49a4-bfd3-e9c90a84c42b None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:58.400914 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3862249-7799-4287-8a4c-8f64c141ff41 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:58.417467 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ac168d-8e64-48e7-ab7e-5b024201ddfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:58.418397 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac168d-8e64-48e7-ab7e-5b024201ddfa None admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:58.418685 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac168d-8e64-48e7-ab7e-5b024201ddfa None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:58.418962 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac168d-8e64-48e7-ab7e-5b024201ddfa None admin] PATH_INFO: `/v3/projects/adfd1b153ab54652bb25b1b4a02bae1d/groups/5405b78cebff4a2096483c4afbfa37e1/roles/a92b520fb33f4333aad569d98be2bd7e` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:58.423407 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ac168d-8e64-48e7-ab7e-5b024201ddfa None admin] RBAC: Authorizing `identity:create_grant(project_id=adfd1b153ab54652bb25b1b4a02bae1d, group_id=5405b78cebff4a2096483c4afbfa37e1, role_id=a92b520fb33f4333aad569d98be2bd7e)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:58.424973 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ac168d-8e64-48e7-ab7e-5b024201ddfa None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:58.449564 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 205/411] 10.222.0.42 () {58 vars in 1442 bytes} [Wed Jun 22 08:34:58 2022] PUT /identity/v3/projects/adfd1b153ab54652bb25b1b4a02bae1d/groups/5405b78cebff4a2096483c4afbfa37e1/roles/a92b520fb33f4333aad569d98be2bd7e => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:34:58.451655 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2418b-343f-4e33-8dd4-84a02b93afcd None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:58.451970 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2418b-343f-4e33-8dd4-84a02b93afcd None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:58.453078 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2418b-343f-4e33-8dd4-84a02b93afcd None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:58.455352 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 206/412] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:34:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:34:58.464172 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ad815-09ef-4dd5-b26d-471228316ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:58.464906 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ad815-09ef-4dd5-b26d-471228316ae6 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:58.465196 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ad815-09ef-4dd5-b26d-471228316ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:58.465528 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ad815-09ef-4dd5-b26d-471228316ae6 None admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:58.466327 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129ad815-09ef-4dd5-b26d-471228316ae6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:58.466641 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129ad815-09ef-4dd5-b26d-471228316ae6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:58.468187 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129ad815-09ef-4dd5-b26d-471228316ae6 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:58.471260 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba810ef-df6e-42d0-ab64-3471ecd806b6 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:58.472178 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba810ef-df6e-42d0-ab64-3471ecd806b6 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:58.472466 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba810ef-df6e-42d0-ab64-3471ecd806b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:58.494902 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 207/413] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Jun 22 08:34:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:34:58.494902 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ad815-09ef-4dd5-b26d-471228316ae6 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:58.507566 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-aba810ef-df6e-42d0-ab64-3471ecd806b6 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:34:58.510102 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-aba810ef-df6e-42d0-ab64-3471ecd806b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:34:58.530336 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:58.574522 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:58.656364 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 207/414] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:34:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:34:58.657695 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ad815-09ef-4dd5-b26d-471228316ae6 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:58.689164 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba810ef-df6e-42d0-ab64-3471ecd806b6 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:58.706624 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27907844-10d5-4ffa-aeab-3e6754cd964b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:58.707580 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27907844-10d5-4ffa-aeab-3e6754cd964b None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:58.707872 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27907844-10d5-4ffa-aeab-3e6754cd964b None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:58.708148 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27907844-10d5-4ffa-aeab-3e6754cd964b None admin] PATH_INFO: `/v3/groups/c0a02128e2164122b27fa4674b070ce8` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:58.709419 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27907844-10d5-4ffa-aeab-3e6754cd964b None admin] RBAC: Authorizing `identity:get_group(group_id=c0a02128e2164122b27fa4674b070ce8)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:58.711001 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27907844-10d5-4ffa-aeab-3e6754cd964b None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:58.713001 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 208/415] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Jun 22 08:34:58 2022] GET /identity/v3/groups/c0a02128e2164122b27fa4674b070ce8 => generated 229 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:58.718580 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27907844-10d5-4ffa-aeab-3e6754cd964b None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:58.893879 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:58.899492 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27907844-10d5-4ffa-aeab-3e6754cd964b None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:58.913096 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba810ef-df6e-42d0-ab64-3471ecd806b6 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:58.944591 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88aa74f-4e7b-4a54-bc03-748b72ae05cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:58.946057 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88aa74f-4e7b-4a54-bc03-748b72ae05cc None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:58.946370 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88aa74f-4e7b-4a54-bc03-748b72ae05cc None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:58.946802 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88aa74f-4e7b-4a54-bc03-748b72ae05cc None admin] PATH_INFO: `/v3/projects/272f01980f584e4888194eeac35f8209` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:58.948447 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88aa74f-4e7b-4a54-bc03-748b72ae05cc None admin] RBAC: Authorizing `identity:get_project(project_id=272f01980f584e4888194eeac35f8209)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:58.950629 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88aa74f-4e7b-4a54-bc03-748b72ae05cc None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:58.953593 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 209/416] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Jun 22 08:34:58 2022] GET /identity/v3/projects/272f01980f584e4888194eeac35f8209 => generated 344 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:58.963075 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88aa74f-4e7b-4a54-bc03-748b72ae05cc None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:58.967492 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a558a65-6b8f-4b84-bacc-194b02127dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:58.968325 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a558a65-6b8f-4b84-bacc-194b02127dff None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:58.968612 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a558a65-6b8f-4b84-bacc-194b02127dff None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:58.968891 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a558a65-6b8f-4b84-bacc-194b02127dff None admin] PATH_INFO: `/v3/roles/member` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:58.991372 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a558a65-6b8f-4b84-bacc-194b02127dff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:34:59.001168 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-0a558a65-6b8f-4b84-bacc-194b02127dff None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:34:59.001168 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:34:59.001168 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:34:59.001168 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:34:59.001168 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:34:59.001168 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:34:59.001168 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:34:59.001168 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:34:59.001168 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:34:59.001168 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:34:59.001168 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:34:59.001168 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:34:59.001168 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:34:59.001168 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:34:59.001168 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:34:59.001168 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:34:59.002063 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:34:59.002063 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:34:59.002063 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:34:59.002063 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:34:59.002063 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:34:59.002063 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:34:59.002063 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:34:59.002063 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:34:59.002063 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:34:59.002063 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:34:59.002063 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:34:59.002063 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:34:59.002063 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:34:59.002063 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:34:59.002063 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:34:59.002063 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:34:59.003562 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:34:59.003562 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:34:59.003562 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:34:59.003562 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:34:59.003562 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:34:59.003562 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:34:59.003562 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:34:59.003562 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:34:59.003562 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:34:59.003562 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:34:59.003562 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:34:59.003562 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:34:59.003562 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 208/417] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Jun 22 08:34:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:34:59.010701 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a558a65-6b8f-4b84-bacc-194b02127dff None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:59.015825 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:59.167402 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a558a65-6b8f-4b84-bacc-194b02127dff None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:59.188478 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88aa74f-4e7b-4a54-bc03-748b72ae05cc None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:59.229213 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831fad33-7848-4a57-a46e-bab6c373ef40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:59.230644 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831fad33-7848-4a57-a46e-bab6c373ef40 None admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:59.231934 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831fad33-7848-4a57-a46e-bab6c373ef40 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:59.233049 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831fad33-7848-4a57-a46e-bab6c373ef40 None admin] PATH_INFO: `/v3/projects/272f01980f584e4888194eeac35f8209/groups/c0a02128e2164122b27fa4674b070ce8/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:59.237850 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831fad33-7848-4a57-a46e-bab6c373ef40 None admin] RBAC: Authorizing `identity:create_grant(project_id=272f01980f584e4888194eeac35f8209, group_id=c0a02128e2164122b27fa4674b070ce8, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:59.240162 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831fad33-7848-4a57-a46e-bab6c373ef40 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:59.247513 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8320bdf8-75fa-4781-b991-133d2642b7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:59.248528 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320bdf8-75fa-4781-b991-133d2642b7d5 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:59.249036 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320bdf8-75fa-4781-b991-133d2642b7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:59.249535 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320bdf8-75fa-4781-b991-133d2642b7d5 None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:59.250540 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8320bdf8-75fa-4781-b991-133d2642b7d5 None admin] RBAC: Adding query filter params (name=member) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:34:59.252351 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8320bdf8-75fa-4781-b991-133d2642b7d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:59.254722 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8320bdf8-75fa-4781-b991-133d2642b7d5 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:59.270650 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 209/418] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Jun 22 08:34:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:59.279375 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 210/419] 10.222.0.42 () {58 vars in 1442 bytes} [Wed Jun 22 08:34:58 2022] PUT /identity/v3/projects/272f01980f584e4888194eeac35f8209/groups/c0a02128e2164122b27fa4674b070ce8/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:34:59.280883 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8320bdf8-75fa-4781-b991-133d2642b7d5 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:59.385537 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:59.446203 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8320bdf8-75fa-4781-b991-133d2642b7d5 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:59.485905 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0891338-65a3-47da-a4b4-d25c8e45262f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:59.486624 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0891338-65a3-47da-a4b4-d25c8e45262f None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:59.486906 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0891338-65a3-47da-a4b4-d25c8e45262f None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:59.487880 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0891338-65a3-47da-a4b4-d25c8e45262f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:59.572636 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0891338-65a3-47da-a4b4-d25c8e45262f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:59.574115 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0891338-65a3-47da-a4b4-d25c8e45262f None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:59.663236 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ed0fe-417e-400e-ba28-90781b2aa24e None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:59.663739 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ed0fe-417e-400e-ba28-90781b2aa24e None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:59.663813 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ed0fe-417e-400e-ba28-90781b2aa24e None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:59.664428 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:59.666015 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 211/420] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:34:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:34:59.671499 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1fbdb-f995-4ec0-852c-1ea234e4db9e None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:59.671792 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1fbdb-f995-4ec0-852c-1ea234e4db9e None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:59.672062 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1fbdb-f995-4ec0-852c-1ea234e4db9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:59.708618 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 210/421] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Jun 22 08:34:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 22 08:34:59.712622 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-62e1fbdb-f995-4ec0-852c-1ea234e4db9e None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:34:59.713911 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-62e1fbdb-f995-4ec0-852c-1ea234e4db9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:34:59.715083 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0891338-65a3-47da-a4b4-d25c8e45262f None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:59.779125 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:34:59.870405 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 212/422] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:34:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:34:59.891633 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0891338-65a3-47da-a4b4-d25c8e45262f None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:34:59.893991 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e1fbdb-f995-4ec0-852c-1ea234e4db9e None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:34:59.952628 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafbde65-1078-4855-b361-57e7a7ed92c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:34:59.953701 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafbde65-1078-4855-b361-57e7a7ed92c0 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:59.953992 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafbde65-1078-4855-b361-57e7a7ed92c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:59.954330 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafbde65-1078-4855-b361-57e7a7ed92c0 None admin] PATH_INFO: `/v3/projects/68c923ae1ea74d589e86978e4dd415c2` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:59.955745 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafbde65-1078-4855-b361-57e7a7ed92c0 None admin] RBAC: Authorizing `identity:get_project(project_id=68c923ae1ea74d589e86978e4dd415c2)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:34:59.957291 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafbde65-1078-4855-b361-57e7a7ed92c0 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:34:59.959587 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 211/423] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Jun 22 08:34:59 2022] GET /identity/v3/projects/68c923ae1ea74d589e86978e4dd415c2 => generated 298 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:34:59.960924 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2ffac-b104-4004-ab28-82b30177881e None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:34:59.961216 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2ffac-b104-4004-ab28-82b30177881e None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:34:59.961496 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2ffac-b104-4004-ab28-82b30177881e None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:34:59.963036 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 212/424] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:34:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:34:59.967812 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e2ffac-b104-4004-ab28-82b30177881e None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:00.006345 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:00.036992 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e1fbdb-f995-4ec0-852c-1ea234e4db9e None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:00.076447 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b4046-a84e-4906-a1f5-4d7dc6b86798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:00.077277 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b4046-a84e-4906-a1f5-4d7dc6b86798 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:00.077564 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b4046-a84e-4906-a1f5-4d7dc6b86798 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:00.077845 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b4046-a84e-4906-a1f5-4d7dc6b86798 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:00.091717 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3b4046-a84e-4906-a1f5-4d7dc6b86798 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:35:00.101298 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-2d3b4046-a84e-4906-a1f5-4d7dc6b86798 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:35:00.101298 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:00.101298 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:00.101298 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:00.101298 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:00.101298 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:00.101298 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:00.101298 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:00.101298 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:00.101298 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:00.101298 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:00.101298 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:00.101298 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:35:00.101298 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:35:00.101298 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:35:00.101298 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:35:00.102211 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:35:00.102211 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:35:00.102211 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:35:00.102211 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:35:00.102211 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:00.102211 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:00.102211 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:00.102211 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:00.102211 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:00.102211 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:00.102211 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:00.102211 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:00.102211 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:00.102211 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:00.102211 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:00.102211 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:00.102978 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:00.102978 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:00.102978 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:00.102978 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:00.102978 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:35:00.102978 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:35:00.102978 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:35:00.102978 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:35:00.102978 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:35:00.102978 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:35:00.102978 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:35:00.102978 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:00.107353 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 213/425] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Jun 22 08:34:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:00.108594 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8da41a-73d1-40fd-9752-3c856c9b50ca None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:00.108999 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8da41a-73d1-40fd-9752-3c856c9b50ca None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:00.109293 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8da41a-73d1-40fd-9752-3c856c9b50ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:00.111026 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e2ffac-b104-4004-ab28-82b30177881e None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:00.128709 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-3b8da41a-73d1-40fd-9752-3c856c9b50ca None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:35:00.130182 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-3b8da41a-73d1-40fd-9752-3c856c9b50ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:35:00.146909 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:00.150927 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b4ea18-46b6-4201-8798-70400b2f579e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:00.152079 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b4ea18-46b6-4201-8798-70400b2f579e None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:00.152526 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b4ea18-46b6-4201-8798-70400b2f579e None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:00.152947 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b4ea18-46b6-4201-8798-70400b2f579e None admin] PATH_INFO: `/v3/groups/5405b78cebff4a2096483c4afbfa37e1` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:00.154386 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b4ea18-46b6-4201-8798-70400b2f579e None admin] RBAC: Authorizing `identity:get_group(group_id=5405b78cebff4a2096483c4afbfa37e1)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:00.156120 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b4ea18-46b6-4201-8798-70400b2f579e None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:00.163692 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 213/426] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Jun 22 08:34:59 2022] GET /identity/v3/groups/5405b78cebff4a2096483c4afbfa37e1 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:00.165100 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b4ea18-46b6-4201-8798-70400b2f579e None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:00.218903 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 214/427] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:35:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:35:00.219748 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8da41a-73d1-40fd-9752-3c856c9b50ca None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:00.302672 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:00.305436 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b4ea18-46b6-4201-8798-70400b2f579e None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:00.336646 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8da41a-73d1-40fd-9752-3c856c9b50ca None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:00.342755 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a3ab2d-a167-4b7c-a910-5e7e8a3c866c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:00.343806 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3ab2d-a167-4b7c-a910-5e7e8a3c866c None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:00.343806 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3ab2d-a167-4b7c-a910-5e7e8a3c866c None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:00.343995 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3ab2d-a167-4b7c-a910-5e7e8a3c866c None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:00.344747 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a3ab2d-a167-4b7c-a910-5e7e8a3c866c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:00.345059 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a3ab2d-a167-4b7c-a910-5e7e8a3c866c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:00.347050 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a3ab2d-a167-4b7c-a910-5e7e8a3c866c None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:00.356369 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 214/428] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Jun 22 08:35:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:00.357248 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a3ab2d-a167-4b7c-a910-5e7e8a3c866c None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:00.383414 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d5c4eb-0e48-4e9e-899e-c1af934c3cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:00.384245 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d5c4eb-0e48-4e9e-899e-c1af934c3cf6 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:00.384538 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d5c4eb-0e48-4e9e-899e-c1af934c3cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:00.384921 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d5c4eb-0e48-4e9e-899e-c1af934c3cf6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:00.385771 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d5c4eb-0e48-4e9e-899e-c1af934c3cf6 None admin] RBAC: Adding query filter params (group.id=5405b78cebff4a2096483c4afbfa37e1, role.id=5ea101070f734fa59995615179f2eff2, scope.project.id=68c923ae1ea74d589e86978e4dd415c2) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:00.386113 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d5c4eb-0e48-4e9e-899e-c1af934c3cf6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:00.387715 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d5c4eb-0e48-4e9e-899e-c1af934c3cf6 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:00.396156 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 215/429] 10.222.0.42 () {56 vars in 1376 bytes} [Wed Jun 22 08:35:00 2022] GET /identity/v3/role_assignments?group.id=5405b78cebff4a2096483c4afbfa37e1&scope.project.id=68c923ae1ea74d589e86978e4dd415c2&role.id=5ea101070f734fa59995615179f2eff2 => generated 611 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:00.397152 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d5c4eb-0e48-4e9e-899e-c1af934c3cf6 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:00.416743 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:00.525467 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d5c4eb-0e48-4e9e-899e-c1af934c3cf6 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:00.566691 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af6477-5d35-47f4-b8d5-05de8acd6f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:00.567785 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af6477-5d35-47f4-b8d5-05de8acd6f5f None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:00.568237 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af6477-5d35-47f4-b8d5-05de8acd6f5f None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:00.568737 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af6477-5d35-47f4-b8d5-05de8acd6f5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:00.569545 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a3ab2d-a167-4b7c-a910-5e7e8a3c866c None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:00.658164 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5ce35-4fdc-4a45-949d-3ee0762d9d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:00.659727 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5ce35-4fdc-4a45-949d-3ee0762d9d49 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:00.661692 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5ce35-4fdc-4a45-949d-3ee0762d9d49 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:00.662126 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5ce35-4fdc-4a45-949d-3ee0762d9d49 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:00.663734 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9af6477-5d35-47f4-b8d5-05de8acd6f5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:00.666542 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9af6477-5d35-47f4-b8d5-05de8acd6f5f None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:00.674533 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc5ce35-4fdc-4a45-949d-3ee0762d9d49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:35:00.683555 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-7fc5ce35-4fdc-4a45-949d-3ee0762d9d49 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:35:00.683555 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:00.683555 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:00.683555 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:00.683555 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:00.683555 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:00.683555 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:00.683555 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:00.683555 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:00.683555 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:00.683555 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:00.683555 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:00.683555 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:35:00.683555 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:35:00.683555 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:35:00.683555 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:35:00.684709 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:35:00.684709 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:35:00.684709 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:35:00.684709 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:35:00.684709 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:00.684709 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:00.684709 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:00.684709 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:00.684709 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:00.684709 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:00.684709 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:00.684709 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:00.684709 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:00.684709 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:00.684709 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:00.684709 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:00.685694 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:00.685694 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:00.685694 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:00.685694 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:00.685694 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:35:00.685694 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:35:00.685694 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:35:00.685694 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:35:00.685694 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:35:00.685694 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:35:00.685694 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:35:00.685694 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:00.687390 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:00.688149 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 215/430] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Jun 22 08:35:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:00.694635 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5ce35-4fdc-4a45-949d-3ee0762d9d49 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:00.731477 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:00.792180 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 216/431] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Jun 22 08:35:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:35:00.802177 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af6477-5d35-47f4-b8d5-05de8acd6f5f None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:00.848133 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5ce35-4fdc-4a45-949d-3ee0762d9d49 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:00.892230 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89dc639-1256-47d6-9b7a-770ae357d41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:00.893206 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89dc639-1256-47d6-9b7a-770ae357d41f None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:00.893644 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89dc639-1256-47d6-9b7a-770ae357d41f None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:00.894486 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89dc639-1256-47d6-9b7a-770ae357d41f None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:00.895296 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89dc639-1256-47d6-9b7a-770ae357d41f None admin] RBAC: Adding query filter params (name=member) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:00.895616 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89dc639-1256-47d6-9b7a-770ae357d41f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:00.897087 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89dc639-1256-47d6-9b7a-770ae357d41f None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:00.908608 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 216/432] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Jun 22 08:35:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:00.915187 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89dc639-1256-47d6-9b7a-770ae357d41f None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:00.930698 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af6477-5d35-47f4-b8d5-05de8acd6f5f None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:00.950341 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:00.976196 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f929f-968c-4d9a-a08e-01f1aa7c6954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:00.977079 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f929f-968c-4d9a-a08e-01f1aa7c6954 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:00.977468 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f929f-968c-4d9a-a08e-01f1aa7c6954 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:00.977757 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f929f-968c-4d9a-a08e-01f1aa7c6954 None admin] PATH_INFO: `/v3/projects/68c923ae1ea74d589e86978e4dd415c2` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:00.979218 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8f929f-968c-4d9a-a08e-01f1aa7c6954 None admin] RBAC: Authorizing `identity:get_project(project_id=68c923ae1ea74d589e86978e4dd415c2)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:00.981217 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8f929f-968c-4d9a-a08e-01f1aa7c6954 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:00.983720 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 217/433] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Jun 22 08:35:00 2022] GET /identity/v3/projects/68c923ae1ea74d589e86978e4dd415c2 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:00.989576 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f929f-968c-4d9a-a08e-01f1aa7c6954 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:01.033205 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:01.056336 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89dc639-1256-47d6-9b7a-770ae357d41f None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:01.116417 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6651915f-19e1-4ca5-b2c8-737a97bdb63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:01.117110 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651915f-19e1-4ca5-b2c8-737a97bdb63a None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:01.117404 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651915f-19e1-4ca5-b2c8-737a97bdb63a None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:01.117690 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651915f-19e1-4ca5-b2c8-737a97bdb63a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:01.141525 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f929f-968c-4d9a-a08e-01f1aa7c6954 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:01.204191 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ca4a25-5454-430b-9452-bcecf0429884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:01.205817 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca4a25-5454-430b-9452-bcecf0429884 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:01.206361 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca4a25-5454-430b-9452-bcecf0429884 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:01.206889 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca4a25-5454-430b-9452-bcecf0429884 None admin] PATH_INFO: `/v3/groups/5405b78cebff4a2096483c4afbfa37e1` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:01.209345 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ca4a25-5454-430b-9452-bcecf0429884 None admin] RBAC: Authorizing `identity:get_group(group_id=5405b78cebff4a2096483c4afbfa37e1)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:01.211732 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ca4a25-5454-430b-9452-bcecf0429884 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:01.214580 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 218/434] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Jun 22 08:35:00 2022] GET /identity/v3/groups/5405b78cebff4a2096483c4afbfa37e1 => generated 226 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:35:01.216190 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2c0ca-f131-4e2b-8f80-4f7c8740a715 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:01.216693 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2c0ca-f131-4e2b-8f80-4f7c8740a715 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:01.217214 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2c0ca-f131-4e2b-8f80-4f7c8740a715 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:01.219378 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 219/435] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:35:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:35:01.220864 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad2c0ca-f131-4e2b-8f80-4f7c8740a715 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:01.235319 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6651915f-19e1-4ca5-b2c8-737a97bdb63a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:01.237788 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6651915f-19e1-4ca5-b2c8-737a97bdb63a None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:01.301723 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:01.359034 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:01.373261 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad2c0ca-f131-4e2b-8f80-4f7c8740a715 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:01.388951 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 217/436] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Jun 22 08:35:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:35:01.388951 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29af69-92bb-47c0-a588-3606a48db0d7 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:01.388951 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29af69-92bb-47c0-a588-3606a48db0d7 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:01.388951 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29af69-92bb-47c0-a588-3606a48db0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:01.410605 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-1f29af69-92bb-47c0-a588-3606a48db0d7 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:35:01.412322 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-1f29af69-92bb-47c0-a588-3606a48db0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:35:01.415255 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b819f4e-3600-408c-98c4-2f8d678ed2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:01.415920 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b819f4e-3600-408c-98c4-2f8d678ed2fd None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:01.416206 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b819f4e-3600-408c-98c4-2f8d678ed2fd None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:01.416486 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b819f4e-3600-408c-98c4-2f8d678ed2fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:01.417333 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b819f4e-3600-408c-98c4-2f8d678ed2fd None admin] RBAC: Adding query filter params (group.id=5405b78cebff4a2096483c4afbfa37e1, role.id=a92b520fb33f4333aad569d98be2bd7e, scope.project.id=68c923ae1ea74d589e86978e4dd415c2) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:01.417654 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b819f4e-3600-408c-98c4-2f8d678ed2fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:01.419165 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b819f4e-3600-408c-98c4-2f8d678ed2fd None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:01.426778 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 220/437] 10.222.0.42 () {56 vars in 1376 bytes} [Wed Jun 22 08:35:01 2022] GET /identity/v3/role_assignments?group.id=5405b78cebff4a2096483c4afbfa37e1&scope.project.id=68c923ae1ea74d589e86978e4dd415c2&role.id=a92b520fb33f4333aad569d98be2bd7e => generated 611 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:01.427344 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b819f4e-3600-408c-98c4-2f8d678ed2fd None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:01.520984 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 218/438] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:35:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:35:01.551680 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f29af69-92bb-47c0-a588-3606a48db0d7 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:01.601210 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b819f4e-3600-408c-98c4-2f8d678ed2fd None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:01.617385 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:01.645655 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a7fbeb-d07b-49a8-b9c4-54131c3c8f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:01.646580 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7fbeb-d07b-49a8-b9c4-54131c3c8f62 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:01.646865 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7fbeb-d07b-49a8-b9c4-54131c3c8f62 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:01.647143 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7fbeb-d07b-49a8-b9c4-54131c3c8f62 None admin] PATH_INFO: `/v3/projects/adfd1b153ab54652bb25b1b4a02bae1d` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:01.648366 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a7fbeb-d07b-49a8-b9c4-54131c3c8f62 None admin] RBAC: Authorizing `identity:get_project(project_id=adfd1b153ab54652bb25b1b4a02bae1d)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:01.649797 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a7fbeb-d07b-49a8-b9c4-54131c3c8f62 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:01.651599 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 221/439] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Jun 22 08:35:01 2022] GET /identity/v3/projects/adfd1b153ab54652bb25b1b4a02bae1d => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:01.652870 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f632bf-146a-42e7-a993-6b9da31f75a0 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:01.653162 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f632bf-146a-42e7-a993-6b9da31f75a0 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:01.653438 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f632bf-146a-42e7-a993-6b9da31f75a0 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:01.654741 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 222/440] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:35:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:35:01.657211 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f632bf-146a-42e7-a993-6b9da31f75a0 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:01.687729 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f29af69-92bb-47c0-a588-3606a48db0d7 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:01.703547 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:01.727630 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d622b9-603e-4186-bff1-2b2d4a030985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:01.728445 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d622b9-603e-4186-bff1-2b2d4a030985 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:01.728719 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d622b9-603e-4186-bff1-2b2d4a030985 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:01.729046 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d622b9-603e-4186-bff1-2b2d4a030985 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:01.740428 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d622b9-603e-4186-bff1-2b2d4a030985 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:35:01.748913 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-f0d622b9-603e-4186-bff1-2b2d4a030985 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:35:01.748913 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:01.748913 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:01.748913 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:01.748913 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:01.748913 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:01.748913 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:01.748913 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:01.748913 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:01.748913 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:01.748913 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:01.748913 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:01.748913 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:35:01.748913 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:35:01.748913 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:35:01.748913 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:35:01.749814 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:35:01.749814 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:35:01.749814 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:35:01.749814 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:35:01.749814 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:01.749814 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:01.749814 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:01.749814 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:01.749814 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:01.749814 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:01.749814 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:01.749814 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:01.749814 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:01.749814 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:01.749814 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:01.749814 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:01.750892 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:01.750892 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:01.750892 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:01.750892 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:01.750892 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:35:01.750892 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:35:01.750892 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:35:01.750892 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:35:01.750892 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:35:01.750892 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:35:01.750892 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:35:01.750892 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:01.750892 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 219/441] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Jun 22 08:35:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:35:01.753009 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e49cd5-d17a-49bb-80d0-8c5c18f1a474 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:01.753706 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e49cd5-d17a-49bb-80d0-8c5c18f1a474 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:01.753706 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e49cd5-d17a-49bb-80d0-8c5c18f1a474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:01.773639 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-72e49cd5-d17a-49bb-80d0-8c5c18f1a474 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:35:01.773639 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-72e49cd5-d17a-49bb-80d0-8c5c18f1a474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:35:01.784637 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f632bf-146a-42e7-a993-6b9da31f75a0 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:01.821947 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ea585-d141-46c5-961b-c2c3ca514c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:01.822841 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ea585-d141-46c5-961b-c2c3ca514c3d None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:01.823112 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ea585-d141-46c5-961b-c2c3ca514c3d None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:01.823389 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ea585-d141-46c5-961b-c2c3ca514c3d None admin] PATH_INFO: `/v3/groups/5405b78cebff4a2096483c4afbfa37e1` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:01.825519 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1ea585-d141-46c5-961b-c2c3ca514c3d None admin] RBAC: Authorizing `identity:get_group(group_id=5405b78cebff4a2096483c4afbfa37e1)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:01.826997 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1ea585-d141-46c5-961b-c2c3ca514c3d None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:01.829006 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 223/442] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Jun 22 08:35:01 2022] GET /identity/v3/groups/5405b78cebff4a2096483c4afbfa37e1 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:35:01.829717 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ea585-d141-46c5-961b-c2c3ca514c3d None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:01.851316 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 220/443] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:35:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:35:01.852202 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e49cd5-d17a-49bb-80d0-8c5c18f1a474 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:01.883892 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:01.936041 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ea585-d141-46c5-961b-c2c3ca514c3d None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:01.953475 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e49cd5-d17a-49bb-80d0-8c5c18f1a474 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:01.956475 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:01.970720 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611a9482-143f-4370-a6a4-cce41b37ce8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:01.971414 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a9482-143f-4370-a6a4-cce41b37ce8a None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:01.971695 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a9482-143f-4370-a6a4-cce41b37ce8a None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:01.971982 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a9482-143f-4370-a6a4-cce41b37ce8a None admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:01.972727 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611a9482-143f-4370-a6a4-cce41b37ce8a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:01.973033 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611a9482-143f-4370-a6a4-cce41b37ce8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:01.974435 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611a9482-143f-4370-a6a4-cce41b37ce8a None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:01.982457 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 224/444] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Jun 22 08:35:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:01.983246 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611a9482-143f-4370-a6a4-cce41b37ce8a None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:01.993234 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd2c71a-57fe-456c-a287-beccc00b99a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:01.993895 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd2c71a-57fe-456c-a287-beccc00b99a8 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:01.994210 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd2c71a-57fe-456c-a287-beccc00b99a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:01.994495 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd2c71a-57fe-456c-a287-beccc00b99a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:01.995326 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd2c71a-57fe-456c-a287-beccc00b99a8 None admin] RBAC: Adding query filter params (group.id=5405b78cebff4a2096483c4afbfa37e1, role.id=5ea101070f734fa59995615179f2eff2, scope.project.id=adfd1b153ab54652bb25b1b4a02bae1d) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:01.995641 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd2c71a-57fe-456c-a287-beccc00b99a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:01.997101 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd2c71a-57fe-456c-a287-beccc00b99a8 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:02.005137 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 221/445] 10.222.0.42 () {56 vars in 1376 bytes} [Wed Jun 22 08:35:01 2022] GET /identity/v3/role_assignments?group.id=5405b78cebff4a2096483c4afbfa37e1&scope.project.id=adfd1b153ab54652bb25b1b4a02bae1d&role.id=5ea101070f734fa59995615179f2eff2 => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:02.005949 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd2c71a-57fe-456c-a287-beccc00b99a8 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:02.096013 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611a9482-143f-4370-a6a4-cce41b37ce8a None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:02.108261 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:02.131214 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd2c71a-57fe-456c-a287-beccc00b99a8 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:02.136850 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1201f04f-3095-4f25-a1d7-53d15606fc40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:02.137589 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201f04f-3095-4f25-a1d7-53d15606fc40 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:02.137872 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201f04f-3095-4f25-a1d7-53d15606fc40 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:02.138182 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201f04f-3095-4f25-a1d7-53d15606fc40 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:02.150798 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1201f04f-3095-4f25-a1d7-53d15606fc40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:35:02.158562 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-1201f04f-3095-4f25-a1d7-53d15606fc40 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:35:02.158562 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:02.158562 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:02.158562 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:02.158562 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:02.158562 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:02.158562 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:02.158562 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:02.158562 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:02.158562 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:02.158562 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:02.158562 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:02.158562 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:35:02.158562 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:35:02.158562 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:35:02.158562 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:35:02.159482 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:35:02.159482 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:35:02.159482 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:35:02.159482 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:35:02.159482 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:02.159482 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:02.159482 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:02.159482 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:02.159482 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:02.159482 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:02.159482 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:02.159482 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:02.159482 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:02.159482 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:02.159482 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:02.159482 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:02.160257 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:02.160257 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:02.160257 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:02.160257 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:02.160257 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:35:02.160257 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:35:02.160257 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:35:02.160257 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:35:02.160257 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:35:02.160257 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:35:02.160257 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:35:02.160257 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:02.160257 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 225/446] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Jun 22 08:35:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:02.166124 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1201f04f-3095-4f25-a1d7-53d15606fc40 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:02.176569 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc3b31c-4d9b-41fd-a57c-1756a4ed6d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:02.177289 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3b31c-4d9b-41fd-a57c-1756a4ed6d04 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:02.178398 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3b31c-4d9b-41fd-a57c-1756a4ed6d04 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:02.178997 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3b31c-4d9b-41fd-a57c-1756a4ed6d04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:02.216903 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:02.270837 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc3b31c-4d9b-41fd-a57c-1756a4ed6d04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:02.272976 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc3b31c-4d9b-41fd-a57c-1756a4ed6d04 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:02.317497 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1201f04f-3095-4f25-a1d7-53d15606fc40 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:02.373478 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234b1f6-8f30-4191-83e0-63ef47c3a610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:02.374212 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234b1f6-8f30-4191-83e0-63ef47c3a610 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:02.374504 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234b1f6-8f30-4191-83e0-63ef47c3a610 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:02.374787 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234b1f6-8f30-4191-83e0-63ef47c3a610 None admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:02.375565 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a234b1f6-8f30-4191-83e0-63ef47c3a610 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:02.375880 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a234b1f6-8f30-4191-83e0-63ef47c3a610 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:02.377992 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a234b1f6-8f30-4191-83e0-63ef47c3a610 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:02.389029 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 226/447] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Jun 22 08:35:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:35:02.395549 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234b1f6-8f30-4191-83e0-63ef47c3a610 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:02.415931 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 222/448] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Jun 22 08:35:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:35:02.424210 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc3b31c-4d9b-41fd-a57c-1756a4ed6d04 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:02.434395 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:02.517974 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:02.522609 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234b1f6-8f30-4191-83e0-63ef47c3a610 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:02.563571 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7457ef-7958-4272-b93a-b057211a6028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:02.564603 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7457ef-7958-4272-b93a-b057211a6028 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:02.565569 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7457ef-7958-4272-b93a-b057211a6028 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:02.566035 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7457ef-7958-4272-b93a-b057211a6028 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:02.576633 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc3b31c-4d9b-41fd-a57c-1756a4ed6d04 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:02.621066 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf5c7c1-46b0-49dd-87d5-c013cdef5da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:02.622033 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5c7c1-46b0-49dd-87d5-c013cdef5da2 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:02.622442 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5c7c1-46b0-49dd-87d5-c013cdef5da2 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:02.622805 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5c7c1-46b0-49dd-87d5-c013cdef5da2 None admin] PATH_INFO: `/v3/projects/adfd1b153ab54652bb25b1b4a02bae1d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:02.624142 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf5c7c1-46b0-49dd-87d5-c013cdef5da2 None admin] RBAC: Authorizing `identity:get_project(project_id=adfd1b153ab54652bb25b1b4a02bae1d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:02.625823 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf5c7c1-46b0-49dd-87d5-c013cdef5da2 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:02.628222 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 223/449] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Jun 22 08:35:02 2022] GET /identity/v3/projects/adfd1b153ab54652bb25b1b4a02bae1d => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:35:02.636988 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf5c7c1-46b0-49dd-87d5-c013cdef5da2 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:02.647090 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7457ef-7958-4272-b93a-b057211a6028 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:02.648500 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7457ef-7958-4272-b93a-b057211a6028 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:02.680838 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:02.774683 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 227/450] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Jun 22 08:35:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:35:02.776714 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7457ef-7958-4272-b93a-b057211a6028 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:02.810839 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf5c7c1-46b0-49dd-87d5-c013cdef5da2 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:02.855456 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737479b-c53f-4fc2-bea9-5f20be9c1831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:02.856551 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737479b-c53f-4fc2-bea9-5f20be9c1831 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:02.856902 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737479b-c53f-4fc2-bea9-5f20be9c1831 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:02.857242 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737479b-c53f-4fc2-bea9-5f20be9c1831 None admin] PATH_INFO: `/v3/groups/5405b78cebff4a2096483c4afbfa37e1` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:02.859036 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8737479b-c53f-4fc2-bea9-5f20be9c1831 None admin] RBAC: Authorizing `identity:get_group(group_id=5405b78cebff4a2096483c4afbfa37e1)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:02.860725 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8737479b-c53f-4fc2-bea9-5f20be9c1831 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:02.862765 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 224/451] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Jun 22 08:35:02 2022] GET /identity/v3/groups/5405b78cebff4a2096483c4afbfa37e1 => generated 226 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:35:02.869717 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737479b-c53f-4fc2-bea9-5f20be9c1831 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:02.875152 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:02.911649 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7457ef-7958-4272-b93a-b057211a6028 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:02.948885 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:02.957283 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80088993-dab2-4b31-8348-9fd12af63515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:02.958682 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80088993-dab2-4b31-8348-9fd12af63515 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:02.959169 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80088993-dab2-4b31-8348-9fd12af63515 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:02.959649 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80088993-dab2-4b31-8348-9fd12af63515 None admin] PATH_INFO: `/v3/projects/272f01980f584e4888194eeac35f8209` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:02.961609 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80088993-dab2-4b31-8348-9fd12af63515 None admin] RBAC: Authorizing `identity:get_project(project_id=272f01980f584e4888194eeac35f8209)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:02.964249 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80088993-dab2-4b31-8348-9fd12af63515 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:02.973212 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 228/452] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Jun 22 08:35:02 2022] GET /identity/v3/projects/272f01980f584e4888194eeac35f8209 => generated 344 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:02.974988 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80088993-dab2-4b31-8348-9fd12af63515 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:02.991835 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737479b-c53f-4fc2-bea9-5f20be9c1831 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:03.029572 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0aa14-7a9c-4116-b931-7fd3308fb2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:03.030691 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0aa14-7a9c-4116-b931-7fd3308fb2a1 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:03.031179 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0aa14-7a9c-4116-b931-7fd3308fb2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:03.031628 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0aa14-7a9c-4116-b931-7fd3308fb2a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:03.033113 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc0aa14-7a9c-4116-b931-7fd3308fb2a1 None admin] RBAC: Adding query filter params (group.id=5405b78cebff4a2096483c4afbfa37e1, role.id=a92b520fb33f4333aad569d98be2bd7e, scope.project.id=adfd1b153ab54652bb25b1b4a02bae1d) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:03.033624 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc0aa14-7a9c-4116-b931-7fd3308fb2a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:03.036306 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc0aa14-7a9c-4116-b931-7fd3308fb2a1 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:03.044752 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 225/453] 10.222.0.42 () {56 vars in 1376 bytes} [Wed Jun 22 08:35:02 2022] GET /identity/v3/role_assignments?group.id=5405b78cebff4a2096483c4afbfa37e1&scope.project.id=adfd1b153ab54652bb25b1b4a02bae1d&role.id=a92b520fb33f4333aad569d98be2bd7e => generated 611 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:35:03.109134 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80088993-dab2-4b31-8348-9fd12af63515 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:03.153814 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb546b-db3e-41d3-82fc-59517f043d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:03.154963 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb546b-db3e-41d3-82fc-59517f043d93 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:03.155346 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb546b-db3e-41d3-82fc-59517f043d93 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:03.155740 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb546b-db3e-41d3-82fc-59517f043d93 None admin] PATH_INFO: `/v3/groups/c0a02128e2164122b27fa4674b070ce8` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:03.157260 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdb546b-db3e-41d3-82fc-59517f043d93 None admin] RBAC: Authorizing `identity:get_group(group_id=c0a02128e2164122b27fa4674b070ce8)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:03.159494 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdb546b-db3e-41d3-82fc-59517f043d93 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:03.161447 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 229/454] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Jun 22 08:35:02 2022] GET /identity/v3/groups/c0a02128e2164122b27fa4674b070ce8 => generated 229 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:03.168457 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0aa14-7a9c-4116-b931-7fd3308fb2a1 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:03.286765 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:03.336924 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0aa14-7a9c-4116-b931-7fd3308fb2a1 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:03.384838 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1a9d1e-3d1f-48c2-95ba-5f768be22b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:03.385768 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a9d1e-3d1f-48c2-95ba-5f768be22b1c None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:03.386244 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a9d1e-3d1f-48c2-95ba-5f768be22b1c None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:03.386683 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a9d1e-3d1f-48c2-95ba-5f768be22b1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:03.387711 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1a9d1e-3d1f-48c2-95ba-5f768be22b1c None admin] RBAC: Adding query filter params (group.id=c0a02128e2164122b27fa4674b070ce8, role.id=c7518e0f532945af80c33860f2ac506d, scope.project.id=272f01980f584e4888194eeac35f8209) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:03.388146 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1a9d1e-3d1f-48c2-95ba-5f768be22b1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:03.390492 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1a9d1e-3d1f-48c2-95ba-5f768be22b1c None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:03.398557 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 226/455] 10.222.0.42 () {56 vars in 1376 bytes} [Wed Jun 22 08:35:03 2022] GET /identity/v3/role_assignments?group.id=c0a02128e2164122b27fa4674b070ce8&scope.project.id=272f01980f584e4888194eeac35f8209&role.id=c7518e0f532945af80c33860f2ac506d => generated 611 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:07.111187 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db769355-7ea9-4b2e-8ecd-3907f468c780 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:07.112033 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db769355-7ea9-4b2e-8ecd-3907f468c780 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:07.112033 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db769355-7ea9-4b2e-8ecd-3907f468c780 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:07.113461 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 230/456] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:35:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:35:07.124061 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d01c9-f110-4319-bd67-b97dd223a733 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:07.124799 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d01c9-f110-4319-bd67-b97dd223a733 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:07.124799 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d01c9-f110-4319-bd67-b97dd223a733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:07.155557 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-570d01c9-f110-4319-bd67-b97dd223a733 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:35:07.156873 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-570d01c9-f110-4319-bd67-b97dd223a733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:35:07.253832 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 227/457] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:35:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:35:07.270178 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d908d7f-cb88-4c0d-854f-8d9812808360 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:07.271170 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d908d7f-cb88-4c0d-854f-8d9812808360 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:07.271928 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d908d7f-cb88-4c0d-854f-8d9812808360 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:07.272192 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb32ac3-4efd-4b70-96f6-4b97fcf32ef7 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:07.272437 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb32ac3-4efd-4b70-96f6-4b97fcf32ef7 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:07.272726 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb32ac3-4efd-4b70-96f6-4b97fcf32ef7 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:07.274394 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 228/458] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:35:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:35:07.276315 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 231/459] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:35:07 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:35:07.282342 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb32ac3-4efd-4b70-96f6-4b97fcf32ef7 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:07.285977 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324fa28-862a-4fd6-b6b4-1f3ad040649c None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:07.287068 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324fa28-862a-4fd6-b6b4-1f3ad040649c None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:07.287928 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324fa28-862a-4fd6-b6b4-1f3ad040649c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:07.321122 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-0324fa28-862a-4fd6-b6b4-1f3ad040649c None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:35:07.323767 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-0324fa28-862a-4fd6-b6b4-1f3ad040649c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:35:07.394393 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:07.408104 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:07.416350 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 232/460] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:35:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:35:07.418972 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174df43-6dca-4ec9-846f-b7a74bacaf50 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:07.419523 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174df43-6dca-4ec9-846f-b7a74bacaf50 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:07.420031 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174df43-6dca-4ec9-846f-b7a74bacaf50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:07.441266 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-4174df43-6dca-4ec9-846f-b7a74bacaf50 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:35:07.442880 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-4174df43-6dca-4ec9-846f-b7a74bacaf50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:35:07.505394 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb32ac3-4efd-4b70-96f6-4b97fcf32ef7 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:07.524280 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 233/461] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:35:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:35:07.538680 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4174df43-6dca-4ec9-846f-b7a74bacaf50 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:07.578751 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18918a10-ca59-47c8-8353-045fb5615fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:07.580150 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18918a10-ca59-47c8-8353-045fb5615fd2 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:07.581490 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18918a10-ca59-47c8-8353-045fb5615fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:07.582302 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18918a10-ca59-47c8-8353-045fb5615fd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:07.604607 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18918a10-ca59-47c8-8353-045fb5615fd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:07.607727 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18918a10-ca59-47c8-8353-045fb5615fd2 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:07.640478 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-18918a10-ca59-47c8-8353-045fb5615fd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:07.640478 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:07.640478 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:07.640478 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:07.640478 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:07.640478 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:07.640478 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:07.640478 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:07.640478 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:07.640478 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:07.640478 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:07.640478 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:07.640478 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:35:07.640478 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:35:07.640478 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:35:07.641968 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:35:07.641968 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:07.641968 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:07.641968 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:07.641968 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:07.641968 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:07.641968 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:07.641968 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:07.641968 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:07.641968 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:07.641968 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:07.641968 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:07.641968 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:07.641968 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:07.641968 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:07.641968 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:07.641968 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:07.644681 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:35:07.644681 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:35:07.644681 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:07.644681 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:07.648367 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 229/462] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:35:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:07.650274 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18918a10-ca59-47c8-8353-045fb5615fd2 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:07.680398 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4174df43-6dca-4ec9-846f-b7a74bacaf50 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:07.710547 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:07.718565 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cbccbd-8589-4630-b8da-01eb0ad39e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:07.719625 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cbccbd-8589-4630-b8da-01eb0ad39e96 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:07.719774 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cbccbd-8589-4630-b8da-01eb0ad39e96 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:07.720031 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cbccbd-8589-4630-b8da-01eb0ad39e96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:07.731601 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cbccbd-8589-4630-b8da-01eb0ad39e96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:07.733092 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cbccbd-8589-4630-b8da-01eb0ad39e96 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:07.753134 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-49cbccbd-8589-4630-b8da-01eb0ad39e96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:07.753134 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:07.753134 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:07.753134 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:07.753134 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:07.753134 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:07.753134 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:07.753134 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:07.753134 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:07.753134 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:07.753134 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:07.753134 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:07.753134 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:35:07.753134 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:35:07.753134 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:35:07.758802 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:35:07.758802 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:07.758802 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:07.758802 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:07.758802 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:07.758802 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:07.758802 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:07.758802 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:07.758802 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:07.758802 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:07.758802 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:07.758802 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:07.758802 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:07.758802 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:07.758802 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:07.758802 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:07.758802 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:07.760568 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:35:07.760568 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:35:07.760568 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:07.760568 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:07.760568 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 234/463] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:35:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:07.760568 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cbccbd-8589-4630-b8da-01eb0ad39e96 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:07.874346 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cbccbd-8589-4630-b8da-01eb0ad39e96 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:07.883928 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18918a10-ca59-47c8-8353-045fb5615fd2 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:07.915508 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e93a1dd-bd52-4e0c-b433-abb1fb4aa8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:07.916075 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93a1dd-bd52-4e0c-b433-abb1fb4aa8be None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:07.916361 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93a1dd-bd52-4e0c-b433-abb1fb4aa8be None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:07.916646 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93a1dd-bd52-4e0c-b433-abb1fb4aa8be None admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:07.917415 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e93a1dd-bd52-4e0c-b433-abb1fb4aa8be None admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:07.918376 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:07.918554 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e93a1dd-bd52-4e0c-b433-abb1fb4aa8be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:07.919280 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e93a1dd-bd52-4e0c-b433-abb1fb4aa8be None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:07.934131 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 235/464] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:35:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:07.935221 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e93a1dd-bd52-4e0c-b433-abb1fb4aa8be None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:07.954375 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e570688-cb73-426c-b8ad-d18b7b1c208c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:07.955200 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e570688-cb73-426c-b8ad-d18b7b1c208c None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:07.955683 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e570688-cb73-426c-b8ad-d18b7b1c208c None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:07.955874 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e570688-cb73-426c-b8ad-d18b7b1c208c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:07.969809 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e570688-cb73-426c-b8ad-d18b7b1c208c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:07.972557 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e570688-cb73-426c-b8ad-d18b7b1c208c None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:07.992318 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:07.996079 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-6e570688-cb73-426c-b8ad-d18b7b1c208c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:07.996079 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:07.996079 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:07.996079 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:07.996079 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:07.996079 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:07.996079 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:07.996079 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:07.996079 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:07.996079 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:07.996079 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:07.996079 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:07.996079 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:35:07.996079 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:35:07.996079 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:35:07.998029 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:35:07.998029 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:07.998029 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:07.998029 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:07.998029 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:07.998029 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:07.998029 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:07.998029 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:07.998029 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:07.998029 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:07.998029 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:07.998029 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:07.998029 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:07.998029 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:07.998029 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:07.998029 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:07.998029 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:08.000596 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:35:08.000596 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:35:08.000596 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:08.000596 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:08.002317 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 230/465] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:35:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:08.003825 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2951b-cf27-4b92-9384-c72c741c2914 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:08.004108 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2951b-cf27-4b92-9384-c72c741c2914 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:08.004379 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2951b-cf27-4b92-9384-c72c741c2914 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:08.005754 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 231/466] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:35:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:35:08.006620 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2951b-cf27-4b92-9384-c72c741c2914 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:08.095923 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e93a1dd-bd52-4e0c-b433-abb1fb4aa8be None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:08.141226 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533e8a0-bb1e-4b42-bd3e-68063fad20db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:08.141995 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533e8a0-bb1e-4b42-bd3e-68063fad20db None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:08.142216 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533e8a0-bb1e-4b42-bd3e-68063fad20db None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:08.143607 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533e8a0-bb1e-4b42-bd3e-68063fad20db None admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:08.144363 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c533e8a0-bb1e-4b42-bd3e-68063fad20db None admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:08.144672 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c533e8a0-bb1e-4b42-bd3e-68063fad20db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:08.146649 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c533e8a0-bb1e-4b42-bd3e-68063fad20db None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:08.167543 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 236/467] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:35:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:08.167543 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533e8a0-bb1e-4b42-bd3e-68063fad20db None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:08.170648 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2951b-cf27-4b92-9384-c72c741c2914 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:08.218556 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef2f69e-9a7d-482e-a5a5-943b4e3155bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:08.219350 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2f69e-9a7d-482e-a5a5-943b4e3155bb None admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:08.219676 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2f69e-9a7d-482e-a5a5-943b4e3155bb None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:08.219984 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2f69e-9a7d-482e-a5a5-943b4e3155bb None admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:08.220801 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef2f69e-9a7d-482e-a5a5-943b4e3155bb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:08.223320 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef2f69e-9a7d-482e-a5a5-943b4e3155bb None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:08.248116 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 232/468] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Jun 22 08:35:08 2022] POST /identity/v3/users => generated 248 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:35:08.259671 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc79a5-9faa-4711-9007-46eda930703c None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:08.259972 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc79a5-9faa-4711-9007-46eda930703c None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:08.260259 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc79a5-9faa-4711-9007-46eda930703c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:08.290820 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-8afc79a5-9faa-4711-9007-46eda930703c None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:35:08.293214 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-8afc79a5-9faa-4711-9007-46eda930703c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:35:08.336093 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:08.337975 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:08.343752 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533e8a0-bb1e-4b42-bd3e-68063fad20db None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:08.407064 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335c8581-7d9e-49be-b5db-aca4e54d5c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:08.408428 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c8581-7d9e-49be-b5db-aca4e54d5c99 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:08.409513 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c8581-7d9e-49be-b5db-aca4e54d5c99 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:08.410102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c8581-7d9e-49be-b5db-aca4e54d5c99 None admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:08.411156 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335c8581-7d9e-49be-b5db-aca4e54d5c99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:08.411678 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335c8581-7d9e-49be-b5db-aca4e54d5c99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:08.413393 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335c8581-7d9e-49be-b5db-aca4e54d5c99 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:08.439342 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 237/469] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:35:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:08.439342 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335c8581-7d9e-49be-b5db-aca4e54d5c99 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:08.441942 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 233/470] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:35:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:35:08.443153 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc79a5-9faa-4711-9007-46eda930703c None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:08.581666 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc79a5-9faa-4711-9007-46eda930703c None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:08.614463 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335c8581-7d9e-49be-b5db-aca4e54d5c99 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:08.644211 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305faf33-1973-4618-b9a2-cc535f09ab17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:08.646618 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305faf33-1973-4618-b9a2-cc535f09ab17 None admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:08.647505 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305faf33-1973-4618-b9a2-cc535f09ab17 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:08.648110 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305faf33-1973-4618-b9a2-cc535f09ab17 None admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:08.650375 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305faf33-1973-4618-b9a2-cc535f09ab17 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:08.654147 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305faf33-1973-4618-b9a2-cc535f09ab17 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:08.673244 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff6061b-39c1-4db6-89b9-ecaabe1eb0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:08.673937 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6061b-39c1-4db6-89b9-ecaabe1eb0eb None admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:08.674291 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6061b-39c1-4db6-89b9-ecaabe1eb0eb None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:08.674573 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6061b-39c1-4db6-89b9-ecaabe1eb0eb None admin] PATH_INFO: `/v3/users` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:08.675301 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff6061b-39c1-4db6-89b9-ecaabe1eb0eb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:08.676768 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff6061b-39c1-4db6-89b9-ecaabe1eb0eb None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:08.703569 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 234/471] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Jun 22 08:35:08 2022] POST /identity/v3/users => generated 248 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:35:08.708624 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 238/472] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Jun 22 08:35:08 2022] POST /identity/v3/users => generated 246 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:35:08.709350 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305faf33-1973-4618-b9a2-cc535f09ab17 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:08.742872 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:08.914787 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305faf33-1973-4618-b9a2-cc535f09ab17 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:08.974431 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f147c-531f-4627-953f-f58d827b1c79 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:08.974821 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f147c-531f-4627-953f-f58d827b1c79 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:08.975295 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f147c-531f-4627-953f-f58d827b1c79 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:08.982277 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 239/473] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:35:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:35:08.987606 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee2810-4427-4503-b7f2-bf5d7a0b4c2a None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:08.988040 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee2810-4427-4503-b7f2-bf5d7a0b4c2a None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:08.988487 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee2810-4427-4503-b7f2-bf5d7a0b4c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:08.988586 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f4f15d-a1f1-451e-bb97-d2f9ea7c1bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:08.989957 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4f15d-a1f1-451e-bb97-d2f9ea7c1bf4 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:08.990458 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4f15d-a1f1-451e-bb97-d2f9ea7c1bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:08.990955 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4f15d-a1f1-451e-bb97-d2f9ea7c1bf4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:09.010571 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f4f15d-a1f1-451e-bb97-d2f9ea7c1bf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:09.012392 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f4f15d-a1f1-451e-bb97-d2f9ea7c1bf4 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:09.025977 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-fdee2810-4427-4503-b7f2-bf5d7a0b4c2a None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:35:09.026969 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-fdee2810-4427-4503-b7f2-bf5d7a0b4c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:35:09.042759 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-90f4f15d-a1f1-451e-bb97-d2f9ea7c1bf4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:09.042759 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:09.042759 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:09.042759 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:09.042759 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:09.042759 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:09.042759 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:09.042759 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:09.042759 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:09.042759 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:09.042759 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:09.042759 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:09.042759 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:35:09.042759 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:35:09.042759 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:35:09.043654 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:35:09.043654 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:09.043654 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:09.043654 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:09.043654 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:09.043654 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:09.043654 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:09.043654 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:09.043654 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:09.043654 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:09.043654 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:09.043654 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:09.043654 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:09.043654 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:09.043654 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:09.043654 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:09.043654 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:09.044616 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:35:09.044616 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:35:09.044616 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:09.044616 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:09.044845 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 235/474] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:35:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:09.054496 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f4f15d-a1f1-451e-bb97-d2f9ea7c1bf4 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:09.055855 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:09.192160 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 240/475] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:35:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:35:09.193278 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:09.243735 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f4f15d-a1f1-451e-bb97-d2f9ea7c1bf4 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:09.255725 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee2810-4427-4503-b7f2-bf5d7a0b4c2a None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:09.299902 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98435695-2d93-45f4-bd7c-3ed31e90dee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:09.300937 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98435695-2d93-45f4-bd7c-3ed31e90dee1 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:09.301507 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98435695-2d93-45f4-bd7c-3ed31e90dee1 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:09.301794 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98435695-2d93-45f4-bd7c-3ed31e90dee1 None admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:09.302607 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98435695-2d93-45f4-bd7c-3ed31e90dee1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:09.302909 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98435695-2d93-45f4-bd7c-3ed31e90dee1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:09.304354 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98435695-2d93-45f4-bd7c-3ed31e90dee1 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:09.335961 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 236/476] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:35:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:35:09.346989 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98435695-2d93-45f4-bd7c-3ed31e90dee1 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:09.520768 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee2810-4427-4503-b7f2-bf5d7a0b4c2a None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:09.605709 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38f6912-4c08-4fcf-bfa6-5da52be9973e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:09.606684 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98435695-2d93-45f4-bd7c-3ed31e90dee1 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:09.606947 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f6912-4c08-4fcf-bfa6-5da52be9973e None admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:09.607391 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f6912-4c08-4fcf-bfa6-5da52be9973e None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:09.607893 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f6912-4c08-4fcf-bfa6-5da52be9973e None admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:09.609331 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38f6912-4c08-4fcf-bfa6-5da52be9973e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:09.612592 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38f6912-4c08-4fcf-bfa6-5da52be9973e None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:09.624014 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.sql.core [None req-c38f6912-4c08-4fcf-bfa6-5da52be9973e None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 22 08:35:09.624014 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 22 08:35:09.624014 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [parameters: {'id': 'e8d25e86ae8647e192999f0cd8a987bb', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 22 08:35:09.624014 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86701) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 22 08:35:09.658528 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-c38f6912-4c08-4fcf-bfa6-5da52be9973e None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 22 08:35:09.658528 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:09.658528 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 22 08:35:09.658528 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 22 08:35:09.658528 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 22 08:35:09.658528 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 22 08:35:09.658528 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 22 08:35:09.658528 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application result = self._query(query) Jun 22 08:35:09.658528 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 22 08:35:09.658528 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application conn.query(q) Jun 22 08:35:09.658528 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 22 08:35:09.658528 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 22 08:35:09.658528 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 22 08:35:09.658528 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application result.read() Jun 22 08:35:09.658528 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 22 08:35:09.660708 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 22 08:35:09.660708 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 22 08:35:09.660708 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 22 08:35:09.660708 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 22 08:35:09.660708 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 22 08:35:09.660708 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 22 08:35:09.660708 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 22 08:35:09.660708 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 22 08:35:09.660708 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:09.660708 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 22 08:35:09.660708 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:09.660708 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:09.660708 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 22 08:35:09.660708 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 22 08:35:09.660708 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 22 08:35:09.660708 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return ref.to_dict() Jun 22 08:35:09.660708 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 22 08:35:09.660708 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application next(self.gen) Jun 22 08:35:09.662470 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 22 08:35:09.662470 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application yield resource Jun 22 08:35:09.662470 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 22 08:35:09.662470 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application next(self.gen) Jun 22 08:35:09.662470 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 22 08:35:09.662470 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application self.session.rollback() Jun 22 08:35:09.662470 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 22 08:35:09.662470 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application self.force_reraise() Jun 22 08:35:09.662470 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 22 08:35:09.662470 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise self.value Jun 22 08:35:09.662470 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 22 08:35:09.662470 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 22 08:35:09.662470 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 22 08:35:09.662470 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application session.commit() Jun 22 08:35:09.662470 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 22 08:35:09.662470 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 22 08:35:09.662470 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 22 08:35:09.664038 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application self._prepare_impl() Jun 22 08:35:09.664038 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 22 08:35:09.664038 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application self.session.flush() Jun 22 08:35:09.664038 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 22 08:35:09.664038 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application self._flush(objects) Jun 22 08:35:09.664038 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 22 08:35:09.664038 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 22 08:35:09.664038 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 22 08:35:09.664038 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application compat.raise_( Jun 22 08:35:09.664038 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 22 08:35:09.664038 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception Jun 22 08:35:09.664038 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 22 08:35:09.664038 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application flush_context.execute() Jun 22 08:35:09.664038 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 22 08:35:09.664038 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rec.execute(self) Jun 22 08:35:09.664038 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 22 08:35:09.664038 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 22 08:35:09.665625 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 22 08:35:09.665625 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 22 08:35:09.665625 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 22 08:35:09.665625 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 22 08:35:09.665625 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 22 08:35:09.665625 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 22 08:35:09.665625 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 22 08:35:09.665625 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 22 08:35:09.665625 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 22 08:35:09.665625 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 22 08:35:09.665625 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 22 08:35:09.665625 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 22 08:35:09.665625 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 22 08:35:09.665625 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 22 08:35:09.665625 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 22 08:35:09.665625 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception Jun 22 08:35:09.669588 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 22 08:35:09.669588 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 22 08:35:09.669588 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 22 08:35:09.669588 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 22 08:35:09.669588 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 22 08:35:09.669588 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application result = self._query(query) Jun 22 08:35:09.669588 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 22 08:35:09.669588 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application conn.query(q) Jun 22 08:35:09.669588 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 22 08:35:09.669588 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 22 08:35:09.669588 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 22 08:35:09.669588 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application result.read() Jun 22 08:35:09.669588 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 22 08:35:09.669588 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 22 08:35:09.669588 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 22 08:35:09.669588 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 22 08:35:09.671586 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 22 08:35:09.671586 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 22 08:35:09.671586 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 22 08:35:09.671586 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 22 08:35:09.671586 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 22 08:35:09.671586 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 22 08:35:09.671586 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [parameters: {'id': 'e8d25e86ae8647e192999f0cd8a987bb', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 22 08:35:09.671586 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 22 08:35:09.671586 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:09.671586 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:35:09.671586 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:09.671586 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:09.671586 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:09.671586 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:09.671586 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:09.671586 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:09.673386 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:09.673386 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:09.673386 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:09.673386 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:09.673386 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:09.673386 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:09.673386 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 22 08:35:09.673386 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 22 08:35:09.673386 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:09.673386 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:09.673386 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 22 08:35:09.673386 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 22 08:35:09.673386 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 22 08:35:09.673386 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 22 08:35:09.673386 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 22 08:35:09.673386 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:09.679612 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 241/477] 10.222.0.42 () {60 vars in 1131 bytes} [Wed Jun 22 08:35:09 2022] POST /identity/v3/roles => generated 144 bytes in 407 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:09.679612 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38f6912-4c08-4fcf-bfa6-5da52be9973e None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:09.691806 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:09.706691 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:09.726817 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dfdfc3-ca74-4b52-9c90-56ebbb4416b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:09.728240 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dfdfc3-ca74-4b52-9c90-56ebbb4416b1 None admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:09.728735 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dfdfc3-ca74-4b52-9c90-56ebbb4416b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:09.729192 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dfdfc3-ca74-4b52-9c90-56ebbb4416b1 None admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:09.730652 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dfdfc3-ca74-4b52-9c90-56ebbb4416b1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:09.733790 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dfdfc3-ca74-4b52-9c90-56ebbb4416b1 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:09.772999 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 237/478] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Jun 22 08:35:09 2022] POST /identity/v3/users => generated 249 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 08:35:09.928491 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38f6912-4c08-4fcf-bfa6-5da52be9973e None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:09.983305 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea7578e-62ef-4549-99ca-c38a0a843bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:09.984140 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7578e-62ef-4549-99ca-c38a0a843bc4 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:09.984421 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7578e-62ef-4549-99ca-c38a0a843bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:09.984696 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7578e-62ef-4549-99ca-c38a0a843bc4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:10.007518 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea7578e-62ef-4549-99ca-c38a0a843bc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:35:10.015757 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-eea7578e-62ef-4549-99ca-c38a0a843bc4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:35:10.015757 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:10.015757 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:10.015757 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:10.015757 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:10.015757 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:10.015757 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:10.015757 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:10.015757 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:10.015757 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:10.015757 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:10.015757 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:10.015757 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:35:10.015757 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:35:10.015757 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:35:10.015757 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:35:10.020007 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:35:10.020007 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:35:10.020007 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:35:10.020007 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:35:10.020007 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:10.020007 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:10.020007 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:10.020007 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:10.020007 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:10.020007 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:10.020007 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:10.020007 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:10.020007 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:10.020007 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:10.020007 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:10.020007 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:10.023168 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:10.023168 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:10.023168 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:10.023168 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:10.023168 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:35:10.023168 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:35:10.023168 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:35:10.023168 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:35:10.023168 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:35:10.023168 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:35:10.023168 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:35:10.023168 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:10.023168 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 242/479] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Jun 22 08:35:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:35:10.030492 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dfdfc3-ca74-4b52-9c90-56ebbb4416b1 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:10.289326 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dfdfc3-ca74-4b52-9c90-56ebbb4416b1 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:10.362685 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2687a9-9346-4308-8f49-78800ab7228d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:10.363788 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2687a9-9346-4308-8f49-78800ab7228d None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:10.364240 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2687a9-9346-4308-8f49-78800ab7228d None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:10.364731 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2687a9-9346-4308-8f49-78800ab7228d None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:10.366199 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2687a9-9346-4308-8f49-78800ab7228d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:10.366888 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2687a9-9346-4308-8f49-78800ab7228d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:10.369572 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2687a9-9346-4308-8f49-78800ab7228d None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:10.387613 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 238/480] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Jun 22 08:35:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:11.767603 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e903e-e62a-4bae-8d0b-796295ddfe5e None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:11.770052 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e903e-e62a-4bae-8d0b-796295ddfe5e None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:11.770875 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e903e-e62a-4bae-8d0b-796295ddfe5e None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:11.775767 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 243/481] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:35:11 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:35:11.783082 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f32a5-c81c-485d-a02b-c436366bf9c0 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:11.785017 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f32a5-c81c-485d-a02b-c436366bf9c0 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:11.785783 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f32a5-c81c-485d-a02b-c436366bf9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:11.821112 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-434f32a5-c81c-485d-a02b-c436366bf9c0 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:35:11.823224 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-434f32a5-c81c-485d-a02b-c436366bf9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:35:11.876264 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ab753-1c02-48ab-b0d8-c1dc8cd38871 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:11.876756 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ab753-1c02-48ab-b0d8-c1dc8cd38871 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:11.878112 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ab753-1c02-48ab-b0d8-c1dc8cd38871 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:11.880402 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:11.881723 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 244/482] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:35:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:35:11.888200 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc9154-a76b-49c4-b03a-4455b5dcea3c None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:11.889044 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc9154-a76b-49c4-b03a-4455b5dcea3c None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:11.889818 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc9154-a76b-49c4-b03a-4455b5dcea3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:11.938643 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-93bc9154-a76b-49c4-b03a-4455b5dcea3c None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:35:11.944357 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-93bc9154-a76b-49c4-b03a-4455b5dcea3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:35:11.979283 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 239/483] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:35:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:35:11.979283 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0bbfae-4be4-4c42-aa62-449a49cdd8bd None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:11.979283 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0bbfae-4be4-4c42-aa62-449a49cdd8bd None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:11.979283 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0bbfae-4be4-4c42-aa62-449a49cdd8bd None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:11.983667 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 240/484] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:35:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:35:11.987244 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc723a-582e-488d-86d8-7e3043f4e58c None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:11.988460 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc723a-582e-488d-86d8-7e3043f4e58c None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:11.989091 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc723a-582e-488d-86d8-7e3043f4e58c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:12.020349 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-ecdc723a-582e-488d-86d8-7e3043f4e58c None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:35:12.022515 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-ecdc723a-582e-488d-86d8-7e3043f4e58c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:35:12.095388 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 241/485] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:35:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:35:12.102100 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc723a-582e-488d-86d8-7e3043f4e58c None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:12.102237 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:12.108041 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 245/486] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:35:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:35:12.183330 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc9154-a76b-49c4-b03a-4455b5dcea3c None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:12.202136 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:12.207413 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc723a-582e-488d-86d8-7e3043f4e58c None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:12.245280 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8044a3-d290-4571-a9c6-66ed4c78fd0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:12.245969 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8044a3-d290-4571-a9c6-66ed4c78fd0e None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:12.246285 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8044a3-d290-4571-a9c6-66ed4c78fd0e None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:12.246557 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8044a3-d290-4571-a9c6-66ed4c78fd0e None admin] PATH_INFO: `/v3/roles/service` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:12.266509 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8044a3-d290-4571-a9c6-66ed4c78fd0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:35:12.276427 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-0e8044a3-d290-4571-a9c6-66ed4c78fd0e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:35:12.276427 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:12.276427 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:12.276427 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:12.276427 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:12.276427 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:12.276427 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:12.276427 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:12.276427 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:12.276427 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:12.276427 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:12.276427 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:12.276427 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:35:12.276427 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:35:12.276427 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:35:12.276427 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:35:12.285849 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:35:12.285849 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:35:12.285849 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:35:12.285849 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:35:12.285849 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:12.285849 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:12.285849 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:12.285849 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:12.285849 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:12.285849 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:12.285849 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:12.285849 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:12.285849 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:12.285849 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:12.285849 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:12.285849 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:12.287384 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:12.287384 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:12.287384 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:12.287384 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:12.287384 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:35:12.287384 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:35:12.287384 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:35:12.287384 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:35:12.287384 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:35:12.287384 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:35:12.287384 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:35:12.287384 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:12.287384 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 242/487] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Jun 22 08:35:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:12.287384 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8044a3-d290-4571-a9c6-66ed4c78fd0e None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:12.384631 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8044a3-d290-4571-a9c6-66ed4c78fd0e None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:12.406591 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc9154-a76b-49c4-b03a-4455b5dcea3c None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:12.419759 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c14a1-1179-4070-ae00-df68736de427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:12.420559 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c14a1-1179-4070-ae00-df68736de427 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:12.420891 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c14a1-1179-4070-ae00-df68736de427 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:12.421172 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c14a1-1179-4070-ae00-df68736de427 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:12.432277 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4c14a1-1179-4070-ae00-df68736de427 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:35:12.441123 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-de4c14a1-1179-4070-ae00-df68736de427 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:35:12.441123 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:12.441123 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:12.441123 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:12.441123 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:12.441123 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:12.441123 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:12.441123 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:12.441123 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:12.441123 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:12.441123 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:12.441123 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:12.441123 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:35:12.441123 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:35:12.441123 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:35:12.441123 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:35:12.442510 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:35:12.442510 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:35:12.442510 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:35:12.442510 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:35:12.442510 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:12.442510 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:12.442510 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:12.442510 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:12.442510 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:12.442510 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:12.442510 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:12.442510 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:12.442510 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:12.442510 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:12.442510 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:12.442510 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:12.448516 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:12.448516 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:12.448516 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:12.448516 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:12.448516 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:35:12.448516 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:35:12.448516 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:35:12.448516 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:35:12.448516 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:35:12.448516 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:35:12.448516 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:35:12.448516 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:12.448516 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 243/488] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Jun 22 08:35:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:12.448516 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c14a1-1179-4070-ae00-df68736de427 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:12.470185 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:12.490047 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d26efa-8892-4b39-9ceb-9f79c5f94563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:12.491871 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d26efa-8892-4b39-9ceb-9f79c5f94563 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:12.492690 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d26efa-8892-4b39-9ceb-9f79c5f94563 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:12.493447 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d26efa-8892-4b39-9ceb-9f79c5f94563 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:12.515163 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d26efa-8892-4b39-9ceb-9f79c5f94563 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:35:12.533301 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-c4d26efa-8892-4b39-9ceb-9f79c5f94563 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:35:12.533301 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:12.533301 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:12.533301 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:12.533301 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:12.533301 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:12.533301 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:12.533301 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:12.533301 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:12.533301 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:12.533301 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:12.533301 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:12.533301 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:35:12.533301 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:35:12.533301 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:35:12.533301 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:35:12.535671 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:35:12.535671 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:35:12.535671 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:35:12.535671 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:35:12.535671 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:12.535671 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:12.535671 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:12.535671 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:12.535671 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:12.535671 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:12.535671 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:12.535671 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:12.535671 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:12.535671 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:12.535671 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:12.535671 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:12.537229 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:12.537229 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:12.537229 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:12.537229 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:12.537229 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:35:12.537229 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:35:12.537229 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:35:12.537229 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:35:12.537229 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:35:12.537229 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:35:12.537229 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:35:12.537229 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:12.550204 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 246/489] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Jun 22 08:35:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:35:12.552228 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d26efa-8892-4b39-9ceb-9f79c5f94563 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:12.560270 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c14a1-1179-4070-ae00-df68736de427 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:12.595579 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e7ef8d-c62d-462a-83c2-b4e8a81ad803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:12.596343 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7ef8d-c62d-462a-83c2-b4e8a81ad803 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:12.596659 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7ef8d-c62d-462a-83c2-b4e8a81ad803 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:12.596950 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7ef8d-c62d-462a-83c2-b4e8a81ad803 None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:12.597889 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e7ef8d-c62d-462a-83c2-b4e8a81ad803 None admin] RBAC: Adding query filter params (name=service) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:12.598865 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e7ef8d-c62d-462a-83c2-b4e8a81ad803 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:12.599935 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e7ef8d-c62d-462a-83c2-b4e8a81ad803 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:12.616094 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 244/490] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Jun 22 08:35:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:12.616094 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e7ef8d-c62d-462a-83c2-b4e8a81ad803 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:12.675822 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:12.697856 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:12.719203 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e7ef8d-c62d-462a-83c2-b4e8a81ad803 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:12.727965 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d26efa-8892-4b39-9ceb-9f79c5f94563 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:12.757699 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f201f1d-6da0-4fac-aaaf-8fb63e7b06df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:12.758321 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f201f1d-6da0-4fac-aaaf-8fb63e7b06df None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:12.758603 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f201f1d-6da0-4fac-aaaf-8fb63e7b06df None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:12.758881 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f201f1d-6da0-4fac-aaaf-8fb63e7b06df None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:12.759753 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f201f1d-6da0-4fac-aaaf-8fb63e7b06df None admin] RBAC: Adding query filter params (name=service) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:12.759935 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f201f1d-6da0-4fac-aaaf-8fb63e7b06df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:12.761342 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f201f1d-6da0-4fac-aaaf-8fb63e7b06df None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:12.768494 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846b67aa-6dd3-4600-b6f4-424a4d7b284e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:12.770104 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b67aa-6dd3-4600-b6f4-424a4d7b284e None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:12.770595 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b67aa-6dd3-4600-b6f4-424a4d7b284e None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:12.771068 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b67aa-6dd3-4600-b6f4-424a4d7b284e None admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:12.771612 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 245/491] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Jun 22 08:35:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:12.772680 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f201f1d-6da0-4fac-aaaf-8fb63e7b06df None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:12.773628 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846b67aa-6dd3-4600-b6f4-424a4d7b284e None admin] RBAC: Adding query filter params (name=service) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:12.777341 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846b67aa-6dd3-4600-b6f4-424a4d7b284e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:12.779218 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846b67aa-6dd3-4600-b6f4-424a4d7b284e None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:12.789252 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 247/492] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Jun 22 08:35:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:12.790548 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846b67aa-6dd3-4600-b6f4-424a4d7b284e None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:12.909247 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f201f1d-6da0-4fac-aaaf-8fb63e7b06df None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:12.931737 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846b67aa-6dd3-4600-b6f4-424a4d7b284e None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:12.959604 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ccc3f4-be84-4c75-975a-49c3dfde186c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:12.960865 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ccc3f4-be84-4c75-975a-49c3dfde186c None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:12.961880 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ccc3f4-be84-4c75-975a-49c3dfde186c None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:12.962401 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ccc3f4-be84-4c75-975a-49c3dfde186c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:12.964437 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:12.979596 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ccc3f4-be84-4c75-975a-49c3dfde186c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:12.980480 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3b285c-95f2-4c13-9629-8c861dfc2641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:12.981369 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ccc3f4-be84-4c75-975a-49c3dfde186c None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:12.981688 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b285c-95f2-4c13-9629-8c861dfc2641 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:12.982194 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b285c-95f2-4c13-9629-8c861dfc2641 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:12.982617 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b285c-95f2-4c13-9629-8c861dfc2641 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:12.983979 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:12.998401 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3b285c-95f2-4c13-9629-8c861dfc2641 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:13.000158 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3b285c-95f2-4c13-9629-8c861dfc2641 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:13.003645 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-e3ccc3f4-be84-4c75-975a-49c3dfde186c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:13.003645 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:13.003645 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:13.003645 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:13.003645 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:13.003645 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:13.003645 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:13.003645 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:13.003645 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:13.003645 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:13.003645 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:13.003645 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:13.003645 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:35:13.003645 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:35:13.003645 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:35:13.004629 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:35:13.004629 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:13.004629 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:13.004629 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:13.004629 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:13.004629 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:13.004629 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:13.004629 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:13.004629 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:13.004629 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:13.004629 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:13.004629 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:13.004629 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:13.004629 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:13.004629 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:13.004629 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:13.004629 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:13.005451 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:35:13.005451 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:35:13.005451 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:13.005451 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:13.010031 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 246/493] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:35:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:13.011575 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ccc3f4-be84-4c75-975a-49c3dfde186c None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:13.024122 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-ea3b285c-95f2-4c13-9629-8c861dfc2641 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:13.024122 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:13.024122 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:13.024122 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:13.024122 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:13.024122 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:13.024122 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:13.024122 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:13.024122 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:13.024122 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:13.024122 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:13.024122 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:13.024122 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:35:13.024122 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:35:13.024122 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:35:13.025037 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:35:13.025037 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:13.025037 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:13.025037 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:13.025037 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:13.025037 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:13.025037 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:13.025037 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:13.025037 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:13.025037 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:13.025037 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:13.025037 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:13.025037 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:13.025037 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:13.025037 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:13.025037 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:13.025037 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:13.025890 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:35:13.025890 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:35:13.025890 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:13.025890 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:13.028130 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 248/494] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:35:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:13.035006 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3b285c-95f2-4c13-9629-8c861dfc2641 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:13.129047 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ccc3f4-be84-4c75-975a-49c3dfde186c None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:13.164532 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3b285c-95f2-4c13-9629-8c861dfc2641 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:13.167163 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86a352-b3fe-40e3-93d3-f0a3839ae3bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:13.168389 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86a352-b3fe-40e3-93d3-f0a3839ae3bf None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:13.168389 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86a352-b3fe-40e3-93d3-f0a3839ae3bf None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:13.168572 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86a352-b3fe-40e3-93d3-f0a3839ae3bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:13.180398 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b86a352-b3fe-40e3-93d3-f0a3839ae3bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:13.181869 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b86a352-b3fe-40e3-93d3-f0a3839ae3bf None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:13.199594 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-2b86a352-b3fe-40e3-93d3-f0a3839ae3bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:13.199594 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:13.199594 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:13.199594 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:13.199594 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:13.199594 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:13.199594 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:13.199594 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:13.199594 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:13.199594 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:13.199594 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:13.199594 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:13.199594 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:35:13.199594 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:35:13.199594 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:35:13.200477 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:35:13.200477 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:13.200477 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:13.200477 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:13.200477 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:13.200477 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:13.200477 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:13.200477 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:13.200477 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:13.200477 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:13.200477 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:13.200477 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:13.200477 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:13.200477 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:13.200477 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:13.200477 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:13.200477 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:13.201331 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:35:13.201331 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:35:13.201331 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:13.201331 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:13.201331 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 247/495] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:35:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:13.201599 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86a352-b3fe-40e3-93d3-f0a3839ae3bf None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:13.206784 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817f1a5d-0d0a-4717-9ac7-9a66c911f98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:13.207541 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f1a5d-0d0a-4717-9ac7-9a66c911f98d None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:13.207913 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f1a5d-0d0a-4717-9ac7-9a66c911f98d None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:13.208280 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f1a5d-0d0a-4717-9ac7-9a66c911f98d None admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:13.209078 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817f1a5d-0d0a-4717-9ac7-9a66c911f98d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:13.209459 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817f1a5d-0d0a-4717-9ac7-9a66c911f98d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:13.210991 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817f1a5d-0d0a-4717-9ac7-9a66c911f98d None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:13.225087 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 249/496] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:35:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:13.226867 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d08ce7-f191-478f-b2b5-32e8bc67a7f8 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:13.227154 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d08ce7-f191-478f-b2b5-32e8bc67a7f8 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:13.227431 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d08ce7-f191-478f-b2b5-32e8bc67a7f8 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:13.229137 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 250/497] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:35:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:35:13.229684 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d08ce7-f191-478f-b2b5-32e8bc67a7f8 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:13.256977 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:13.278254 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:13.318760 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86a352-b3fe-40e3-93d3-f0a3839ae3bf None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:13.353110 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d08ce7-f191-478f-b2b5-32e8bc67a7f8 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:13.356554 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd68cb-c735-4e0a-8dc1-04778e55e62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:13.357227 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd68cb-c735-4e0a-8dc1-04778e55e62b None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:13.357516 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd68cb-c735-4e0a-8dc1-04778e55e62b None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:13.357800 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd68cb-c735-4e0a-8dc1-04778e55e62b None admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:13.358577 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fd68cb-c735-4e0a-8dc1-04778e55e62b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:13.358894 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fd68cb-c735-4e0a-8dc1-04778e55e62b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:13.360278 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fd68cb-c735-4e0a-8dc1-04778e55e62b None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:13.372756 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 248/498] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:35:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:13.373719 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd68cb-c735-4e0a-8dc1-04778e55e62b None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:13.396716 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3063135-b8f0-4f32-98b8-4b2b6c5f0942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:13.397388 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3063135-b8f0-4f32-98b8-4b2b6c5f0942 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:13.397720 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3063135-b8f0-4f32-98b8-4b2b6c5f0942 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:13.398003 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3063135-b8f0-4f32-98b8-4b2b6c5f0942 None admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:13.398772 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3063135-b8f0-4f32-98b8-4b2b6c5f0942 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:13.399091 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3063135-b8f0-4f32-98b8-4b2b6c5f0942 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:13.400488 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3063135-b8f0-4f32-98b8-4b2b6c5f0942 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:13.419294 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 251/499] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:35:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:13.419294 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d8348-ea99-432f-b6f2-6286a6a4e42f None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:13.419294 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d8348-ea99-432f-b6f2-6286a6a4e42f None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:13.419294 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d8348-ea99-432f-b6f2-6286a6a4e42f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:13.439156 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-8e0d8348-ea99-432f-b6f2-6286a6a4e42f None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:35:13.440495 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-8e0d8348-ea99-432f-b6f2-6286a6a4e42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:35:13.484489 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd68cb-c735-4e0a-8dc1-04778e55e62b None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:13.495440 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:13.510569 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 252/500] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:35:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:35:13.523135 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0d8348-ea99-432f-b6f2-6286a6a4e42f None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:13.530037 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f69cde9-4cf0-4067-88f1-1b09f5217237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:13.531000 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69cde9-4cf0-4067-88f1-1b09f5217237 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:13.531331 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69cde9-4cf0-4067-88f1-1b09f5217237 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:13.531656 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69cde9-4cf0-4067-88f1-1b09f5217237 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:13.541077 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f69cde9-4cf0-4067-88f1-1b09f5217237 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:13.542605 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f69cde9-4cf0-4067-88f1-1b09f5217237 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:13.556414 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:13.559770 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-3f69cde9-4cf0-4067-88f1-1b09f5217237 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 08:35:13.559770 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:13.559770 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:13.559770 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:13.559770 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:13.559770 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:13.559770 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:13.559770 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:13.559770 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:13.559770 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:13.559770 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:13.559770 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:13.559770 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:35:13.559770 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:35:13.559770 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:35:13.559770 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:35:13.560719 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:13.560719 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:13.560719 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:35:13.560719 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:35:13.560719 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:35:13.560719 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:35:13.560719 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:13.560719 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:13.560719 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:13.560719 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:13.560719 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:13.560719 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:13.560719 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:13.560719 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:13.560719 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:13.560719 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:13.560719 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:13.560719 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:13.561595 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:13.561595 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:13.561595 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:35:13.561595 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:35:13.561595 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:35:13.561595 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:35:13.561595 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:35:13.561595 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:35:13.561595 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 08:35:13.561595 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:13.561595 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 249/501] 10.222.0.42 () {56 vars in 1093 bytes} [Wed Jun 22 08:35:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:13.563132 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f69cde9-4cf0-4067-88f1-1b09f5217237 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:13.644540 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0d8348-ea99-432f-b6f2-6286a6a4e42f None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:13.676225 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f69cde9-4cf0-4067-88f1-1b09f5217237 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:13.679891 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe81bb-98d6-46c7-a2ad-6a407dec85e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:13.680695 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe81bb-98d6-46c7-a2ad-6a407dec85e0 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:13.680974 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe81bb-98d6-46c7-a2ad-6a407dec85e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:13.681248 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe81bb-98d6-46c7-a2ad-6a407dec85e0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:13.688735 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fe81bb-98d6-46c7-a2ad-6a407dec85e0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:13.690334 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fe81bb-98d6-46c7-a2ad-6a407dec85e0 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:13.708454 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-a6fe81bb-98d6-46c7-a2ad-6a407dec85e0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 22 08:35:13.708454 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:13.708454 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:13.708454 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:13.708454 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:13.708454 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:13.708454 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:13.708454 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:13.708454 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:13.708454 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:13.708454 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:13.708454 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:13.708454 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:35:13.708454 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:35:13.708454 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:35:13.708454 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:35:13.709398 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:13.709398 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:13.709398 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:35:13.709398 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:35:13.709398 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:35:13.709398 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:35:13.709398 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:13.709398 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:13.709398 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:13.709398 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:13.709398 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:13.709398 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:13.709398 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:13.709398 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:13.709398 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:13.709398 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:13.709398 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:13.709398 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:13.710870 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:13.710870 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:13.710870 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:35:13.710870 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:35:13.710870 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:35:13.710870 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:35:13.710870 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:35:13.710870 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:35:13.710870 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 22 08:35:13.710870 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:13.710870 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 253/502] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Jun 22 08:35:13 2022] GET /identity/v3/users/glance => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:13.710870 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe81bb-98d6-46c7-a2ad-6a407dec85e0 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:13.717917 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4409115-8f76-4679-ad9b-014463fa785e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:13.718750 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4409115-8f76-4679-ad9b-014463fa785e None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:13.719031 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4409115-8f76-4679-ad9b-014463fa785e None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:13.719301 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4409115-8f76-4679-ad9b-014463fa785e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:13.727582 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4409115-8f76-4679-ad9b-014463fa785e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:13.729048 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4409115-8f76-4679-ad9b-014463fa785e None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:13.745641 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-d4409115-8f76-4679-ad9b-014463fa785e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 08:35:13.745641 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:13.745641 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:13.745641 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:13.745641 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:13.745641 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:13.745641 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:13.745641 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:13.745641 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:13.745641 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:13.745641 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:13.745641 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:13.745641 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:35:13.745641 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:35:13.745641 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:35:13.745641 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:35:13.746790 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:13.746790 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:13.746790 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:35:13.746790 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:35:13.746790 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:35:13.746790 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:35:13.746790 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:13.746790 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:13.746790 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:13.746790 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:13.746790 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:13.746790 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:13.746790 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:13.746790 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:13.746790 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:13.746790 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:13.746790 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:13.746790 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:13.752672 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:13.752672 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:13.752672 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:35:13.752672 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:35:13.752672 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:35:13.752672 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:35:13.752672 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:35:13.752672 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:35:13.752672 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 08:35:13.752672 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:13.752672 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 250/503] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Jun 22 08:35:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:13.752672 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4409115-8f76-4679-ad9b-014463fa785e None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:13.784110 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:13.810723 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:13.828535 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe81bb-98d6-46c7-a2ad-6a407dec85e0 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:13.864792 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4409115-8f76-4679-ad9b-014463fa785e None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:13.867104 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d54bfd-e1a7-414b-8d40-d71b92659c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:13.867998 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d54bfd-e1a7-414b-8d40-d71b92659c3e None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:13.868286 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d54bfd-e1a7-414b-8d40-d71b92659c3e None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:13.868562 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d54bfd-e1a7-414b-8d40-d71b92659c3e None admin] PATH_INFO: `/v3/roles/service` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:13.880889 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d54bfd-e1a7-414b-8d40-d71b92659c3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:35:13.888830 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-43d54bfd-e1a7-414b-8d40-d71b92659c3e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:35:13.888830 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:13.888830 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:13.888830 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:13.888830 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:13.888830 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:13.888830 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:13.888830 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:13.888830 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:13.888830 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:13.888830 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:13.888830 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:13.888830 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:35:13.888830 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:35:13.888830 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:35:13.888830 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:35:13.889748 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:35:13.889748 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:35:13.889748 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:35:13.889748 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:35:13.889748 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:13.889748 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:13.889748 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:13.889748 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:13.889748 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:13.889748 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:13.889748 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:13.889748 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:13.889748 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:13.889748 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:13.889748 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:13.889748 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:13.890892 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:13.890892 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:13.890892 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:13.890892 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:13.890892 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:35:13.890892 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:35:13.890892 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:35:13.890892 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:35:13.890892 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:35:13.890892 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:35:13.890892 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:35:13.890892 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:13.890892 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 254/504] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Jun 22 08:35:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:13.890892 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d54bfd-e1a7-414b-8d40-d71b92659c3e None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:13.909133 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28fa2d0-7501-491a-be11-170222e1da83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:13.909817 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28fa2d0-7501-491a-be11-170222e1da83 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:13.910396 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28fa2d0-7501-491a-be11-170222e1da83 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:13.910396 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28fa2d0-7501-491a-be11-170222e1da83 None admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:13.911248 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28fa2d0-7501-491a-be11-170222e1da83 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:13.911565 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28fa2d0-7501-491a-be11-170222e1da83 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:13.913024 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28fa2d0-7501-491a-be11-170222e1da83 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:13.959081 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 251/505] 10.222.0.42 () {56 vars in 1133 bytes} [Wed Jun 22 08:35:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:13.960002 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28fa2d0-7501-491a-be11-170222e1da83 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:14.020551 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d54bfd-e1a7-414b-8d40-d71b92659c3e None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:14.057562 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe010ae-7a1b-4274-a7b6-e4ed0d64d157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:14.058277 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe010ae-7a1b-4274-a7b6-e4ed0d64d157 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:14.058575 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe010ae-7a1b-4274-a7b6-e4ed0d64d157 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:14.058864 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe010ae-7a1b-4274-a7b6-e4ed0d64d157 None admin] PATH_INFO: `/v3/users` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:14.059711 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe010ae-7a1b-4274-a7b6-e4ed0d64d157 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:14.060028 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe010ae-7a1b-4274-a7b6-e4ed0d64d157 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:14.061618 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe010ae-7a1b-4274-a7b6-e4ed0d64d157 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:14.068450 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:14.095154 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28fa2d0-7501-491a-be11-170222e1da83 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:14.106477 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 255/506] 10.222.0.42 () {56 vars in 1137 bytes} [Wed Jun 22 08:35:13 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:14.107767 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe010ae-7a1b-4274-a7b6-e4ed0d64d157 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:14.112006 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:14.152651 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7822c362-3663-4aca-b50c-6a29fcb396cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:14.153723 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822c362-3663-4aca-b50c-6a29fcb396cc None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:14.154230 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822c362-3663-4aca-b50c-6a29fcb396cc None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:14.154684 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822c362-3663-4aca-b50c-6a29fcb396cc None admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:14.156172 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7822c362-3663-4aca-b50c-6a29fcb396cc None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:14.156696 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7822c362-3663-4aca-b50c-6a29fcb396cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:14.159836 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7822c362-3663-4aca-b50c-6a29fcb396cc None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:14.188282 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 252/507] 10.222.0.42 () {56 vars in 1137 bytes} [Wed Jun 22 08:35:13 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:14.189606 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7822c362-3663-4aca-b50c-6a29fcb396cc None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:14.233015 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe010ae-7a1b-4274-a7b6-e4ed0d64d157 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:14.279032 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97d5d3c-8e18-45a5-bb9e-9985a4fd3689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:14.279703 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d5d3c-8e18-45a5-bb9e-9985a4fd3689 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:14.279989 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d5d3c-8e18-45a5-bb9e-9985a4fd3689 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:14.280270 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d5d3c-8e18-45a5-bb9e-9985a4fd3689 None admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:14.281035 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97d5d3c-8e18-45a5-bb9e-9985a4fd3689 None admin] RBAC: Adding query filter params (name=service) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:14.281346 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97d5d3c-8e18-45a5-bb9e-9985a4fd3689 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:14.282816 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97d5d3c-8e18-45a5-bb9e-9985a4fd3689 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:14.292718 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 256/508] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Jun 22 08:35:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:14.293982 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97d5d3c-8e18-45a5-bb9e-9985a4fd3689 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:14.310377 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7822c362-3663-4aca-b50c-6a29fcb396cc None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:14.350401 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a36f62-5ad5-492c-baf8-774664c64b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:14.351118 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a36f62-5ad5-492c-baf8-774664c64b0c None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:14.351397 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a36f62-5ad5-492c-baf8-774664c64b0c None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:14.351932 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a36f62-5ad5-492c-baf8-774664c64b0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:14.365087 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:14.366317 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:14.407680 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97d5d3c-8e18-45a5-bb9e-9985a4fd3689 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:14.430721 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a36f62-5ad5-492c-baf8-774664c64b0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:14.432285 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a36f62-5ad5-492c-baf8-774664c64b0c None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:14.447680 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b058a-a0f5-4f9d-926f-4c05971ed917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:14.448525 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b058a-a0f5-4f9d-926f-4c05971ed917 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:14.448973 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b058a-a0f5-4f9d-926f-4c05971ed917 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:14.449324 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b058a-a0f5-4f9d-926f-4c05971ed917 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:14.523643 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6b058a-a0f5-4f9d-926f-4c05971ed917 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:14.525207 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6b058a-a0f5-4f9d-926f-4c05971ed917 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:14.552364 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 253/509] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Jun 22 08:35:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:35:14.552364 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042bfd0-e5df-462a-b4e1-c9a3d0d6eb04 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:14.552364 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042bfd0-e5df-462a-b4e1-c9a3d0d6eb04 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:14.552364 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042bfd0-e5df-462a-b4e1-c9a3d0d6eb04 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:14.552364 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 254/510] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:35:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:35:14.553092 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a042bfd0-e5df-462a-b4e1-c9a3d0d6eb04 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:14.600832 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:14.608983 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:14.645670 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 257/511] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Jun 22 08:35:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:35:14.646934 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b058a-a0f5-4f9d-926f-4c05971ed917 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:14.670973 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a042bfd0-e5df-462a-b4e1-c9a3d0d6eb04 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:14.708225 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5690597-8f73-4bcf-8914-1d314858ed46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:14.708874 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5690597-8f73-4bcf-8914-1d314858ed46 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:14.709286 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5690597-8f73-4bcf-8914-1d314858ed46 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:14.709582 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5690597-8f73-4bcf-8914-1d314858ed46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:14.757444 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b058a-a0f5-4f9d-926f-4c05971ed917 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:14.786648 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5690597-8f73-4bcf-8914-1d314858ed46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:14.788060 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5690597-8f73-4bcf-8914-1d314858ed46 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:14.794164 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b066017-ab7b-4de6-a1ef-23250f8d29d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:14.794976 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b066017-ab7b-4de6-a1ef-23250f8d29d4 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:14.795259 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b066017-ab7b-4de6-a1ef-23250f8d29d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:14.795532 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b066017-ab7b-4de6-a1ef-23250f8d29d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:14.807027 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b066017-ab7b-4de6-a1ef-23250f8d29d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:14.808482 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b066017-ab7b-4de6-a1ef-23250f8d29d4 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:14.827019 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-3b066017-ab7b-4de6-a1ef-23250f8d29d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:14.827019 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:14.827019 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:14.827019 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:14.827019 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:14.827019 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:14.827019 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:14.827019 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:14.827019 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:14.827019 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:14.827019 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:14.827019 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:14.827019 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:35:14.827019 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:35:14.827019 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:35:14.828834 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:35:14.828834 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:14.828834 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:14.828834 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:14.828834 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:14.828834 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:14.828834 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:14.828834 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:14.828834 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:14.828834 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:14.828834 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:14.828834 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:14.828834 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:14.828834 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:14.828834 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:14.828834 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:14.828834 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:14.829855 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:35:14.829855 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:35:14.829855 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:14.829855 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:14.829855 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 258/512] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:35:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:14.829855 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b066017-ab7b-4de6-a1ef-23250f8d29d4 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:14.834366 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:14.852459 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:14.900900 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 255/513] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Jun 22 08:35:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:35:14.902238 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddabc74-44a3-4c4b-bd28-5eb047b969fe None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:14.902525 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddabc74-44a3-4c4b-bd28-5eb047b969fe None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:14.902792 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddabc74-44a3-4c4b-bd28-5eb047b969fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:14.920156 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-fddabc74-44a3-4c4b-bd28-5eb047b969fe None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:35:14.921946 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-fddabc74-44a3-4c4b-bd28-5eb047b969fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:35:14.944671 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b066017-ab7b-4de6-a1ef-23250f8d29d4 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:14.987294 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e5b50a-5202-45b2-8249-2e5e24b5e659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:14.988102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5b50a-5202-45b2-8249-2e5e24b5e659 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:14.988430 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5b50a-5202-45b2-8249-2e5e24b5e659 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:14.988716 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5b50a-5202-45b2-8249-2e5e24b5e659 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:14.999492 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e5b50a-5202-45b2-8249-2e5e24b5e659 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:15.000995 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e5b50a-5202-45b2-8249-2e5e24b5e659 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:15.006440 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 256/514] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:35:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:35:15.007321 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddabc74-44a3-4c4b-bd28-5eb047b969fe None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:15.022721 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-c2e5b50a-5202-45b2-8249-2e5e24b5e659 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:15.022721 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:15.022721 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:15.022721 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:15.022721 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:15.022721 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:15.022721 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:15.022721 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:15.022721 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:15.022721 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:15.022721 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:15.022721 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:15.022721 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:35:15.022721 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:35:15.022721 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:35:15.024543 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:35:15.024543 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:15.024543 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:15.024543 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:15.024543 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:15.024543 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:15.024543 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:15.024543 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:15.024543 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:15.024543 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:15.024543 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:15.024543 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:15.024543 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:15.024543 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:15.024543 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:15.024543 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:15.024543 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:15.026267 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:35:15.026267 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:35:15.026267 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:15.026267 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:15.026267 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 259/515] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:35:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:15.026267 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e5b50a-5202-45b2-8249-2e5e24b5e659 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:15.092460 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:15.109536 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:15.125711 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddabc74-44a3-4c4b-bd28-5eb047b969fe None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:15.147196 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e5b50a-5202-45b2-8249-2e5e24b5e659 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:15.163375 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b715f1-d6c7-4ef6-929b-93588c1b43ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:15.164171 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b715f1-d6c7-4ef6-929b-93588c1b43ca None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:15.164454 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b715f1-d6c7-4ef6-929b-93588c1b43ca None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:15.164739 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b715f1-d6c7-4ef6-929b-93588c1b43ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:15.176461 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b715f1-d6c7-4ef6-929b-93588c1b43ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:15.177959 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b715f1-d6c7-4ef6-929b-93588c1b43ca None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:15.183855 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4944f34-30ff-4126-a71f-c6f3ede856e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:15.184608 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4944f34-30ff-4126-a71f-c6f3ede856e7 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:15.184954 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4944f34-30ff-4126-a71f-c6f3ede856e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:15.185306 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4944f34-30ff-4126-a71f-c6f3ede856e7 None admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:15.186310 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4944f34-30ff-4126-a71f-c6f3ede856e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:15.186755 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4944f34-30ff-4126-a71f-c6f3ede856e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:15.188472 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4944f34-30ff-4126-a71f-c6f3ede856e7 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:15.197742 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-d1b715f1-d6c7-4ef6-929b-93588c1b43ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:15.197742 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:15.197742 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:15.197742 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:15.197742 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:15.197742 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:15.197742 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:15.197742 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:15.197742 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:15.197742 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:15.197742 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:15.197742 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:15.197742 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:35:15.197742 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:35:15.197742 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:35:15.198936 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:35:15.198936 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:15.198936 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:15.198936 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:15.198936 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:15.198936 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:15.198936 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:15.198936 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:15.198936 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:15.198936 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:15.198936 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:15.198936 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:15.198936 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:15.198936 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:15.198936 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:15.198936 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:15.198936 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:15.199821 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:35:15.199821 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:35:15.199821 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:15.199821 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:15.202385 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 257/516] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:35:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:15.202986 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 260/517] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:35:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:15.203844 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4944f34-30ff-4126-a71f-c6f3ede856e7 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:15.204683 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b715f1-d6c7-4ef6-929b-93588c1b43ca None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:15.317390 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b715f1-d6c7-4ef6-929b-93588c1b43ca None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:15.318286 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4944f34-30ff-4126-a71f-c6f3ede856e7 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:15.344766 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:15.349913 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:15.359952 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ed0300-69a6-4222-85ff-3b942f96796a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:15.360945 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed0300-69a6-4222-85ff-3b942f96796a None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:15.361657 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed0300-69a6-4222-85ff-3b942f96796a None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:15.362762 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed0300-69a6-4222-85ff-3b942f96796a None admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:15.364032 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ed0300-69a6-4222-85ff-3b942f96796a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:15.364803 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ed0300-69a6-4222-85ff-3b942f96796a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:15.367264 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ed0300-69a6-4222-85ff-3b942f96796a None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:15.370914 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781b723-d28b-4623-be2c-3848348d65ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:15.372088 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781b723-d28b-4623-be2c-3848348d65ae None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:15.372540 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781b723-d28b-4623-be2c-3848348d65ae None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:15.372985 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781b723-d28b-4623-be2c-3848348d65ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:15.383138 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 261/518] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:35:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:15.384325 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ed0300-69a6-4222-85ff-3b942f96796a None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:15.386298 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4781b723-d28b-4623-be2c-3848348d65ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:15.388791 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4781b723-d28b-4623-be2c-3848348d65ae None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:15.409659 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-4781b723-d28b-4623-be2c-3848348d65ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:15.409659 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:15.409659 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:15.409659 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:15.409659 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:15.409659 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:15.409659 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:15.409659 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:15.409659 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:15.409659 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:15.409659 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:15.409659 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:15.409659 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:35:15.409659 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:35:15.409659 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:35:15.410775 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:35:15.410775 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:15.410775 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:15.410775 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:15.410775 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:15.410775 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:15.410775 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:15.410775 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:15.410775 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:15.410775 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:15.410775 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:15.410775 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:15.410775 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:15.410775 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:15.410775 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:15.410775 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:15.410775 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:15.411869 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:35:15.411869 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:35:15.411869 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:15.411869 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:15.411869 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 258/519] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:35:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:15.411869 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781b723-d28b-4623-be2c-3848348d65ae None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:15.498381 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ed0300-69a6-4222-85ff-3b942f96796a None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:15.518208 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781b723-d28b-4623-be2c-3848348d65ae None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:15.537102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045256b-69aa-4e65-8c60-fc248dce3b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:15.537961 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045256b-69aa-4e65-8c60-fc248dce3b14 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:15.538352 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045256b-69aa-4e65-8c60-fc248dce3b14 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:15.538690 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045256b-69aa-4e65-8c60-fc248dce3b14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:15.551843 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0045256b-69aa-4e65-8c60-fc248dce3b14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:15.553290 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0045256b-69aa-4e65-8c60-fc248dce3b14 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:15.554678 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2f64e1-dce8-46aa-b266-c0fe1cf58a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:15.555343 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f64e1-dce8-46aa-b266-c0fe1cf58a1d None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:15.555624 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f64e1-dce8-46aa-b266-c0fe1cf58a1d None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:15.556181 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f64e1-dce8-46aa-b266-c0fe1cf58a1d None admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:15.556618 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2f64e1-dce8-46aa-b266-c0fe1cf58a1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:15.556923 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2f64e1-dce8-46aa-b266-c0fe1cf58a1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:15.558306 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2f64e1-dce8-46aa-b266-c0fe1cf58a1d None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:15.571747 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-0045256b-69aa-4e65-8c60-fc248dce3b14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:15.571747 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:15.571747 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:15.571747 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:15.571747 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:15.571747 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:15.571747 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:15.571747 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:15.571747 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:15.571747 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:15.571747 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:15.571747 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:15.571747 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:35:15.571747 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:35:15.571747 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:35:15.573757 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:35:15.573757 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:15.573757 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:15.573757 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:15.573757 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:15.573757 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:15.573757 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:15.573757 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:15.573757 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:15.573757 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:15.573757 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:15.573757 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:15.573757 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:15.573757 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:15.573757 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:15.573757 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:15.573757 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:15.575471 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:35:15.575471 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:35:15.575471 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:15.575471 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:15.575876 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 259/520] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:35:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:15.575876 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2f64e1-dce8-46aa-b266-c0fe1cf58a1d None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:15.577617 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 262/521] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:35:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:15.578366 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045256b-69aa-4e65-8c60-fc248dce3b14 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:15.614050 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:15.623702 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:15.685877 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2f64e1-dce8-46aa-b266-c0fe1cf58a1d None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:15.688329 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045256b-69aa-4e65-8c60-fc248dce3b14 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:15.721681 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd303ef-153b-4776-ad5d-d922f2f0bb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:15.722516 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd303ef-153b-4776-ad5d-d922f2f0bb50 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:15.722789 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193335aa-6012-4547-af91-e471124061f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:15.722930 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd303ef-153b-4776-ad5d-d922f2f0bb50 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:15.723086 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd303ef-153b-4776-ad5d-d922f2f0bb50 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:15.723581 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193335aa-6012-4547-af91-e471124061f3 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:15.723861 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193335aa-6012-4547-af91-e471124061f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:15.724137 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193335aa-6012-4547-af91-e471124061f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:15.731177 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193335aa-6012-4547-af91-e471124061f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:15.731391 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd303ef-153b-4776-ad5d-d922f2f0bb50 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:15.732641 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193335aa-6012-4547-af91-e471124061f3 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:15.732770 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd303ef-153b-4776-ad5d-d922f2f0bb50 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:15.747715 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-5cd303ef-153b-4776-ad5d-d922f2f0bb50 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 22 08:35:15.747715 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:15.747715 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:15.747715 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:15.747715 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:15.747715 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:15.747715 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:15.747715 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:15.747715 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:15.747715 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:15.747715 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:15.747715 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:15.747715 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:35:15.747715 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:35:15.747715 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:35:15.747715 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:35:15.749621 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:15.749621 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:15.749621 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:35:15.749621 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:35:15.749621 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:35:15.749621 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:35:15.749621 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:15.749621 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:15.749621 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:15.749621 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:15.749621 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:15.749621 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:15.749621 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:15.749621 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:15.749621 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:15.749621 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:15.749621 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:15.749621 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:15.751644 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:15.751644 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:15.751644 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:35:15.751644 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:35:15.751644 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:35:15.751644 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:35:15.751644 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:35:15.751644 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:35:15.751644 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 22 08:35:15.751644 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:15.753987 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-193335aa-6012-4547-af91-e471124061f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:35:15.753987 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:15.753987 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:15.753987 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:15.753987 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:15.753987 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:15.753987 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:15.753987 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:15.753987 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:15.753987 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:15.753987 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:15.753987 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:15.753987 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:35:15.753987 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:35:15.753987 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:35:15.757482 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:35:15.757482 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:15.757482 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:15.757482 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:15.757482 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:15.757482 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:15.757482 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:15.757482 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:15.757482 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:15.757482 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:15.757482 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:15.757482 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:15.757482 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:15.757482 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:15.757482 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:15.757482 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:15.757482 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:15.760221 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:35:15.760221 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:35:15.760221 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:35:15.760221 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:35:15.760221 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:35:15.760221 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:35:15.760221 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:35:15.760221 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:15.761186 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 260/522] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Jun 22 08:35:15 2022] GET /identity/v3/users/neutron => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:15.761186 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd303ef-153b-4776-ad5d-d922f2f0bb50 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:15.761543 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 263/523] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Jun 22 08:35:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:15.761543 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193335aa-6012-4547-af91-e471124061f3 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:15.861114 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:15.864868 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193335aa-6012-4547-af91-e471124061f3 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:15.865476 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:15.872452 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd303ef-153b-4776-ad5d-d922f2f0bb50 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:15.901772 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad5cfc9-5861-4cf5-b8cd-66a00c9f6e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:15.902458 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5cfc9-5861-4cf5-b8cd-66a00c9f6e2d None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:15.902738 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5cfc9-5861-4cf5-b8cd-66a00c9f6e2d None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:15.903016 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5cfc9-5861-4cf5-b8cd-66a00c9f6e2d None admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:15.903743 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad5cfc9-5861-4cf5-b8cd-66a00c9f6e2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:15.904048 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad5cfc9-5861-4cf5-b8cd-66a00c9f6e2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:15.905426 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad5cfc9-5861-4cf5-b8cd-66a00c9f6e2d None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:15.910380 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5045849c-ad9d-4bc9-8077-94fd4658217b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:15.911152 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045849c-ad9d-4bc9-8077-94fd4658217b None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:15.911540 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045849c-ad9d-4bc9-8077-94fd4658217b None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:15.911935 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045849c-ad9d-4bc9-8077-94fd4658217b None admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:15.913004 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5045849c-ad9d-4bc9-8077-94fd4658217b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:15.913403 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5045849c-ad9d-4bc9-8077-94fd4658217b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:15.915133 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5045849c-ad9d-4bc9-8077-94fd4658217b None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:15.918057 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 264/524] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:35:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:15.918902 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad5cfc9-5861-4cf5-b8cd-66a00c9f6e2d None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:15.932394 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 261/525] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:35:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:15.933808 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5045849c-ad9d-4bc9-8077-94fd4658217b None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:16.038131 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad5cfc9-5861-4cf5-b8cd-66a00c9f6e2d None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:16.048408 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5045849c-ad9d-4bc9-8077-94fd4658217b None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:16.075361 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c629f2-4744-46a5-b587-52bbcbe8bb8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:16.076409 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c629f2-4744-46a5-b587-52bbcbe8bb8c None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:16.076683 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c629f2-4744-46a5-b587-52bbcbe8bb8c None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:16.076958 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c629f2-4744-46a5-b587-52bbcbe8bb8c None admin] PATH_INFO: `/v3/projects/service` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:16.083828 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd87ad-afe3-46e5-b8f7-1c5b108ab7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:16.084515 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd87ad-afe3-46e5-b8f7-1c5b108ab7b4 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:16.084675 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c629f2-4744-46a5-b587-52bbcbe8bb8c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:16.084806 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd87ad-afe3-46e5-b8f7-1c5b108ab7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:16.085062 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd87ad-afe3-46e5-b8f7-1c5b108ab7b4 None admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:16.085908 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dd87ad-afe3-46e5-b8f7-1c5b108ab7b4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:16.086137 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c629f2-4744-46a5-b587-52bbcbe8bb8c None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:16.086266 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dd87ad-afe3-46e5-b8f7-1c5b108ab7b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:16.087681 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dd87ad-afe3-46e5-b8f7-1c5b108ab7b4 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:16.100854 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-52c629f2-4744-46a5-b587-52bbcbe8bb8c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:35:16.100854 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:16.100854 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:16.100854 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:16.100854 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:16.100854 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:16.100854 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:16.100854 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:16.100854 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:16.100854 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:16.100854 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:16.100854 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:16.100854 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:35:16.100854 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:35:16.100854 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:35:16.102612 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:35:16.102612 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:16.102612 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:16.102612 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:16.102612 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:16.102612 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:16.102612 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:16.102612 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:16.102612 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:16.102612 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:16.102612 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:16.102612 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:16.102612 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:16.102612 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:16.102612 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:16.102612 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:16.102612 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:16.103725 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:35:16.103725 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:35:16.103725 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:35:16.103725 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:35:16.103725 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:35:16.103725 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:35:16.103725 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:35:16.103725 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:16.103725 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 265/526] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Jun 22 08:35:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:16.103725 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c629f2-4744-46a5-b587-52bbcbe8bb8c None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:16.109406 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 262/527] 10.222.0.42 () {56 vars in 1139 bytes} [Wed Jun 22 08:35:15 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:16.111309 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd87ad-afe3-46e5-b8f7-1c5b108ab7b4 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:16.130554 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:16.131100 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:16.238274 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c629f2-4744-46a5-b587-52bbcbe8bb8c None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:16.244277 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd87ad-afe3-46e5-b8f7-1c5b108ab7b4 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:16.275156 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8908f9-12e9-4a6d-bc3d-7e80fa580268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:16.276001 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8908f9-12e9-4a6d-bc3d-7e80fa580268 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:16.276373 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8908f9-12e9-4a6d-bc3d-7e80fa580268 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:16.276783 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8908f9-12e9-4a6d-bc3d-7e80fa580268 None admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:16.277747 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8908f9-12e9-4a6d-bc3d-7e80fa580268 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:16.278191 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8908f9-12e9-4a6d-bc3d-7e80fa580268 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:16.279829 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8908f9-12e9-4a6d-bc3d-7e80fa580268 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:16.284036 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678a7eb-7c22-4340-befc-8805ac09fefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:16.284704 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678a7eb-7c22-4340-befc-8805ac09fefe None admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:16.284975 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678a7eb-7c22-4340-befc-8805ac09fefe None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:16.285256 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678a7eb-7c22-4340-befc-8805ac09fefe None admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:16.285972 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f678a7eb-7c22-4340-befc-8805ac09fefe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:16.287456 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f678a7eb-7c22-4340-befc-8805ac09fefe None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:16.301464 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 266/528] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Jun 22 08:35:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:16.302414 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8908f9-12e9-4a6d-bc3d-7e80fa580268 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:16.323485 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 263/529] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Jun 22 08:35:16 2022] POST /identity/v3/users => generated 247 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:35:16.323485 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678a7eb-7c22-4340-befc-8805ac09fefe None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:16.412136 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:16.412853 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:16.443870 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8908f9-12e9-4a6d-bc3d-7e80fa580268 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:16.466741 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678a7eb-7c22-4340-befc-8805ac09fefe None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:16.496846 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6721a2-0d24-4193-8ef8-4eece26a256a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:16.497656 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6721a2-0d24-4193-8ef8-4eece26a256a None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:16.497940 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6721a2-0d24-4193-8ef8-4eece26a256a None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:16.499296 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6721a2-0d24-4193-8ef8-4eece26a256a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:16.507448 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6721a2-0d24-4193-8ef8-4eece26a256a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:16.508975 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6721a2-0d24-4193-8ef8-4eece26a256a None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:16.512688 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c70c43-590a-4440-ab82-a5be823d541c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:16.513239 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c70c43-590a-4440-ab82-a5be823d541c None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:16.514399 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c70c43-590a-4440-ab82-a5be823d541c None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:16.517482 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c70c43-590a-4440-ab82-a5be823d541c None admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:16.517482 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c70c43-590a-4440-ab82-a5be823d541c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:16.517482 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c70c43-590a-4440-ab82-a5be823d541c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:16.519449 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c70c43-590a-4440-ab82-a5be823d541c None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:16.533887 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-bb6721a2-0d24-4193-8ef8-4eece26a256a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:35:16.533887 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:16.533887 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:16.533887 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:16.533887 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:16.533887 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:16.533887 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:16.533887 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:16.533887 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:16.533887 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:16.533887 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:16.533887 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:16.533887 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:35:16.533887 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:35:16.533887 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:35:16.534987 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:35:16.534987 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:16.534987 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:16.534987 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:16.534987 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:16.534987 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:16.534987 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:16.534987 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:16.534987 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:16.534987 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:16.534987 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:16.534987 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:16.534987 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:16.534987 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:16.534987 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:16.534987 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:16.534987 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:16.536080 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:35:16.536080 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:35:16.536080 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:35:16.536080 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:35:16.536080 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:35:16.536080 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:35:16.536080 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:35:16.536080 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:16.536628 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 267/530] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Jun 22 08:35:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:16.537656 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6721a2-0d24-4193-8ef8-4eece26a256a None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:16.549493 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 264/531] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Jun 22 08:35:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:16.550750 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c70c43-590a-4440-ab82-a5be823d541c None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:16.672478 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c70c43-590a-4440-ab82-a5be823d541c None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:16.676181 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6721a2-0d24-4193-8ef8-4eece26a256a None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:16.709240 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:16.718246 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22002fb0-35fd-451b-8614-848230d5981a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:16.718921 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22002fb0-35fd-451b-8614-848230d5981a None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:16.719209 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22002fb0-35fd-451b-8614-848230d5981a None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:16.719503 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22002fb0-35fd-451b-8614-848230d5981a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:16.720364 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22002fb0-35fd-451b-8614-848230d5981a None admin] RBAC: Adding query filter params (role.id=e67c237283fd404d9a2bdf1333109696, scope.project.id=e1f161193cb440fa8c4a9d23820a5c28, user.id=4f1809a35b244c1db7a185d82859369e) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:16.721237 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22002fb0-35fd-451b-8614-848230d5981a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:16.721389 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabcf387-80de-49f9-974f-79412e89d5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:16.722147 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabcf387-80de-49f9-974f-79412e89d5bb None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:16.722572 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabcf387-80de-49f9-974f-79412e89d5bb None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:16.722726 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22002fb0-35fd-451b-8614-848230d5981a None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:16.723037 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabcf387-80de-49f9-974f-79412e89d5bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:16.737144 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 265/532] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Jun 22 08:35:16 2022] GET /identity/v3/role_assignments?user.id=4f1809a35b244c1db7a185d82859369e&scope.project.id=e1f161193cb440fa8c4a9d23820a5c28&role.id=e67c237283fd404d9a2bdf1333109696 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:16.737144 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22002fb0-35fd-451b-8614-848230d5981a None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:16.741552 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:16.869758 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabcf387-80de-49f9-974f-79412e89d5bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:16.872927 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabcf387-80de-49f9-974f-79412e89d5bb None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:16.903301 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22002fb0-35fd-451b-8614-848230d5981a None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:16.974225 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a41edbd-0b45-4b8a-975b-dbf9b437d9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:16.974225 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a41edbd-0b45-4b8a-975b-dbf9b437d9f9 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:16.974225 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a41edbd-0b45-4b8a-975b-dbf9b437d9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:16.974225 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a41edbd-0b45-4b8a-975b-dbf9b437d9f9 None admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:16.975584 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a41edbd-0b45-4b8a-975b-dbf9b437d9f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:16.975584 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a41edbd-0b45-4b8a-975b-dbf9b437d9f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:16.976250 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a41edbd-0b45-4b8a-975b-dbf9b437d9f9 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:17.003624 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 266/533] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Jun 22 08:35:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:17.005288 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a41edbd-0b45-4b8a-975b-dbf9b437d9f9 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:17.063759 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 268/534] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Jun 22 08:35:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:35:17.065393 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabcf387-80de-49f9-974f-79412e89d5bb None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:17.124234 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:17.133303 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:17.212648 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabcf387-80de-49f9-974f-79412e89d5bb None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:17.215306 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a41edbd-0b45-4b8a-975b-dbf9b437d9f9 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:17.255320 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a756d4-ec71-410c-ae85-35966b617562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:17.255993 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a756d4-ec71-410c-ae85-35966b617562 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:17.256278 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a756d4-ec71-410c-ae85-35966b617562 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:17.256602 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a756d4-ec71-410c-ae85-35966b617562 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:17.257628 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a756d4-ec71-410c-ae85-35966b617562 None admin] RBAC: Adding query filter params (role.id=e67c237283fd404d9a2bdf1333109696, scope.project.id=e1f161193cb440fa8c4a9d23820a5c28, user.id=b4a2701c65144851ad87ac77fccb686f) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:17.257947 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a756d4-ec71-410c-ae85-35966b617562 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:17.259640 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a756d4-ec71-410c-ae85-35966b617562 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:17.267855 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 269/535] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Jun 22 08:35:17 2022] GET /identity/v3/role_assignments?user.id=b4a2701c65144851ad87ac77fccb686f&scope.project.id=e1f161193cb440fa8c4a9d23820a5c28&role.id=e67c237283fd404d9a2bdf1333109696 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:17.268883 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a756d4-ec71-410c-ae85-35966b617562 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:17.288536 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff16069-f0fa-45b9-b9f8-37417c24adbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:17.290275 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff16069-f0fa-45b9-b9f8-37417c24adbf None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:17.291192 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff16069-f0fa-45b9-b9f8-37417c24adbf None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:17.292087 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff16069-f0fa-45b9-b9f8-37417c24adbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:17.294497 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff16069-f0fa-45b9-b9f8-37417c24adbf None admin] RBAC: Adding query filter params (role.id=e67c237283fd404d9a2bdf1333109696, scope.project.id=e1f161193cb440fa8c4a9d23820a5c28, user.id=589eb8cc97714580840ac7a48ea38ee8) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:17.295632 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff16069-f0fa-45b9-b9f8-37417c24adbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:17.299617 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff16069-f0fa-45b9-b9f8-37417c24adbf None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:17.326765 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 267/536] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Jun 22 08:35:17 2022] GET /identity/v3/role_assignments?user.id=589eb8cc97714580840ac7a48ea38ee8&scope.project.id=e1f161193cb440fa8c4a9d23820a5c28&role.id=e67c237283fd404d9a2bdf1333109696 => generated 259 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:17.421270 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a756d4-ec71-410c-ae85-35966b617562 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:17.425558 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:17.470785 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e528a78-9b76-4b1b-be66-c55babd97460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:17.471616 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e528a78-9b76-4b1b-be66-c55babd97460 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:17.471937 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e528a78-9b76-4b1b-be66-c55babd97460 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:17.472219 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e528a78-9b76-4b1b-be66-c55babd97460 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:17.484703 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e528a78-9b76-4b1b-be66-c55babd97460 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:17.486311 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e528a78-9b76-4b1b-be66-c55babd97460 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:17.508225 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-2e528a78-9b76-4b1b-be66-c55babd97460 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:17.508225 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:17.508225 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:17.508225 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:17.508225 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:17.508225 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:17.508225 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:17.508225 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:17.508225 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:17.508225 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:17.508225 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:17.508225 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:17.508225 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:35:17.508225 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:35:17.508225 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:35:17.509996 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:35:17.509996 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:17.509996 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:17.509996 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:17.509996 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:17.509996 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:17.509996 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:17.509996 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:17.509996 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:17.509996 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:17.509996 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:17.509996 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:17.509996 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:17.509996 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:17.509996 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:17.509996 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:17.509996 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:17.511882 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:35:17.511882 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:35:17.511882 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:17.511882 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:17.511882 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 270/537] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:35:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:17.515170 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff16069-f0fa-45b9-b9f8-37417c24adbf None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:17.676191 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff16069-f0fa-45b9-b9f8-37417c24adbf None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:17.695792 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:17.720190 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb634178-a210-443d-b504-b46f6d628eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:17.721410 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb634178-a210-443d-b504-b46f6d628eee None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:17.721697 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb634178-a210-443d-b504-b46f6d628eee None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:17.721975 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb634178-a210-443d-b504-b46f6d628eee None admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:17.722751 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb634178-a210-443d-b504-b46f6d628eee None admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:17.723060 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb634178-a210-443d-b504-b46f6d628eee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:17.724485 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb634178-a210-443d-b504-b46f6d628eee None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:17.745775 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 268/538] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:35:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:17.751446 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e528a78-9b76-4b1b-be66-c55babd97460 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:17.925924 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e528a78-9b76-4b1b-be66-c55babd97460 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:17.979107 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1986f391-0b56-46d7-9226-71fd40a0e40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:17.979919 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1986f391-0b56-46d7-9226-71fd40a0e40e None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:17.980213 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1986f391-0b56-46d7-9226-71fd40a0e40e None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:17.980478 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1986f391-0b56-46d7-9226-71fd40a0e40e None admin] PATH_INFO: `/v3/projects/service` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:17.999610 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1986f391-0b56-46d7-9226-71fd40a0e40e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:18.001110 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1986f391-0b56-46d7-9226-71fd40a0e40e None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:18.018979 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-1986f391-0b56-46d7-9226-71fd40a0e40e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:35:18.018979 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:18.018979 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:18.018979 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:18.018979 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:18.018979 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:18.018979 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:18.018979 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:18.018979 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:18.018979 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:18.018979 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:18.018979 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:18.018979 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:35:18.018979 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:35:18.018979 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:35:18.020780 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:35:18.020780 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:18.020780 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:18.020780 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:18.020780 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:18.020780 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:18.020780 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:18.020780 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:18.020780 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:18.020780 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:18.020780 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:18.020780 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:18.020780 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:18.020780 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:18.020780 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:18.020780 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:18.020780 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:18.022374 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:35:18.022374 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:35:18.022374 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:35:18.022374 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:35:18.022374 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:35:18.022374 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:35:18.022374 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:35:18.022374 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:18.022374 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 271/539] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Jun 22 08:35:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:18.026403 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb634178-a210-443d-b504-b46f6d628eee None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:18.208810 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb634178-a210-443d-b504-b46f6d628eee None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:18.273857 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa38e16-f257-46b9-988c-0431355f8120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:18.275049 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa38e16-f257-46b9-988c-0431355f8120 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:18.275555 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa38e16-f257-46b9-988c-0431355f8120 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:18.276057 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa38e16-f257-46b9-988c-0431355f8120 None admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:18.277444 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa38e16-f257-46b9-988c-0431355f8120 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:18.278026 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa38e16-f257-46b9-988c-0431355f8120 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:18.280660 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa38e16-f257-46b9-988c-0431355f8120 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:18.310927 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 269/540] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Jun 22 08:35:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:18.317728 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1986f391-0b56-46d7-9226-71fd40a0e40e None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:18.354418 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:18.485650 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1986f391-0b56-46d7-9226-71fd40a0e40e None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:18.533143 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1945ca-ce35-4de5-9022-426cfb3b314c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:18.534353 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1945ca-ce35-4de5-9022-426cfb3b314c None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:18.534642 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1945ca-ce35-4de5-9022-426cfb3b314c None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:18.534921 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1945ca-ce35-4de5-9022-426cfb3b314c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:18.535779 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1945ca-ce35-4de5-9022-426cfb3b314c None admin] RBAC: Adding query filter params (role.id=e67c237283fd404d9a2bdf1333109696, scope.project.id=e1f161193cb440fa8c4a9d23820a5c28, user.id=751f037ff70d4eb8acb4e8d4c5c487ad) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:18.536095 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1945ca-ce35-4de5-9022-426cfb3b314c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:18.537609 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1945ca-ce35-4de5-9022-426cfb3b314c None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:18.549247 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 272/541] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Jun 22 08:35:18 2022] GET /identity/v3/role_assignments?user.id=751f037ff70d4eb8acb4e8d4c5c487ad&scope.project.id=e1f161193cb440fa8c4a9d23820a5c28&role.id=e67c237283fd404d9a2bdf1333109696 => generated 259 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:18.890526 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e4783-bb2d-4085-82f1-65992e036b8c None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:18.890992 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e4783-bb2d-4085-82f1-65992e036b8c None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:18.891446 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e4783-bb2d-4085-82f1-65992e036b8c None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:18.895191 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 270/542] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:35:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:35:18.901793 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d0852-0aa3-4679-95fe-12f4a399782e None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:18.902324 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d0852-0aa3-4679-95fe-12f4a399782e None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:18.902805 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d0852-0aa3-4679-95fe-12f4a399782e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:18.928874 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-cc5d0852-0aa3-4679-95fe-12f4a399782e None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:35:18.930842 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-cc5d0852-0aa3-4679-95fe-12f4a399782e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:35:19.058595 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 273/543] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:35:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:35:19.116354 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e4783-bb2d-4085-82f1-65992e036b8c None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:19.203239 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:19.329423 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a3eef-c894-4511-978d-66ce1fe782ad None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:19.330579 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a3eef-c894-4511-978d-66ce1fe782ad None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:19.331361 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a3eef-c894-4511-978d-66ce1fe782ad None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:19.334605 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 274/544] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:35:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:35:19.342325 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403780e7-530b-4ae0-99a0-8badce7eefc1 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:19.343387 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403780e7-530b-4ae0-99a0-8badce7eefc1 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:19.344159 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403780e7-530b-4ae0-99a0-8badce7eefc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:19.354113 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e4783-bb2d-4085-82f1-65992e036b8c None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:19.383923 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-403780e7-530b-4ae0-99a0-8badce7eefc1 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:35:19.387790 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-403780e7-530b-4ae0-99a0-8badce7eefc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:35:19.403665 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:19.425707 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e81d4-e306-4b75-af40-a184dca1cfbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:19.426552 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e81d4-e306-4b75-af40-a184dca1cfbf None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:19.426968 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e81d4-e306-4b75-af40-a184dca1cfbf None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:19.427120 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e81d4-e306-4b75-af40-a184dca1cfbf None admin] PATH_INFO: `/v3/roles/service` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:19.451811 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74e81d4-e306-4b75-af40-a184dca1cfbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:35:19.467866 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-a74e81d4-e306-4b75-af40-a184dca1cfbf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:35:19.467866 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:19.467866 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:19.467866 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:19.467866 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:19.467866 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:19.467866 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:19.467866 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:19.467866 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:19.467866 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:19.467866 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:19.467866 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:19.467866 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:35:19.467866 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:35:19.467866 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:35:19.467866 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:35:19.469580 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:35:19.469580 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:35:19.469580 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:35:19.469580 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:35:19.469580 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:19.469580 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:19.469580 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:19.469580 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:19.469580 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:19.469580 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:19.469580 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:19.469580 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:19.469580 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:19.469580 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:19.469580 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:19.469580 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:19.471755 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:19.471755 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:19.471755 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:19.471755 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:19.471755 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:35:19.471755 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:35:19.471755 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:35:19.471755 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:35:19.471755 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:35:19.471755 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:35:19.471755 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:35:19.471755 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:19.476682 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 271/545] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Jun 22 08:35:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:19.478046 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e81d4-e306-4b75-af40-a184dca1cfbf None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:19.573787 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 275/546] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:35:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:35:19.609047 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403780e7-530b-4ae0-99a0-8badce7eefc1 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:19.693180 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:19.703713 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e81d4-e306-4b75-af40-a184dca1cfbf None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:19.773286 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e06c08-9f4b-4bce-930f-559920e3bd73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:19.773863 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e06c08-9f4b-4bce-930f-559920e3bd73 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:19.774180 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e06c08-9f4b-4bce-930f-559920e3bd73 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:19.774459 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e06c08-9f4b-4bce-930f-559920e3bd73 None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:19.775221 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e06c08-9f4b-4bce-930f-559920e3bd73 None admin] RBAC: Adding query filter params (name=service) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:19.775529 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e06c08-9f4b-4bce-930f-559920e3bd73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:19.776938 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e06c08-9f4b-4bce-930f-559920e3bd73 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:19.786844 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 272/547] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Jun 22 08:35:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:19.795338 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e06c08-9f4b-4bce-930f-559920e3bd73 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:19.887602 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403780e7-530b-4ae0-99a0-8badce7eefc1 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:19.929898 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c280ef3d-4f21-4af1-bca3-a9cfe1ddb632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:19.931124 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c280ef3d-4f21-4af1-bca3-a9cfe1ddb632 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:19.931276 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c280ef3d-4f21-4af1-bca3-a9cfe1ddb632 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:19.931523 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c280ef3d-4f21-4af1-bca3-a9cfe1ddb632 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:19.944187 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:19.948198 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c280ef3d-4f21-4af1-bca3-a9cfe1ddb632 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:35:19.957719 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-c280ef3d-4f21-4af1-bca3-a9cfe1ddb632 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:35:19.957719 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:19.957719 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:19.957719 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:19.957719 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:19.957719 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:19.957719 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:19.957719 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:19.957719 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:19.957719 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:19.957719 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:19.957719 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:19.957719 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:35:19.957719 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:35:19.957719 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:35:19.957719 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:35:19.959335 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:35:19.959335 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:35:19.959335 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:35:19.959335 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:35:19.959335 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:19.959335 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:19.959335 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:19.959335 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:19.959335 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:19.959335 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:19.959335 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:19.959335 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:19.959335 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:19.959335 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:19.959335 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:19.959335 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:19.960899 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:19.960899 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:19.960899 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:19.960899 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:19.960899 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:35:19.960899 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:35:19.960899 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:35:19.960899 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:35:19.960899 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:35:19.960899 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:35:19.960899 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:35:19.960899 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:19.960899 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 276/548] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Jun 22 08:35:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:19.967901 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c280ef3d-4f21-4af1-bca3-a9cfe1ddb632 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:20.030302 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e06c08-9f4b-4bce-930f-559920e3bd73 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:20.074029 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea72718d-4d61-48f3-a675-9b7fce6edfe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:20.074864 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72718d-4d61-48f3-a675-9b7fce6edfe8 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:20.075158 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72718d-4d61-48f3-a675-9b7fce6edfe8 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:20.075450 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72718d-4d61-48f3-a675-9b7fce6edfe8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:20.087735 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea72718d-4d61-48f3-a675-9b7fce6edfe8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:20.089472 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea72718d-4d61-48f3-a675-9b7fce6edfe8 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:20.092708 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c280ef3d-4f21-4af1-bca3-a9cfe1ddb632 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:20.129052 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd726e1d-d3f3-40bf-9008-79b9b7b0801c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:20.129726 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd726e1d-d3f3-40bf-9008-79b9b7b0801c None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:20.130006 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd726e1d-d3f3-40bf-9008-79b9b7b0801c None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:20.130315 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd726e1d-d3f3-40bf-9008-79b9b7b0801c None admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:20.131222 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd726e1d-d3f3-40bf-9008-79b9b7b0801c None admin] RBAC: Adding query filter params (name=service) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:20.131643 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd726e1d-d3f3-40bf-9008-79b9b7b0801c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:20.132017 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-ea72718d-4d61-48f3-a675-9b7fce6edfe8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:20.132017 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:20.132017 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:20.132017 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:20.132017 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:20.132017 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:20.132017 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:20.132017 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:20.132017 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:20.132017 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:20.132017 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:20.132017 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:20.132017 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:35:20.132017 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:35:20.132017 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:35:20.134996 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:35:20.134996 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:20.134996 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:20.134996 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:20.134996 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:20.134996 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:20.134996 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:20.134996 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:20.134996 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:20.134996 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:20.134996 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:20.134996 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:20.134996 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:20.134996 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:20.134996 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:20.134996 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:20.134996 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:20.141403 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:35:20.141403 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:35:20.141403 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:20.141403 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:20.142374 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd726e1d-d3f3-40bf-9008-79b9b7b0801c None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:20.142610 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 273/549] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:35:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:20.142610 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea72718d-4d61-48f3-a675-9b7fce6edfe8 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:20.144312 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 277/550] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Jun 22 08:35:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:20.155251 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd726e1d-d3f3-40bf-9008-79b9b7b0801c None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:20.166779 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:20.265646 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea72718d-4d61-48f3-a675-9b7fce6edfe8 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:20.319420 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961521dd-2a71-4550-a954-a40700b29391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:20.320024 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961521dd-2a71-4550-a954-a40700b29391 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:20.321739 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961521dd-2a71-4550-a954-a40700b29391 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:20.322037 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961521dd-2a71-4550-a954-a40700b29391 None admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:20.322857 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961521dd-2a71-4550-a954-a40700b29391 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:20.323176 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961521dd-2a71-4550-a954-a40700b29391 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:20.324664 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961521dd-2a71-4550-a954-a40700b29391 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:20.349674 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:20.370600 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 274/551] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:35:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:20.377770 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961521dd-2a71-4550-a954-a40700b29391 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:20.474920 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:20.488227 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd726e1d-d3f3-40bf-9008-79b9b7b0801c None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:20.510111 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961521dd-2a71-4550-a954-a40700b29391 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:20.551779 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97de143f-b9bf-4ab3-9495-deffba0ef8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:20.552743 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de143f-b9bf-4ab3-9495-deffba0ef8e4 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:20.553053 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de143f-b9bf-4ab3-9495-deffba0ef8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:20.553325 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de143f-b9bf-4ab3-9495-deffba0ef8e4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:20.561705 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97de143f-b9bf-4ab3-9495-deffba0ef8e4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:20.563565 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97de143f-b9bf-4ab3-9495-deffba0ef8e4 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:20.581373 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-97de143f-b9bf-4ab3-9495-deffba0ef8e4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 22 08:35:20.581373 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:20.581373 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:20.581373 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:20.581373 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:20.581373 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:20.581373 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:20.581373 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:20.581373 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:20.581373 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:20.581373 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:20.581373 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:20.581373 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:35:20.581373 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:35:20.581373 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:35:20.581373 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:35:20.583292 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:20.583292 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:20.583292 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:35:20.583292 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:35:20.583292 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:35:20.583292 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:35:20.583292 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:20.583292 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:20.583292 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:20.583292 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:20.583292 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:20.583292 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:20.583292 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:20.583292 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:20.583292 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:20.583292 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:20.583292 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:20.583292 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:20.585142 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:20.585142 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:20.585142 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:35:20.585142 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:35:20.585142 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:35:20.585142 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:35:20.585142 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:35:20.585142 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:35:20.585142 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 22 08:35:20.585142 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:20.585142 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 275/552] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Jun 22 08:35:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:20.596182 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97de143f-b9bf-4ab3-9495-deffba0ef8e4 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:20.609622 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bb3272-16c4-47f3-a336-b893b7d31fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:20.610486 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb3272-16c4-47f3-a336-b893b7d31fbd None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:20.610865 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb3272-16c4-47f3-a336-b893b7d31fbd None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:20.611485 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb3272-16c4-47f3-a336-b893b7d31fbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:20.639372 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bb3272-16c4-47f3-a336-b893b7d31fbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:20.640853 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bb3272-16c4-47f3-a336-b893b7d31fbd None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:20.682929 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-e8bb3272-16c4-47f3-a336-b893b7d31fbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:20.682929 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:20.682929 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:20.682929 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:20.682929 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:20.682929 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:20.682929 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:20.682929 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:20.682929 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:20.682929 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:20.682929 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:20.682929 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:20.682929 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:35:20.682929 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:35:20.682929 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:35:20.686589 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:35:20.686589 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:20.686589 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:20.686589 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:20.686589 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:20.686589 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:20.686589 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:20.686589 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:20.686589 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:20.686589 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:20.686589 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:20.686589 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:20.686589 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:20.686589 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:20.686589 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:20.686589 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:20.686589 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:20.694622 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:35:20.694622 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:35:20.694622 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:20.694622 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:20.694622 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 278/553] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:35:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 529 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:20.696982 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bb3272-16c4-47f3-a336-b893b7d31fbd None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:20.777033 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97de143f-b9bf-4ab3-9495-deffba0ef8e4 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:20.815661 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:20.822860 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3520a4-1f8d-420a-bf49-484f7f0af396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:20.824113 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3520a4-1f8d-420a-bf49-484f7f0af396 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:20.824931 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3520a4-1f8d-420a-bf49-484f7f0af396 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:20.825235 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3520a4-1f8d-420a-bf49-484f7f0af396 None admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:20.826111 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3520a4-1f8d-420a-bf49-484f7f0af396 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:20.826426 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3520a4-1f8d-420a-bf49-484f7f0af396 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:20.827914 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3520a4-1f8d-420a-bf49-484f7f0af396 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:20.856818 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 276/554] 10.222.0.42 () {56 vars in 1135 bytes} [Wed Jun 22 08:35:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:20.856818 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1425735-c603-42b9-8f19-d76b799c3860 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:20.856818 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1425735-c603-42b9-8f19-d76b799c3860 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:20.856818 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1425735-c603-42b9-8f19-d76b799c3860 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:20.856818 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 277/555] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:35:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:35:20.858267 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1425735-c603-42b9-8f19-d76b799c3860 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:20.900449 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bb3272-16c4-47f3-a336-b893b7d31fbd None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:20.924389 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:20.957029 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec56c166-c7bb-416d-974b-9a9f1762279c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:20.959356 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56c166-c7bb-416d-974b-9a9f1762279c None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:20.960105 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56c166-c7bb-416d-974b-9a9f1762279c None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:20.960683 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56c166-c7bb-416d-974b-9a9f1762279c None admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:20.961793 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec56c166-c7bb-416d-974b-9a9f1762279c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:20.962344 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec56c166-c7bb-416d-974b-9a9f1762279c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:20.964750 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec56c166-c7bb-416d-974b-9a9f1762279c None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:20.989776 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 279/556] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:35:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:20.989776 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f16a3b-dd78-440a-b0fe-a7887eab55c8 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:20.989776 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f16a3b-dd78-440a-b0fe-a7887eab55c8 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:20.989776 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f16a3b-dd78-440a-b0fe-a7887eab55c8 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:20.990732 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 280/557] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:35:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:35:20.992017 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f702f12-855c-426f-8262-408c571031ae None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:20.992521 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f702f12-855c-426f-8262-408c571031ae None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:20.992998 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f702f12-855c-426f-8262-408c571031ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:21.018531 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-6f702f12-855c-426f-8262-408c571031ae None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:35:21.020632 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-6f702f12-855c-426f-8262-408c571031ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:35:21.035579 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1425735-c603-42b9-8f19-d76b799c3860 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:21.101695 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ab1b11-e266-4f9f-a14c-b96decab3775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:21.102755 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab1b11-e266-4f9f-a14c-b96decab3775 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:21.103227 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab1b11-e266-4f9f-a14c-b96decab3775 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:21.103701 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab1b11-e266-4f9f-a14c-b96decab3775 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:21.138872 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 281/558] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:35:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:35:21.140463 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f702f12-855c-426f-8262-408c571031ae None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:21.201734 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:21.216511 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ab1b11-e266-4f9f-a14c-b96decab3775 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:21.218621 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ab1b11-e266-4f9f-a14c-b96decab3775 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:21.277448 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f702f12-855c-426f-8262-408c571031ae None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:21.281036 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:21.334025 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9416403-36d3-49b5-85ea-67186bdc7de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:21.335533 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9416403-36d3-49b5-85ea-67186bdc7de5 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:21.335988 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9416403-36d3-49b5-85ea-67186bdc7de5 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:21.336503 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9416403-36d3-49b5-85ea-67186bdc7de5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:21.349157 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 278/559] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Jun 22 08:35:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:35:21.349157 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69a8a5-72ca-4b4b-a556-7d41d461fe70 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:21.349157 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69a8a5-72ca-4b4b-a556-7d41d461fe70 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:21.349157 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69a8a5-72ca-4b4b-a556-7d41d461fe70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:21.352306 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9416403-36d3-49b5-85ea-67186bdc7de5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:21.355106 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9416403-36d3-49b5-85ea-67186bdc7de5 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:21.366147 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-4f69a8a5-72ca-4b4b-a556-7d41d461fe70 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:35:21.367363 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-4f69a8a5-72ca-4b4b-a556-7d41d461fe70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:35:21.383627 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-f9416403-36d3-49b5-85ea-67186bdc7de5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 08:35:21.383627 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:21.383627 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:21.383627 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:21.383627 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:21.383627 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:21.383627 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:21.383627 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:21.383627 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:21.383627 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:21.383627 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:21.383627 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:21.383627 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:35:21.383627 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:35:21.383627 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:35:21.383627 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:35:21.384591 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:21.384591 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:21.384591 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:35:21.384591 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:35:21.384591 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:35:21.384591 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:35:21.384591 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:21.384591 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:21.384591 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:21.384591 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:21.384591 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:21.384591 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:21.384591 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:21.384591 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:21.384591 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:21.384591 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:21.384591 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:21.384591 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:21.385561 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:21.385561 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:21.385561 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:35:21.385561 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:35:21.385561 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:35:21.385561 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:35:21.385561 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:35:21.385561 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:35:21.385561 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 08:35:21.385561 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:21.386173 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 282/560] 10.222.0.42 () {56 vars in 1093 bytes} [Wed Jun 22 08:35:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:21.387350 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9416403-36d3-49b5-85ea-67186bdc7de5 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:21.452693 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 279/561] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:35:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:35:21.453914 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f69a8a5-72ca-4b4b-a556-7d41d461fe70 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:21.485844 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:21.528451 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9416403-36d3-49b5-85ea-67186bdc7de5 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:21.563437 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff50c81-0740-49a5-8119-e74acdea3039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:21.564449 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff50c81-0740-49a5-8119-e74acdea3039 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:21.564847 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff50c81-0740-49a5-8119-e74acdea3039 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:21.565213 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff50c81-0740-49a5-8119-e74acdea3039 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:21.567515 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f69a8a5-72ca-4b4b-a556-7d41d461fe70 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:21.575864 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff50c81-0740-49a5-8119-e74acdea3039 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:35:21.584102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-5ff50c81-0740-49a5-8119-e74acdea3039 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:35:21.584102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:21.584102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:21.584102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:21.584102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:21.584102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:21.584102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:21.584102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:21.584102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:21.584102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:21.584102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:21.584102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:21.584102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:35:21.584102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:35:21.584102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:35:21.584102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:35:21.585733 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:35:21.585733 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:35:21.585733 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:35:21.585733 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:35:21.585733 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:21.585733 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:21.585733 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:21.585733 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:21.585733 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:21.585733 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:21.585733 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:21.585733 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:21.585733 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:21.585733 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:21.585733 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:21.585733 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:21.587119 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:21.587119 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:21.587119 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:21.587119 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:21.587119 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:35:21.587119 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:35:21.587119 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:35:21.587119 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:35:21.587119 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:35:21.587119 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:35:21.587119 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:35:21.587119 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:21.587119 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 283/562] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Jun 22 08:35:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:21.587119 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff50c81-0740-49a5-8119-e74acdea3039 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:21.606158 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da7989-9c9b-43ab-9e66-84df8f8b885a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:21.606958 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da7989-9c9b-43ab-9e66-84df8f8b885a None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:21.607239 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da7989-9c9b-43ab-9e66-84df8f8b885a None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:21.607512 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da7989-9c9b-43ab-9e66-84df8f8b885a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:21.615295 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:21.618208 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9da7989-9c9b-43ab-9e66-84df8f8b885a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:21.619721 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9da7989-9c9b-43ab-9e66-84df8f8b885a None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:21.638356 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-a9da7989-9c9b-43ab-9e66-84df8f8b885a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:21.638356 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:21.638356 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:21.638356 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:21.638356 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:21.638356 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:21.638356 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:21.638356 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:21.638356 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:21.638356 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:21.638356 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:21.638356 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:21.638356 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:35:21.638356 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:35:21.638356 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:35:21.647258 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:35:21.647258 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:21.647258 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:21.647258 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:21.647258 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:21.647258 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:21.647258 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:21.647258 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:21.647258 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:21.647258 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:21.647258 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:21.647258 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:21.647258 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:21.647258 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:21.647258 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:21.647258 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:21.647258 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:21.649190 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:35:21.649190 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:35:21.649190 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:21.649190 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:21.649190 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 280/563] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:35:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:21.649190 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06af6f-3114-4762-8ea8-bda86d4f91bc None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:21.649190 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06af6f-3114-4762-8ea8-bda86d4f91bc None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:21.649190 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06af6f-3114-4762-8ea8-bda86d4f91bc None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:21.649190 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 281/564] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:35:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:35:21.650015 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06af6f-3114-4762-8ea8-bda86d4f91bc None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:21.695813 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff50c81-0740-49a5-8119-e74acdea3039 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:21.734600 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:21.738510 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce07318-cb16-48ba-99ab-537c27a0c5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:21.739551 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce07318-cb16-48ba-99ab-537c27a0c5b2 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:21.740015 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce07318-cb16-48ba-99ab-537c27a0c5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:21.740471 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce07318-cb16-48ba-99ab-537c27a0c5b2 None admin] PATH_INFO: `/v3/users` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:21.741924 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce07318-cb16-48ba-99ab-537c27a0c5b2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:21.742469 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce07318-cb16-48ba-99ab-537c27a0c5b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:21.744617 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce07318-cb16-48ba-99ab-537c27a0c5b2 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:21.763949 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 284/565] 10.222.0.42 () {56 vars in 1133 bytes} [Wed Jun 22 08:35:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:21.766310 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce07318-cb16-48ba-99ab-537c27a0c5b2 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:21.779057 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06af6f-3114-4762-8ea8-bda86d4f91bc None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:21.820525 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a5d60-cedb-4c1c-8de7-c88d71298db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:21.821327 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a5d60-cedb-4c1c-8de7-c88d71298db0 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:21.821611 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a5d60-cedb-4c1c-8de7-c88d71298db0 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:21.821891 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a5d60-cedb-4c1c-8de7-c88d71298db0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:21.833455 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34a5d60-cedb-4c1c-8de7-c88d71298db0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:35:21.841217 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-f34a5d60-cedb-4c1c-8de7-c88d71298db0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:35:21.841217 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:21.841217 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:21.841217 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:21.841217 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:21.841217 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:21.841217 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:21.841217 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:21.841217 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:21.841217 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:21.841217 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:21.841217 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:21.841217 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:35:21.841217 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:35:21.841217 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:35:21.841217 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:35:21.842965 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:35:21.842965 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:35:21.842965 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:35:21.842965 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:35:21.842965 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:21.842965 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:21.842965 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:21.842965 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:21.842965 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:21.842965 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:21.842965 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:21.842965 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:21.842965 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:21.842965 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:21.842965 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:21.842965 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:21.844619 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:21.844619 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:21.844619 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:21.844619 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:21.844619 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:35:21.844619 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:35:21.844619 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:35:21.844619 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:35:21.844619 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:35:21.844619 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:35:21.844619 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:35:21.844619 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:21.844619 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 282/566] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Jun 22 08:35:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:21.844619 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a5d60-cedb-4c1c-8de7-c88d71298db0 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:21.864677 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:21.883948 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce07318-cb16-48ba-99ab-537c27a0c5b2 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:21.919251 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8654778-3f98-4873-8530-73b561b2eb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:21.919916 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8654778-3f98-4873-8530-73b561b2eb35 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:21.920203 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8654778-3f98-4873-8530-73b561b2eb35 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:21.920465 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8654778-3f98-4873-8530-73b561b2eb35 None admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:21.921206 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8654778-3f98-4873-8530-73b561b2eb35 None admin] RBAC: Adding query filter params (name=service) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:21.921515 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8654778-3f98-4873-8530-73b561b2eb35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:21.922927 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8654778-3f98-4873-8530-73b561b2eb35 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:21.931389 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 285/567] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Jun 22 08:35:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:21.932764 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd7373-d5f0-4824-ace5-950495ec63ef None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:21.932963 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd7373-d5f0-4824-ace5-950495ec63ef None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:21.933278 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd7373-d5f0-4824-ace5-950495ec63ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:21.955515 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-62bd7373-d5f0-4824-ace5-950495ec63ef None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:35:21.956797 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-62bd7373-d5f0-4824-ace5-950495ec63ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:35:21.959814 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a5d60-cedb-4c1c-8de7-c88d71298db0 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:21.994493 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:22.000911 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54777d2a-c4d7-40fe-b6ee-b01d0fa2f57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:22.001754 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54777d2a-c4d7-40fe-b6ee-b01d0fa2f57c None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:22.002162 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54777d2a-c4d7-40fe-b6ee-b01d0fa2f57c None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:22.002524 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54777d2a-c4d7-40fe-b6ee-b01d0fa2f57c None admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:22.003370 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54777d2a-c4d7-40fe-b6ee-b01d0fa2f57c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:22.003872 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54777d2a-c4d7-40fe-b6ee-b01d0fa2f57c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:22.005519 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54777d2a-c4d7-40fe-b6ee-b01d0fa2f57c None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:22.026343 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 283/568] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:35:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:22.029088 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54777d2a-c4d7-40fe-b6ee-b01d0fa2f57c None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:22.037133 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 286/569] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:35:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:35:22.038682 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bd7373-d5f0-4824-ace5-950495ec63ef None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:22.132297 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:22.161056 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bd7373-d5f0-4824-ace5-950495ec63ef None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:22.185825 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54777d2a-c4d7-40fe-b6ee-b01d0fa2f57c None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:22.199634 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc005c-6540-446f-abb6-1b8e306d8e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:22.200489 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc005c-6540-446f-abb6-1b8e306d8e12 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:22.200839 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc005c-6540-446f-abb6-1b8e306d8e12 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:22.201203 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc005c-6540-446f-abb6-1b8e306d8e12 None admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:22.202103 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bc005c-6540-446f-abb6-1b8e306d8e12 None admin] RBAC: Adding query filter params (name=service) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:22.202575 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bc005c-6540-446f-abb6-1b8e306d8e12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:22.204150 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bc005c-6540-446f-abb6-1b8e306d8e12 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:22.213005 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 287/570] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Jun 22 08:35:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:22.213685 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc005c-6540-446f-abb6-1b8e306d8e12 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:22.225398 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c64a6-6dbf-48c4-9868-7f3592441c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:22.226226 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c64a6-6dbf-48c4-9868-7f3592441c77 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:22.226509 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c64a6-6dbf-48c4-9868-7f3592441c77 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:22.226784 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c64a6-6dbf-48c4-9868-7f3592441c77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:22.238937 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915c64a6-6dbf-48c4-9868-7f3592441c77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:22.240474 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915c64a6-6dbf-48c4-9868-7f3592441c77 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:22.261249 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-915c64a6-6dbf-48c4-9868-7f3592441c77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:22.261249 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:22.261249 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:22.261249 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:22.261249 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:22.261249 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:22.261249 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:22.261249 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:22.261249 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:22.261249 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:22.261249 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:22.261249 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:22.261249 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:35:22.261249 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:35:22.261249 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:35:22.263042 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:35:22.263042 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:22.263042 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:22.263042 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:22.263042 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:22.263042 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:22.263042 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:22.263042 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:22.263042 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:22.263042 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:22.263042 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:22.263042 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:22.263042 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:22.263042 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:22.263042 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:22.263042 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:22.263042 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:22.264389 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:35:22.264389 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:35:22.264389 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:22.264389 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:22.264389 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 284/571] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:35:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:22.264389 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c64a6-6dbf-48c4-9868-7f3592441c77 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:22.327586 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:22.348995 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc005c-6540-446f-abb6-1b8e306d8e12 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:22.388724 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccaca3a-0198-438f-86b0-e8958645ca71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:22.390002 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccaca3a-0198-438f-86b0-e8958645ca71 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:22.390498 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccaca3a-0198-438f-86b0-e8958645ca71 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:22.390948 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccaca3a-0198-438f-86b0-e8958645ca71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:22.394393 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:22.395064 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c64a6-6dbf-48c4-9868-7f3592441c77 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:22.405364 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccaca3a-0198-438f-86b0-e8958645ca71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:22.407267 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccaca3a-0198-438f-86b0-e8958645ca71 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:22.428630 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-eccaca3a-0198-438f-86b0-e8958645ca71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:22.428630 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:22.428630 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:22.428630 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:22.428630 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:22.428630 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:22.428630 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:22.428630 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:22.428630 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:22.428630 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:22.428630 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:22.428630 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:22.428630 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:35:22.428630 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:35:22.428630 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:35:22.430557 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:35:22.430557 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:22.430557 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:22.430557 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:22.430557 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:22.430557 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:22.430557 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:22.430557 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:22.430557 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:22.430557 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:22.430557 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:22.430557 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:22.430557 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:22.430557 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:22.430557 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:22.430557 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:22.430557 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:22.432676 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:35:22.432676 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:35:22.432676 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:22.432676 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:22.432676 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 288/572] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:35:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:22.432676 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccaca3a-0198-438f-86b0-e8958645ca71 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:22.437166 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c294d36b-e685-4612-830d-f7d3cc0c98f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:22.437980 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294d36b-e685-4612-830d-f7d3cc0c98f7 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:22.438294 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294d36b-e685-4612-830d-f7d3cc0c98f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:22.438573 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294d36b-e685-4612-830d-f7d3cc0c98f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:22.448669 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c294d36b-e685-4612-830d-f7d3cc0c98f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:22.450227 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c294d36b-e685-4612-830d-f7d3cc0c98f7 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:22.471716 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-c294d36b-e685-4612-830d-f7d3cc0c98f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:35:22.471716 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:22.471716 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:22.471716 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:22.471716 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:22.471716 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:22.471716 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:22.471716 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:22.471716 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:22.471716 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:22.471716 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:22.471716 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:22.471716 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:35:22.471716 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:35:22.471716 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:35:22.472729 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:35:22.472729 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:22.472729 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:22.472729 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:22.472729 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:22.472729 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:22.472729 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:22.472729 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:22.472729 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:22.472729 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:22.472729 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:22.472729 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:22.472729 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:22.472729 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:22.472729 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:22.472729 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:22.472729 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:22.474122 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:35:22.474122 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:35:22.474122 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:35:22.474122 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:35:22.474122 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:35:22.474122 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:35:22.474122 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:35:22.474122 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:22.474122 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 285/573] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Jun 22 08:35:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:22.474122 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c294d36b-e685-4612-830d-f7d3cc0c98f7 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:22.550007 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccaca3a-0198-438f-86b0-e8958645ca71 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:22.587883 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c2b1f-08bc-4ba2-8fb2-9ff3fdf076d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:22.588692 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c2b1f-08bc-4ba2-8fb2-9ff3fdf076d5 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:22.588858 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c294d36b-e685-4612-830d-f7d3cc0c98f7 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:22.588994 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c2b1f-08bc-4ba2-8fb2-9ff3fdf076d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:22.589232 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c2b1f-08bc-4ba2-8fb2-9ff3fdf076d5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:22.592440 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:22.601792 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182c2b1f-08bc-4ba2-8fb2-9ff3fdf076d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:35:22.609593 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-182c2b1f-08bc-4ba2-8fb2-9ff3fdf076d5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:35:22.609593 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:22.609593 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:22.609593 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:22.609593 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:22.609593 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:22.609593 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:22.609593 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:22.609593 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:22.609593 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:22.609593 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:22.609593 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:22.609593 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:35:22.609593 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:35:22.609593 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:35:22.609593 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:35:22.611102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:35:22.611102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:35:22.611102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:35:22.611102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:35:22.611102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:22.611102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:22.611102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:22.611102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:22.611102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:22.611102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:22.611102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:22.611102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:22.611102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:22.611102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:22.611102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:22.611102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:22.612691 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:22.612691 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:22.612691 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:22.612691 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:22.612691 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:35:22.612691 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:35:22.612691 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:35:22.612691 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:35:22.612691 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:35:22.612691 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:35:22.612691 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:35:22.612691 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:22.612691 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 289/574] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Jun 22 08:35:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:22.612691 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c2b1f-08bc-4ba2-8fb2-9ff3fdf076d5 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:22.636216 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee2c96-499a-4650-9228-fc0a5ed96ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:22.637025 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee2c96-499a-4650-9228-fc0a5ed96ebb None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:22.637308 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee2c96-499a-4650-9228-fc0a5ed96ebb None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:22.637586 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee2c96-499a-4650-9228-fc0a5ed96ebb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:22.650610 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ee2c96-499a-4650-9228-fc0a5ed96ebb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:22.652118 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ee2c96-499a-4650-9228-fc0a5ed96ebb None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:22.669597 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:22.671516 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-b2ee2c96-499a-4650-9228-fc0a5ed96ebb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:22.671516 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:22.671516 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:22.671516 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:22.671516 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:22.671516 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:22.671516 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:22.671516 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:22.671516 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:22.671516 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:22.671516 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:22.671516 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:22.671516 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:35:22.671516 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:35:22.671516 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:35:22.673217 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:35:22.673217 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:22.673217 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:22.673217 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:22.673217 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:22.673217 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:22.673217 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:22.673217 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:22.673217 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:22.673217 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:22.673217 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:22.673217 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:22.673217 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:22.673217 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:22.673217 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:22.673217 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:22.673217 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:22.675142 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:35:22.675142 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:35:22.675142 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:22.675142 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:22.677706 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 286/575] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:35:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:22.678695 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee2c96-499a-4650-9228-fc0a5ed96ebb None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:22.733698 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c2b1f-08bc-4ba2-8fb2-9ff3fdf076d5 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:22.771585 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb832d69-c20d-408c-aa7c-405ee30c1bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:22.772270 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb832d69-c20d-408c-aa7c-405ee30c1bcc None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:22.772602 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb832d69-c20d-408c-aa7c-405ee30c1bcc None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:22.772872 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb832d69-c20d-408c-aa7c-405ee30c1bcc None admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:22.773612 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb832d69-c20d-408c-aa7c-405ee30c1bcc None admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:22.773919 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb832d69-c20d-408c-aa7c-405ee30c1bcc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:22.775376 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb832d69-c20d-408c-aa7c-405ee30c1bcc None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:22.789099 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 290/576] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:35:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:22.789971 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb832d69-c20d-408c-aa7c-405ee30c1bcc None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:22.799571 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee2c96-499a-4650-9228-fc0a5ed96ebb None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:22.843003 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24fd8f3-d4a7-450d-98ca-24ffdd594cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:22.843610 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24fd8f3-d4a7-450d-98ca-24ffdd594cb4 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:22.843897 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24fd8f3-d4a7-450d-98ca-24ffdd594cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:22.844169 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24fd8f3-d4a7-450d-98ca-24ffdd594cb4 None admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:22.844986 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24fd8f3-d4a7-450d-98ca-24ffdd594cb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:22.845355 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24fd8f3-d4a7-450d-98ca-24ffdd594cb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:22.846841 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24fd8f3-d4a7-450d-98ca-24ffdd594cb4 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:22.863975 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 287/577] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:35:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:22.863975 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24fd8f3-d4a7-450d-98ca-24ffdd594cb4 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:22.884471 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:22.910579 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb832d69-c20d-408c-aa7c-405ee30c1bcc None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:22.920874 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:22.950753 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e9a1cf-43d8-46ec-8191-5a5b6e3dfa61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:22.951539 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9a1cf-43d8-46ec-8191-5a5b6e3dfa61 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:22.951831 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9a1cf-43d8-46ec-8191-5a5b6e3dfa61 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:22.952113 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9a1cf-43d8-46ec-8191-5a5b6e3dfa61 None admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:22.952916 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e9a1cf-43d8-46ec-8191-5a5b6e3dfa61 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:22.953225 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e9a1cf-43d8-46ec-8191-5a5b6e3dfa61 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:22.954808 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e9a1cf-43d8-46ec-8191-5a5b6e3dfa61 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:22.968020 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 291/578] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Jun 22 08:35:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:22.968928 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e9a1cf-43d8-46ec-8191-5a5b6e3dfa61 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:22.979265 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24fd8f3-d4a7-450d-98ca-24ffdd594cb4 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:23.022819 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e557c3a-146f-495d-96a4-899b2c26b226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:23.023863 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e557c3a-146f-495d-96a4-899b2c26b226 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:23.024310 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e557c3a-146f-495d-96a4-899b2c26b226 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:23.024766 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e557c3a-146f-495d-96a4-899b2c26b226 None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:23.026040 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e557c3a-146f-495d-96a4-899b2c26b226 None admin] RBAC: Adding query filter params (name=service) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:23.026572 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e557c3a-146f-495d-96a4-899b2c26b226 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:23.028718 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e557c3a-146f-495d-96a4-899b2c26b226 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:23.044872 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 288/579] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Jun 22 08:35:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:23.044872 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e557c3a-146f-495d-96a4-899b2c26b226 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:23.094530 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e9a1cf-43d8-46ec-8191-5a5b6e3dfa61 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:23.132256 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f975fb1-0f47-4ac0-9d6d-096be92ac8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:23.132939 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f975fb1-0f47-4ac0-9d6d-096be92ac8e2 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:23.133212 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f975fb1-0f47-4ac0-9d6d-096be92ac8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:23.133320 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:23.133494 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f975fb1-0f47-4ac0-9d6d-096be92ac8e2 None admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:23.134339 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f975fb1-0f47-4ac0-9d6d-096be92ac8e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:23.134648 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f975fb1-0f47-4ac0-9d6d-096be92ac8e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:23.136074 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f975fb1-0f47-4ac0-9d6d-096be92ac8e2 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:23.149680 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 292/580] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:35:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:23.150649 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f975fb1-0f47-4ac0-9d6d-096be92ac8e2 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:23.165571 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e557c3a-146f-495d-96a4-899b2c26b226 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:23.184518 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:23.208565 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a607167-eeae-41e8-9ee1-48cf3bfbb852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:23.209377 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a607167-eeae-41e8-9ee1-48cf3bfbb852 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:23.209661 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a607167-eeae-41e8-9ee1-48cf3bfbb852 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:23.209944 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a607167-eeae-41e8-9ee1-48cf3bfbb852 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:23.217177 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a607167-eeae-41e8-9ee1-48cf3bfbb852 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:23.218710 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a607167-eeae-41e8-9ee1-48cf3bfbb852 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:23.237489 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-2a607167-eeae-41e8-9ee1-48cf3bfbb852 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:35:23.237489 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:23.237489 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:23.237489 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:23.237489 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:23.237489 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:23.237489 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:23.237489 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:23.237489 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:23.237489 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:23.237489 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:23.237489 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:23.237489 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:35:23.237489 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:35:23.237489 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:35:23.247266 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:35:23.247266 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:23.247266 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:23.247266 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:23.247266 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:23.247266 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:23.247266 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:23.247266 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:23.247266 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:23.247266 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:23.247266 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:23.247266 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:23.247266 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:23.247266 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:23.247266 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:23.247266 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:23.247266 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:23.248377 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:35:23.248377 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:35:23.248377 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:35:23.248377 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:35:23.248377 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:35:23.248377 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:35:23.248377 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:35:23.248377 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:23.248377 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 289/581] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Jun 22 08:35:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:23.248377 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a607167-eeae-41e8-9ee1-48cf3bfbb852 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:23.274118 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f975fb1-0f47-4ac0-9d6d-096be92ac8e2 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:23.311057 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2cbba4-d065-4dc0-8f95-2caba983676e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:23.311869 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2cbba4-d065-4dc0-8f95-2caba983676e None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:23.312150 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2cbba4-d065-4dc0-8f95-2caba983676e None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:23.312424 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2cbba4-d065-4dc0-8f95-2caba983676e None admin] PATH_INFO: `/v3/users/glance` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:23.320960 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2cbba4-d065-4dc0-8f95-2caba983676e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:23.322448 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2cbba4-d065-4dc0-8f95-2caba983676e None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:23.337774 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-9d2cbba4-d065-4dc0-8f95-2caba983676e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 22 08:35:23.337774 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:23.337774 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:23.337774 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:23.337774 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:23.337774 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:23.337774 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:23.337774 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:23.337774 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:23.337774 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:23.337774 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:23.337774 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:23.337774 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:35:23.337774 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:35:23.337774 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:35:23.337774 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:35:23.339601 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:23.339601 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:23.339601 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:35:23.339601 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:35:23.339601 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:35:23.339601 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:35:23.339601 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:23.339601 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:23.339601 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:23.339601 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:23.339601 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:23.339601 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:23.339601 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:23.339601 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:23.339601 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:23.339601 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:23.339601 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:23.339601 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:23.340734 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:23.340734 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:23.340734 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:35:23.340734 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:35:23.340734 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:35:23.340734 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:35:23.340734 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:35:23.340734 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:35:23.340734 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 22 08:35:23.340734 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:23.340734 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 293/582] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Jun 22 08:35:23 2022] GET /identity/v3/users/glance => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:23.340734 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2cbba4-d065-4dc0-8f95-2caba983676e None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:23.356620 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a607167-eeae-41e8-9ee1-48cf3bfbb852 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:23.395940 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a389184-8294-43bb-afb7-2ff910939e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:23.396606 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a389184-8294-43bb-afb7-2ff910939e8b None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:23.396887 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a389184-8294-43bb-afb7-2ff910939e8b None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:23.397194 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a389184-8294-43bb-afb7-2ff910939e8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:23.398043 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a389184-8294-43bb-afb7-2ff910939e8b None admin] RBAC: Adding query filter params (role.id=e67c237283fd404d9a2bdf1333109696, scope.project.id=e1f161193cb440fa8c4a9d23820a5c28, user.id=4403cea84ff646b88cdb785975b20346) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:23.398383 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a389184-8294-43bb-afb7-2ff910939e8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:23.399873 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a389184-8294-43bb-afb7-2ff910939e8b None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:23.406269 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 290/583] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Jun 22 08:35:23 2022] GET /identity/v3/role_assignments?user.id=4403cea84ff646b88cdb785975b20346&scope.project.id=e1f161193cb440fa8c4a9d23820a5c28&role.id=e67c237283fd404d9a2bdf1333109696 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:23.407095 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a389184-8294-43bb-afb7-2ff910939e8b None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:23.410432 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:23.454468 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:23.475202 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2cbba4-d065-4dc0-8f95-2caba983676e None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:23.540978 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5d7a3d-f3ce-42e9-9890-c8f5e5c8a5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:23.542498 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d7a3d-f3ce-42e9-9890-c8f5e5c8a5f7 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:23.543016 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d7a3d-f3ce-42e9-9890-c8f5e5c8a5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:23.543528 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d7a3d-f3ce-42e9-9890-c8f5e5c8a5f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:23.557300 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a389184-8294-43bb-afb7-2ff910939e8b None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:23.565971 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5d7a3d-f3ce-42e9-9890-c8f5e5c8a5f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:23.568987 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5d7a3d-f3ce-42e9-9890-c8f5e5c8a5f7 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:23.591459 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-7b5d7a3d-f3ce-42e9-9890-c8f5e5c8a5f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:23.591459 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:23.591459 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:23.591459 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:23.591459 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:23.591459 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:23.591459 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:23.591459 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:23.591459 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:23.591459 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:23.591459 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:23.591459 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:23.591459 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:35:23.591459 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:35:23.591459 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:35:23.592495 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:35:23.592495 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:23.592495 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:23.592495 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:23.592495 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:23.592495 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:23.592495 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:23.592495 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:23.592495 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:23.592495 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:23.592495 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:23.592495 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:23.592495 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:23.592495 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:23.592495 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:23.592495 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:23.592495 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:23.593402 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:35:23.593402 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:35:23.593402 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:23.593402 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:23.593402 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 294/584] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:35:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:23.593702 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5d7a3d-f3ce-42e9-9890-c8f5e5c8a5f7 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:23.614455 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf4502-57ec-4d0e-9af8-5e81d518e1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:23.615188 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf4502-57ec-4d0e-9af8-5e81d518e1a9 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:23.615478 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf4502-57ec-4d0e-9af8-5e81d518e1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:23.615752 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf4502-57ec-4d0e-9af8-5e81d518e1a9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:23.625394 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bf4502-57ec-4d0e-9af8-5e81d518e1a9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:23.627494 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bf4502-57ec-4d0e-9af8-5e81d518e1a9 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:23.642905 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-21bf4502-57ec-4d0e-9af8-5e81d518e1a9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 08:35:23.642905 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:23.642905 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:23.642905 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:23.642905 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:23.642905 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:23.642905 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:23.642905 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:23.642905 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:23.642905 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:23.642905 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:23.642905 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:23.642905 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:35:23.642905 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:35:23.642905 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:35:23.642905 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:35:23.643920 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:23.643920 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:23.643920 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:35:23.643920 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:35:23.643920 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:35:23.643920 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:35:23.643920 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:23.643920 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:23.643920 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:23.643920 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:23.643920 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:23.643920 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:23.643920 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:23.643920 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:23.643920 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:23.643920 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:23.643920 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:23.643920 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:23.645206 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:23.645206 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:23.645206 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:35:23.645206 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:35:23.645206 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:35:23.645206 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:35:23.645206 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:35:23.645206 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:35:23.645206 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 08:35:23.645206 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:23.645206 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 291/585] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Jun 22 08:35:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:23.645206 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf4502-57ec-4d0e-9af8-5e81d518e1a9 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:23.711147 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5d7a3d-f3ce-42e9-9890-c8f5e5c8a5f7 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:23.711729 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:23.750388 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc56e9c-d82b-42f8-b48a-f83231ebb994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:23.751055 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc56e9c-d82b-42f8-b48a-f83231ebb994 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:23.751348 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc56e9c-d82b-42f8-b48a-f83231ebb994 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:23.751657 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc56e9c-d82b-42f8-b48a-f83231ebb994 None admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:23.752501 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc56e9c-d82b-42f8-b48a-f83231ebb994 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:23.752817 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc56e9c-d82b-42f8-b48a-f83231ebb994 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:23.754287 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc56e9c-d82b-42f8-b48a-f83231ebb994 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:23.758322 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf4502-57ec-4d0e-9af8-5e81d518e1a9 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:23.764203 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:23.768528 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 295/586] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Jun 22 08:35:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:23.771703 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc56e9c-d82b-42f8-b48a-f83231ebb994 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:23.797590 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b37c64-3ccc-4bb4-81f8-d1b6a5bc904c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:23.798291 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b37c64-3ccc-4bb4-81f8-d1b6a5bc904c None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:23.799187 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b37c64-3ccc-4bb4-81f8-d1b6a5bc904c None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:23.799468 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b37c64-3ccc-4bb4-81f8-d1b6a5bc904c None admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:23.800644 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b37c64-3ccc-4bb4-81f8-d1b6a5bc904c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:23.800959 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b37c64-3ccc-4bb4-81f8-d1b6a5bc904c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:23.802434 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b37c64-3ccc-4bb4-81f8-d1b6a5bc904c None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:23.827750 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 292/587] 10.222.0.42 () {56 vars in 1137 bytes} [Wed Jun 22 08:35:23 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:23.828535 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b37c64-3ccc-4bb4-81f8-d1b6a5bc904c None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:23.894515 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc56e9c-d82b-42f8-b48a-f83231ebb994 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:23.937182 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1facf3-dd0e-4c26-873d-25c91d42a672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:23.937845 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1facf3-dd0e-4c26-873d-25c91d42a672 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:23.938155 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1facf3-dd0e-4c26-873d-25c91d42a672 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:23.938437 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1facf3-dd0e-4c26-873d-25c91d42a672 None admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:23.938534 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b37c64-3ccc-4bb4-81f8-d1b6a5bc904c None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:23.939213 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1facf3-dd0e-4c26-873d-25c91d42a672 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:23.939523 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1facf3-dd0e-4c26-873d-25c91d42a672 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:23.941408 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1facf3-dd0e-4c26-873d-25c91d42a672 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:23.958715 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 296/588] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:35:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:23.958715 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1facf3-dd0e-4c26-873d-25c91d42a672 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:23.966223 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:23.982934 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bcc767-c144-4912-b9db-440d3d031178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:23.983612 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bcc767-c144-4912-b9db-440d3d031178 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:23.983901 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bcc767-c144-4912-b9db-440d3d031178 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:23.984178 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bcc767-c144-4912-b9db-440d3d031178 None admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:23.985036 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bcc767-c144-4912-b9db-440d3d031178 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:23.985349 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bcc767-c144-4912-b9db-440d3d031178 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:23.986861 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bcc767-c144-4912-b9db-440d3d031178 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:24.006975 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 293/589] 10.222.0.42 () {56 vars in 1137 bytes} [Wed Jun 22 08:35:23 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:24.008274 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bcc767-c144-4912-b9db-440d3d031178 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:24.028756 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:24.077172 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1facf3-dd0e-4c26-873d-25c91d42a672 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:24.118573 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f02a1bd-0d5e-45f6-9d16-831c8d38cf98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:24.119619 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f02a1bd-0d5e-45f6-9d16-831c8d38cf98 None admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:24.119778 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f02a1bd-0d5e-45f6-9d16-831c8d38cf98 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:24.120003 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f02a1bd-0d5e-45f6-9d16-831c8d38cf98 None admin] PATH_INFO: `/v3/projects/e1f161193cb440fa8c4a9d23820a5c28/users/4f1809a35b244c1db7a185d82859369e/roles/e67c237283fd404d9a2bdf1333109696` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:24.132461 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bcc767-c144-4912-b9db-440d3d031178 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:24.137902 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f02a1bd-0d5e-45f6-9d16-831c8d38cf98 None admin] RBAC: Authorizing `identity:create_grant(project_id=e1f161193cb440fa8c4a9d23820a5c28, user_id=4f1809a35b244c1db7a185d82859369e, role_id=e67c237283fd404d9a2bdf1333109696)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:24.139405 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f02a1bd-0d5e-45f6-9d16-831c8d38cf98 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:24.154837 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 297/590] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Jun 22 08:35:23 2022] PUT /identity/v3/projects/e1f161193cb440fa8c4a9d23820a5c28/users/4f1809a35b244c1db7a185d82859369e/roles/e67c237283fd404d9a2bdf1333109696 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:35:24.155602 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f02a1bd-0d5e-45f6-9d16-831c8d38cf98 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:24.186912 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b5212-79ea-4a74-8730-83fcdd80a385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:24.189840 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b5212-79ea-4a74-8730-83fcdd80a385 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:24.191010 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b5212-79ea-4a74-8730-83fcdd80a385 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:24.191744 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b5212-79ea-4a74-8730-83fcdd80a385 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:24.213668 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590b5212-79ea-4a74-8730-83fcdd80a385 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:24.216868 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590b5212-79ea-4a74-8730-83fcdd80a385 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:24.252780 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-590b5212-79ea-4a74-8730-83fcdd80a385 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:24.252780 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:24.252780 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:24.252780 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:24.252780 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:24.252780 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:24.252780 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:24.252780 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:24.252780 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:24.252780 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:24.252780 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:24.252780 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:24.252780 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:35:24.252780 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:35:24.252780 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:35:24.254891 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:35:24.254891 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:24.254891 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:24.254891 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:24.254891 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:24.254891 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:24.254891 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:24.254891 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:24.254891 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:24.254891 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:24.254891 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:24.254891 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:24.254891 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:24.254891 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:24.254891 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:24.254891 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:24.254891 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:24.256613 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:35:24.256613 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:35:24.256613 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:24.256613 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:24.264587 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 294/591] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:35:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:24.265726 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b5212-79ea-4a74-8730-83fcdd80a385 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:24.320759 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:24.351659 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f02a1bd-0d5e-45f6-9d16-831c8d38cf98 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:24.366118 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:24.412178 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa7f809-5134-499d-816b-a4dfded1e274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:24.413569 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7f809-5134-499d-816b-a4dfded1e274 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:24.414125 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7f809-5134-499d-816b-a4dfded1e274 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:24.414883 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7f809-5134-499d-816b-a4dfded1e274 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:24.426939 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa7f809-5134-499d-816b-a4dfded1e274 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:24.429453 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa7f809-5134-499d-816b-a4dfded1e274 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:24.438294 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b5212-79ea-4a74-8730-83fcdd80a385 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:24.449067 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-6fa7f809-5134-499d-816b-a4dfded1e274 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 22 08:35:24.449067 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:24.449067 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:24.449067 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:24.449067 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:24.449067 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:24.449067 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:24.449067 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:24.449067 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:24.449067 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:24.449067 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:24.449067 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:24.449067 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:35:24.449067 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:35:24.449067 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:35:24.449067 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:35:24.450145 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:24.450145 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:24.450145 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:35:24.450145 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:35:24.450145 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:35:24.450145 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:35:24.450145 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:24.450145 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:24.450145 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:24.450145 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:24.450145 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:24.450145 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:24.450145 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:24.450145 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:24.450145 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:24.450145 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:24.450145 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:24.450145 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:24.451184 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:24.451184 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:24.451184 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:35:24.451184 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:35:24.451184 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:35:24.451184 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:35:24.451184 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:35:24.451184 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:35:24.451184 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 22 08:35:24.451184 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:24.453288 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 298/592] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Jun 22 08:35:24 2022] GET /identity/v3/users/neutron => generated 85 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:24.455601 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa7f809-5134-499d-816b-a4dfded1e274 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:24.509075 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c9673f-e0e2-4e3d-9e60-f91a311b472a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:24.510713 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9673f-e0e2-4e3d-9e60-f91a311b472a None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:24.511478 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9673f-e0e2-4e3d-9e60-f91a311b472a None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:24.512084 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9673f-e0e2-4e3d-9e60-f91a311b472a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:24.533810 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c9673f-e0e2-4e3d-9e60-f91a311b472a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:24.537235 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c9673f-e0e2-4e3d-9e60-f91a311b472a None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:24.576183 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-68c9673f-e0e2-4e3d-9e60-f91a311b472a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:24.576183 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:24.576183 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:24.576183 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:24.576183 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:24.576183 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:24.576183 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:24.576183 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:24.576183 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:24.576183 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:24.576183 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:24.576183 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:24.576183 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:35:24.576183 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:35:24.576183 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:35:24.577329 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:35:24.577329 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:24.577329 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:24.577329 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:24.577329 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:24.577329 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:24.577329 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:24.577329 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:24.577329 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:24.577329 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:24.577329 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:24.577329 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:24.577329 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:24.577329 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:24.577329 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:24.577329 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:24.577329 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:24.578352 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:35:24.578352 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:35:24.578352 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:24.578352 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:24.583374 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa7f809-5134-499d-816b-a4dfded1e274 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:24.588847 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 295/593] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:35:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:24.590604 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c9673f-e0e2-4e3d-9e60-f91a311b472a None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:24.632038 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb7831d-532b-4907-a1d5-2adde1ee9385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:24.633118 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb7831d-532b-4907-a1d5-2adde1ee9385 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:24.633620 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb7831d-532b-4907-a1d5-2adde1ee9385 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:24.634130 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb7831d-532b-4907-a1d5-2adde1ee9385 None admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:24.635762 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb7831d-532b-4907-a1d5-2adde1ee9385 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:24.636337 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb7831d-532b-4907-a1d5-2adde1ee9385 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:24.638369 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb7831d-532b-4907-a1d5-2adde1ee9385 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:24.659952 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 299/594] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:35:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:24.660642 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb7831d-532b-4907-a1d5-2adde1ee9385 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:24.711743 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:24.735184 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:24.760771 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c9673f-e0e2-4e3d-9e60-f91a311b472a None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:24.817912 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed9d64-ce8a-46fe-a4a8-ec9f3a21703d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:24.819181 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed9d64-ce8a-46fe-a4a8-ec9f3a21703d None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:24.819754 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed9d64-ce8a-46fe-a4a8-ec9f3a21703d None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:24.820346 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed9d64-ce8a-46fe-a4a8-ec9f3a21703d None admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:24.822323 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfed9d64-ce8a-46fe-a4a8-ec9f3a21703d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:24.822945 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfed9d64-ce8a-46fe-a4a8-ec9f3a21703d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:24.825601 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfed9d64-ce8a-46fe-a4a8-ec9f3a21703d None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:24.855146 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 296/595] 10.222.0.42 () {56 vars in 1139 bytes} [Wed Jun 22 08:35:24 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:24.856106 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed9d64-ce8a-46fe-a4a8-ec9f3a21703d None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:24.881011 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb7831d-532b-4907-a1d5-2adde1ee9385 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:24.944124 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346b0934-c5e0-4ccf-b32d-72e1d08a18f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:24.945207 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b0934-c5e0-4ccf-b32d-72e1d08a18f0 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:24.945682 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b0934-c5e0-4ccf-b32d-72e1d08a18f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:24.946182 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b0934-c5e0-4ccf-b32d-72e1d08a18f0 None admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:24.947462 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346b0934-c5e0-4ccf-b32d-72e1d08a18f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:24.947942 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346b0934-c5e0-4ccf-b32d-72e1d08a18f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:24.950344 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346b0934-c5e0-4ccf-b32d-72e1d08a18f0 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:24.972144 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 300/596] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:35:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:24.973560 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346b0934-c5e0-4ccf-b32d-72e1d08a18f0 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:25.009745 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed9d64-ce8a-46fe-a4a8-ec9f3a21703d None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:25.056276 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35068b5b-b717-412f-bcaf-4b71bf9a8e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:25.057623 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35068b5b-b717-412f-bcaf-4b71bf9a8e67 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:25.058190 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35068b5b-b717-412f-bcaf-4b71bf9a8e67 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:25.058661 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35068b5b-b717-412f-bcaf-4b71bf9a8e67 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:25.068094 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35068b5b-b717-412f-bcaf-4b71bf9a8e67 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:25.069972 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35068b5b-b717-412f-bcaf-4b71bf9a8e67 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:25.073171 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:25.089261 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-35068b5b-b717-412f-bcaf-4b71bf9a8e67 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:35:25.089261 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:25.089261 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:25.089261 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:25.089261 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:25.089261 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:25.089261 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:25.089261 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:25.089261 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:25.089261 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:25.089261 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:25.089261 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:25.089261 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:35:25.089261 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:35:25.089261 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:35:25.090347 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:35:25.090347 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:25.090347 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:25.090347 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:25.090347 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:25.090347 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:25.090347 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:25.090347 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:25.090347 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:25.090347 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:25.090347 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:25.090347 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:25.090347 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:25.090347 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:25.090347 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:25.090347 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:25.090347 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:25.091327 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:35:25.091327 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:35:25.091327 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:35:25.091327 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:35:25.091327 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:35:25.091327 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:35:25.091327 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:35:25.091327 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:25.098526 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 297/597] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Jun 22 08:35:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:25.098526 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35068b5b-b717-412f-bcaf-4b71bf9a8e67 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:25.161121 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346b0934-c5e0-4ccf-b32d-72e1d08a18f0 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:25.178527 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:25.223683 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd938eb-2d96-41a1-b872-b9846e4bd7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:25.224922 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd938eb-2d96-41a1-b872-b9846e4bd7fb None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:25.225045 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35068b5b-b717-412f-bcaf-4b71bf9a8e67 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:25.225526 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd938eb-2d96-41a1-b872-b9846e4bd7fb None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:25.226028 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd938eb-2d96-41a1-b872-b9846e4bd7fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:25.241588 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd938eb-2d96-41a1-b872-b9846e4bd7fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:25.243487 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd938eb-2d96-41a1-b872-b9846e4bd7fb None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:25.263971 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-cdd938eb-2d96-41a1-b872-b9846e4bd7fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:25.263971 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:25.263971 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:25.263971 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:25.263971 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:25.263971 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:25.263971 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:25.263971 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:25.263971 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:25.263971 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:25.263971 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:25.263971 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:25.263971 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:35:25.263971 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:35:25.263971 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:35:25.265072 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:35:25.265072 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:25.265072 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:25.265072 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:25.265072 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:25.265072 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:25.265072 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:25.265072 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:25.265072 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:25.265072 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:25.265072 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:25.265072 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:25.265072 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:25.265072 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:25.265072 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:25.265072 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:25.265072 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:25.266058 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:35:25.266058 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:35:25.266058 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:25.266058 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:25.268832 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 301/598] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:35:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:25.270180 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd938eb-2d96-41a1-b872-b9846e4bd7fb None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:25.312719 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c050b0-1105-4dc4-ab06-d3921af43f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:25.314970 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c050b0-1105-4dc4-ab06-d3921af43f7b None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:25.315619 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c050b0-1105-4dc4-ab06-d3921af43f7b None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:25.316256 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c050b0-1105-4dc4-ab06-d3921af43f7b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:25.326548 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c050b0-1105-4dc4-ab06-d3921af43f7b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:25.328223 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c050b0-1105-4dc4-ab06-d3921af43f7b None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:25.348086 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-29c050b0-1105-4dc4-ab06-d3921af43f7b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:35:25.348086 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:25.348086 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:25.348086 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:25.348086 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:25.348086 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:25.348086 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:25.348086 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:25.348086 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:25.348086 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:25.348086 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:25.348086 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:25.348086 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:35:25.348086 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:35:25.348086 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:35:25.349202 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:35:25.349202 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:25.349202 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:25.349202 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:25.349202 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:25.349202 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:25.349202 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:25.349202 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:25.349202 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:25.349202 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:25.349202 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:25.349202 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:25.349202 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:25.349202 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:25.349202 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:25.349202 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:25.349202 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:25.350282 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:35:25.350282 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:35:25.350282 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:35:25.350282 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:35:25.350282 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:35:25.350282 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:35:25.350282 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:35:25.350282 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:25.352393 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 298/599] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Jun 22 08:35:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:25.353418 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c050b0-1105-4dc4-ab06-d3921af43f7b None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:25.395507 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd938eb-2d96-41a1-b872-b9846e4bd7fb None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:25.418716 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:25.438751 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd8defe-713d-42b7-b7d6-adf45f4c8236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:25.440114 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8defe-713d-42b7-b7d6-adf45f4c8236 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:25.440463 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8defe-713d-42b7-b7d6-adf45f4c8236 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:25.440810 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8defe-713d-42b7-b7d6-adf45f4c8236 None admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:25.441845 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd8defe-713d-42b7-b7d6-adf45f4c8236 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:25.442252 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd8defe-713d-42b7-b7d6-adf45f4c8236 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:25.443927 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd8defe-713d-42b7-b7d6-adf45f4c8236 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:25.462974 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 302/600] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Jun 22 08:35:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:25.462974 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd8defe-713d-42b7-b7d6-adf45f4c8236 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:25.462974 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:25.473188 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c050b0-1105-4dc4-ab06-d3921af43f7b None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:25.511260 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d57a74-c3be-4c06-abc3-4378f9c4cd6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:25.512293 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d57a74-c3be-4c06-abc3-4378f9c4cd6e None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:25.512792 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d57a74-c3be-4c06-abc3-4378f9c4cd6e None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:25.513249 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d57a74-c3be-4c06-abc3-4378f9c4cd6e None admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:25.514199 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d57a74-c3be-4c06-abc3-4378f9c4cd6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:25.514712 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d57a74-c3be-4c06-abc3-4378f9c4cd6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:25.516315 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d57a74-c3be-4c06-abc3-4378f9c4cd6e None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:25.535049 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 299/601] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:35:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:25.536366 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d57a74-c3be-4c06-abc3-4378f9c4cd6e None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:25.577644 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd8defe-713d-42b7-b7d6-adf45f4c8236 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:25.616018 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ca788-4834-4f1f-9de1-febc561d8678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:25.616686 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ca788-4834-4f1f-9de1-febc561d8678 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:25.616970 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ca788-4834-4f1f-9de1-febc561d8678 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:25.617306 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ca788-4834-4f1f-9de1-febc561d8678 None admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:25.618178 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5ca788-4834-4f1f-9de1-febc561d8678 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:25.618495 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5ca788-4834-4f1f-9de1-febc561d8678 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:25.620064 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5ca788-4834-4f1f-9de1-febc561d8678 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:25.634287 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 303/602] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Jun 22 08:35:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:25.635253 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ca788-4834-4f1f-9de1-febc561d8678 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:25.648317 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d57a74-c3be-4c06-abc3-4378f9c4cd6e None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:25.672091 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:25.688146 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6a912-9530-4619-816e-8df9e92b6926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:25.689454 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6a912-9530-4619-816e-8df9e92b6926 None admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:25.689979 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6a912-9530-4619-816e-8df9e92b6926 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:25.690590 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6a912-9530-4619-816e-8df9e92b6926 None admin] PATH_INFO: `/v3/projects/e1f161193cb440fa8c4a9d23820a5c28/users/589eb8cc97714580840ac7a48ea38ee8/roles/e67c237283fd404d9a2bdf1333109696` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:25.707985 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d6a912-9530-4619-816e-8df9e92b6926 None admin] RBAC: Authorizing `identity:create_grant(project_id=e1f161193cb440fa8c4a9d23820a5c28, user_id=589eb8cc97714580840ac7a48ea38ee8, role_id=e67c237283fd404d9a2bdf1333109696)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:25.708824 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:25.710023 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d6a912-9530-4619-816e-8df9e92b6926 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:25.727808 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 300/603] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Jun 22 08:35:25 2022] PUT /identity/v3/projects/e1f161193cb440fa8c4a9d23820a5c28/users/589eb8cc97714580840ac7a48ea38ee8/roles/e67c237283fd404d9a2bdf1333109696 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:35:25.728936 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6a912-9530-4619-816e-8df9e92b6926 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:25.759218 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ca788-4834-4f1f-9de1-febc561d8678 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:25.801487 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1d2ce-f9b5-4f00-8699-12fbe4c10e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:25.802359 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1d2ce-f9b5-4f00-8699-12fbe4c10e52 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:25.802698 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1d2ce-f9b5-4f00-8699-12fbe4c10e52 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:25.803038 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1d2ce-f9b5-4f00-8699-12fbe4c10e52 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:25.812179 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c1d2ce-f9b5-4f00-8699-12fbe4c10e52 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:25.813782 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c1d2ce-f9b5-4f00-8699-12fbe4c10e52 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:25.832834 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-c0c1d2ce-f9b5-4f00-8699-12fbe4c10e52 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:35:25.832834 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:25.832834 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:25.832834 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:25.832834 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:25.832834 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:25.832834 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:25.832834 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:25.832834 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:25.832834 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:25.832834 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:25.832834 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:25.832834 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:35:25.832834 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:35:25.832834 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:35:25.833820 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:35:25.833820 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:25.833820 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:25.833820 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:25.833820 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:25.833820 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:25.833820 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:25.833820 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:25.833820 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:25.833820 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:25.833820 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:25.833820 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:25.833820 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:25.833820 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:25.833820 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:25.833820 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:25.833820 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:25.834758 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:35:25.834758 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:35:25.834758 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:35:25.834758 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:35:25.834758 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:35:25.834758 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:35:25.834758 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:35:25.834758 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:25.838743 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 304/604] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Jun 22 08:35:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:25.840834 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1d2ce-f9b5-4f00-8699-12fbe4c10e52 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:25.879665 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6a912-9530-4619-816e-8df9e92b6926 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:25.940064 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d247c94a-c2d8-4772-a4b2-a57e3065910f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:25.941023 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247c94a-c2d8-4772-a4b2-a57e3065910f None admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:25.941303 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247c94a-c2d8-4772-a4b2-a57e3065910f None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:25.941578 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247c94a-c2d8-4772-a4b2-a57e3065910f None admin] PATH_INFO: `/v3/projects/e1f161193cb440fa8c4a9d23820a5c28/users/b4a2701c65144851ad87ac77fccb686f/roles/e67c237283fd404d9a2bdf1333109696` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:25.975722 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d247c94a-c2d8-4772-a4b2-a57e3065910f None admin] RBAC: Authorizing `identity:create_grant(project_id=e1f161193cb440fa8c4a9d23820a5c28, user_id=b4a2701c65144851ad87ac77fccb686f, role_id=e67c237283fd404d9a2bdf1333109696)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:25.978738 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d247c94a-c2d8-4772-a4b2-a57e3065910f None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:25.995728 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1d2ce-f9b5-4f00-8699-12fbe4c10e52 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:26.001088 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 301/605] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Jun 22 08:35:25 2022] PUT /identity/v3/projects/e1f161193cb440fa8c4a9d23820a5c28/users/b4a2701c65144851ad87ac77fccb686f/roles/e67c237283fd404d9a2bdf1333109696 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:35:26.027672 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:26.036368 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2518d6-be03-49bb-9a08-992d21b0040b None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:26.036722 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2518d6-be03-49bb-9a08-992d21b0040b None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:26.036944 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2518d6-be03-49bb-9a08-992d21b0040b None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:26.039107 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 302/606] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:35:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:35:26.045465 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90134523-4c4f-4ec0-84ca-f2d945427db5 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:26.045757 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90134523-4c4f-4ec0-84ca-f2d945427db5 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:26.046040 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90134523-4c4f-4ec0-84ca-f2d945427db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:26.055182 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd4bf8-33a9-4bfd-a4a1-3b3f75df4c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:26.056238 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd4bf8-33a9-4bfd-a4a1-3b3f75df4c50 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:26.056741 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd4bf8-33a9-4bfd-a4a1-3b3f75df4c50 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:26.057222 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd4bf8-33a9-4bfd-a4a1-3b3f75df4c50 None admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:26.058279 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bd4bf8-33a9-4bfd-a4a1-3b3f75df4c50 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:26.058955 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bd4bf8-33a9-4bfd-a4a1-3b3f75df4c50 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:26.060660 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bd4bf8-33a9-4bfd-a4a1-3b3f75df4c50 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:26.072902 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-90134523-4c4f-4ec0-84ca-f2d945427db5 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:35:26.076292 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-90134523-4c4f-4ec0-84ca-f2d945427db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:35:26.086285 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 305/607] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Jun 22 08:35:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:35:26.090292 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd4bf8-33a9-4bfd-a4a1-3b3f75df4c50 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:26.101373 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:26.242920 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 303/608] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:35:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:35:26.277375 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd4bf8-33a9-4bfd-a4a1-3b3f75df4c50 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:26.306550 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90134523-4c4f-4ec0-84ca-f2d945427db5 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:26.316943 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58333e0d-0350-4b60-ae95-a91ad0c30420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:26.317843 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58333e0d-0350-4b60-ae95-a91ad0c30420 None admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:26.318219 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58333e0d-0350-4b60-ae95-a91ad0c30420 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:26.318499 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58333e0d-0350-4b60-ae95-a91ad0c30420 None admin] PATH_INFO: `/v3/projects/e1f161193cb440fa8c4a9d23820a5c28/users/751f037ff70d4eb8acb4e8d4c5c487ad/roles/e67c237283fd404d9a2bdf1333109696` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:26.335429 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58333e0d-0350-4b60-ae95-a91ad0c30420 None admin] RBAC: Authorizing `identity:create_grant(project_id=e1f161193cb440fa8c4a9d23820a5c28, user_id=751f037ff70d4eb8acb4e8d4c5c487ad, role_id=e67c237283fd404d9a2bdf1333109696)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:26.336886 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58333e0d-0350-4b60-ae95-a91ad0c30420 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:26.358954 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 306/609] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Jun 22 08:35:26 2022] PUT /identity/v3/projects/e1f161193cb440fa8c4a9d23820a5c28/users/751f037ff70d4eb8acb4e8d4c5c487ad/roles/e67c237283fd404d9a2bdf1333109696 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:35:26.475811 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90134523-4c4f-4ec0-84ca-f2d945427db5 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:26.517775 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a49e7de-f86a-43e3-9588-030ec32feccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:26.518637 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49e7de-f86a-43e3-9588-030ec32feccf None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:26.518927 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49e7de-f86a-43e3-9588-030ec32feccf None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:26.519218 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49e7de-f86a-43e3-9588-030ec32feccf None admin] PATH_INFO: `/v3/roles/service` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:26.536725 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a49e7de-f86a-43e3-9588-030ec32feccf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:35:26.544660 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-7a49e7de-f86a-43e3-9588-030ec32feccf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:35:26.544660 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:26.544660 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:26.544660 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:26.544660 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:26.544660 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:26.544660 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:26.544660 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:26.544660 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:26.544660 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:26.544660 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:26.544660 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:26.544660 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:35:26.544660 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:35:26.544660 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:35:26.544660 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:35:26.546617 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:35:26.546617 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:35:26.546617 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:35:26.546617 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:35:26.546617 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:26.546617 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:26.546617 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:26.546617 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:26.546617 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:26.546617 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:26.546617 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:26.546617 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:26.546617 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:26.546617 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:26.546617 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:26.546617 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:26.548391 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:26.548391 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:26.548391 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:26.548391 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:26.548391 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:35:26.548391 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:35:26.548391 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:35:26.548391 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:35:26.548391 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:35:26.548391 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:35:26.548391 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:35:26.548391 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:26.551168 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 304/610] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Jun 22 08:35:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:26.563421 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58333e0d-0350-4b60-ae95-a91ad0c30420 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:26.639277 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:26.729048 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58333e0d-0350-4b60-ae95-a91ad0c30420 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:26.772849 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db923b71-e074-4d03-aea9-cdfb72823da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:26.773548 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db923b71-e074-4d03-aea9-cdfb72823da0 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:26.773837 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db923b71-e074-4d03-aea9-cdfb72823da0 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:26.774149 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db923b71-e074-4d03-aea9-cdfb72823da0 None admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:26.774929 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db923b71-e074-4d03-aea9-cdfb72823da0 None admin] RBAC: Adding query filter params (name=service) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:26.775245 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db923b71-e074-4d03-aea9-cdfb72823da0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:26.776834 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db923b71-e074-4d03-aea9-cdfb72823da0 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:26.790502 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 307/611] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Jun 22 08:35:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:26.793410 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a49e7de-f86a-43e3-9588-030ec32feccf None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:26.800215 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79df6c-9cf2-4851-a26d-f85e2443b050 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:26.800612 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79df6c-9cf2-4851-a26d-f85e2443b050 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:26.800873 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79df6c-9cf2-4851-a26d-f85e2443b050 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:26.802634 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 308/612] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:35:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:35:26.810766 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f434281-3e8c-492b-8813-15691d85368d None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:26.811177 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f434281-3e8c-492b-8813-15691d85368d None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:26.811344 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f434281-3e8c-492b-8813-15691d85368d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:26.818700 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:26.853646 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-8f434281-3e8c-492b-8813-15691d85368d None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:35:26.854918 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-8f434281-3e8c-492b-8813-15691d85368d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:35:26.974421 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a49e7de-f86a-43e3-9588-030ec32feccf None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:26.992617 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 309/613] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:35:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:35:27.010904 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365d2fb6-a8fa-449e-9be7-ff779a25a020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:27.011708 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d2fb6-a8fa-449e-9be7-ff779a25a020 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:27.011993 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d2fb6-a8fa-449e-9be7-ff779a25a020 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:27.012274 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d2fb6-a8fa-449e-9be7-ff779a25a020 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:27.025019 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365d2fb6-a8fa-449e-9be7-ff779a25a020 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:27.026598 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365d2fb6-a8fa-449e-9be7-ff779a25a020 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:27.041254 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f434281-3e8c-492b-8813-15691d85368d None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:27.045724 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-365d2fb6-a8fa-449e-9be7-ff779a25a020 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:27.045724 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:27.045724 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:27.045724 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:27.045724 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:27.045724 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:27.045724 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:27.045724 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:27.045724 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:27.045724 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:27.045724 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:27.045724 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:27.045724 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:35:27.045724 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:35:27.045724 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:35:27.047403 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:35:27.047403 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:27.047403 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:27.047403 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:27.047403 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:27.047403 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:27.047403 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:27.047403 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:27.047403 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:27.047403 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:27.047403 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:27.047403 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:27.047403 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:27.047403 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:27.047403 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:27.047403 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:27.047403 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:27.049209 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:35:27.049209 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:35:27.049209 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:27.049209 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:27.049209 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 305/614] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:35:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:27.054893 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365d2fb6-a8fa-449e-9be7-ff779a25a020 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:27.096972 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:27.122525 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:27.161869 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365d2fb6-a8fa-449e-9be7-ff779a25a020 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:27.201781 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc25ff6a-360b-4919-92c9-337e8e2ca672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:27.202497 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25ff6a-360b-4919-92c9-337e8e2ca672 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:27.202794 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25ff6a-360b-4919-92c9-337e8e2ca672 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:27.203056 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25ff6a-360b-4919-92c9-337e8e2ca672 None admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:27.206106 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc25ff6a-360b-4919-92c9-337e8e2ca672 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:27.206106 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc25ff6a-360b-4919-92c9-337e8e2ca672 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:27.207425 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc25ff6a-360b-4919-92c9-337e8e2ca672 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:27.244999 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 306/615] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:35:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:27.251058 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc25ff6a-360b-4919-92c9-337e8e2ca672 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:27.296732 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f434281-3e8c-492b-8813-15691d85368d None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:27.400108 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fffd7c-fb58-4ca8-9c5d-636f72b40f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:27.402003 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fffd7c-fb58-4ca8-9c5d-636f72b40f2f None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:27.402732 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc25ff6a-360b-4919-92c9-337e8e2ca672 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:27.403091 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fffd7c-fb58-4ca8-9c5d-636f72b40f2f None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:27.403862 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fffd7c-fb58-4ca8-9c5d-636f72b40f2f None admin] PATH_INFO: `/v3/roles/service` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:27.429158 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:27.442718 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c035e-f7ee-4eb5-8ec0-5ce103f52e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:27.443542 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c035e-f7ee-4eb5-8ec0-5ce103f52e12 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:27.443830 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c035e-f7ee-4eb5-8ec0-5ce103f52e12 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:27.444119 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c035e-f7ee-4eb5-8ec0-5ce103f52e12 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:27.453494 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c035e-f7ee-4eb5-8ec0-5ce103f52e12 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:27.455680 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c035e-f7ee-4eb5-8ec0-5ce103f52e12 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:27.471626 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fffd7c-fb58-4ca8-9c5d-636f72b40f2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:35:27.472108 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-d42c035e-f7ee-4eb5-8ec0-5ce103f52e12 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 22 08:35:27.472108 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:27.472108 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:27.472108 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:27.472108 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:27.472108 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:27.472108 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:27.472108 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:27.472108 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:27.472108 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:27.472108 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:27.472108 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:27.472108 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:35:27.472108 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:35:27.472108 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:35:27.472108 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:35:27.473015 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:27.473015 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:27.473015 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:35:27.473015 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:35:27.473015 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:35:27.473015 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:35:27.473015 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:27.473015 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:27.473015 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:27.473015 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:27.473015 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:27.473015 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:27.473015 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:27.473015 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:27.473015 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:27.473015 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:27.473015 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:27.473015 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:27.473943 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:27.473943 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:27.473943 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:35:27.473943 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:35:27.473943 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:35:27.473943 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:35:27.473943 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:35:27.473943 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:35:27.473943 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 22 08:35:27.473943 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:27.473943 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 307/616] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Jun 22 08:35:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:27.490816 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c035e-f7ee-4eb5-8ec0-5ce103f52e12 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:27.494302 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-83fffd7c-fb58-4ca8-9c5d-636f72b40f2f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:35:27.494302 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:27.494302 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:27.494302 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:27.494302 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:27.494302 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:27.494302 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:27.494302 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:27.494302 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:27.494302 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:27.494302 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:27.494302 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:27.494302 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:35:27.494302 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:35:27.494302 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:35:27.494302 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:35:27.495244 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:35:27.495244 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:35:27.495244 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:35:27.495244 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:35:27.495244 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:27.495244 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:27.495244 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:27.495244 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:27.495244 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:27.495244 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:27.495244 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:27.495244 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:27.495244 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:27.495244 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:27.495244 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:27.495244 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:27.496070 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:27.496070 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:27.496070 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:27.496070 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:27.496070 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:35:27.496070 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:35:27.496070 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:35:27.496070 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:35:27.496070 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:35:27.496070 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:35:27.496070 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:35:27.496070 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:27.496694 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 310/617] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Jun 22 08:35:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 456 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:35:27.502806 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fffd7c-fb58-4ca8-9c5d-636f72b40f2f None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:27.663253 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c035e-f7ee-4eb5-8ec0-5ce103f52e12 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:27.712221 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59927df-3692-4be5-adf9-88ec9c4e8f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:27.712919 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59927df-3692-4be5-adf9-88ec9c4e8f73 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:27.713207 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59927df-3692-4be5-adf9-88ec9c4e8f73 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:27.713490 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59927df-3692-4be5-adf9-88ec9c4e8f73 None admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:27.714388 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59927df-3692-4be5-adf9-88ec9c4e8f73 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:27.714706 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59927df-3692-4be5-adf9-88ec9c4e8f73 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:27.716166 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59927df-3692-4be5-adf9-88ec9c4e8f73 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:27.750456 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:27.760521 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 308/618] 10.222.0.42 () {56 vars in 1135 bytes} [Wed Jun 22 08:35:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:35:27.777072 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fffd7c-fb58-4ca8-9c5d-636f72b40f2f None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:27.781567 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59927df-3692-4be5-adf9-88ec9c4e8f73 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:27.867051 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:27.870732 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daad7808-34b1-4b1b-95d3-a2e1ed600928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:27.871431 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daad7808-34b1-4b1b-95d3-a2e1ed600928 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:27.871704 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daad7808-34b1-4b1b-95d3-a2e1ed600928 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:27.872239 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daad7808-34b1-4b1b-95d3-a2e1ed600928 None admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:27.873097 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daad7808-34b1-4b1b-95d3-a2e1ed600928 None admin] RBAC: Adding query filter params (name=service) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:27.873418 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daad7808-34b1-4b1b-95d3-a2e1ed600928 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:27.875165 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daad7808-34b1-4b1b-95d3-a2e1ed600928 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:27.898974 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 311/619] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Jun 22 08:35:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:35:27.902013 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daad7808-34b1-4b1b-95d3-a2e1ed600928 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:28.005714 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59927df-3692-4be5-adf9-88ec9c4e8f73 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:28.073913 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13573a4-e461-4587-bef5-a19340f301cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:28.074840 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13573a4-e461-4587-bef5-a19340f301cc None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:28.075130 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13573a4-e461-4587-bef5-a19340f301cc None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:28.075403 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13573a4-e461-4587-bef5-a19340f301cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:28.095822 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13573a4-e461-4587-bef5-a19340f301cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:28.102120 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13573a4-e461-4587-bef5-a19340f301cc None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:28.120559 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daad7808-34b1-4b1b-95d3-a2e1ed600928 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:28.141845 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-b13573a4-e461-4587-bef5-a19340f301cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:28.141845 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:28.141845 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:28.141845 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:28.141845 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:28.141845 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:28.141845 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:28.141845 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:28.141845 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:28.141845 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:28.141845 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:28.141845 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:28.141845 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:35:28.141845 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:35:28.141845 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:35:28.142941 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:35:28.142941 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:28.142941 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:28.142941 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:28.142941 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:28.142941 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:28.142941 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:28.142941 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:28.142941 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:28.142941 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:28.142941 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:28.142941 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:28.142941 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:28.142941 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:28.142941 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:28.142941 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:28.142941 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:28.143825 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:35:28.143825 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:35:28.143825 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:28.143825 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:28.149255 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 309/620] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:35:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:28.153565 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13573a4-e461-4587-bef5-a19340f301cc None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:28.190192 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb5f80-3387-4fa8-a330-527a50951378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:28.191051 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb5f80-3387-4fa8-a330-527a50951378 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:28.191344 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb5f80-3387-4fa8-a330-527a50951378 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:28.191884 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb5f80-3387-4fa8-a330-527a50951378 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:28.209174 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeb5f80-3387-4fa8-a330-527a50951378 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:28.210709 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeb5f80-3387-4fa8-a330-527a50951378 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:28.224908 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:28.246943 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-5aeb5f80-3387-4fa8-a330-527a50951378 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:28.246943 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:28.246943 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:28.246943 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:28.246943 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:28.246943 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:28.246943 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:28.246943 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:28.246943 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:28.246943 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:28.246943 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:28.246943 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:28.246943 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:35:28.246943 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:35:28.246943 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:35:28.247891 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:35:28.247891 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:28.247891 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:28.247891 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:28.247891 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:28.247891 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:28.247891 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:28.247891 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:28.247891 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:28.247891 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:28.247891 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:28.247891 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:28.247891 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:28.247891 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:28.247891 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:28.247891 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:28.247891 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:28.248770 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:35:28.248770 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:35:28.248770 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:28.248770 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:28.258179 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 312/621] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:35:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:28.261208 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb5f80-3387-4fa8-a330-527a50951378 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:28.358651 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:28.369709 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13573a4-e461-4587-bef5-a19340f301cc None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:28.406655 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb5f80-3387-4fa8-a330-527a50951378 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:28.409690 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3460d9-6835-402a-bd29-2db3fe4f07c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:28.410734 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3460d9-6835-402a-bd29-2db3fe4f07c8 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:28.411234 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3460d9-6835-402a-bd29-2db3fe4f07c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:28.411733 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3460d9-6835-402a-bd29-2db3fe4f07c8 None admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:28.412686 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3460d9-6835-402a-bd29-2db3fe4f07c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:28.413207 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3460d9-6835-402a-bd29-2db3fe4f07c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:28.414867 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3460d9-6835-402a-bd29-2db3fe4f07c8 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:28.432057 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 310/622] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:35:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:28.433866 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3505bf9-6902-4f61-a35a-17c10d024910 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:28.434419 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3505bf9-6902-4f61-a35a-17c10d024910 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:28.434925 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3505bf9-6902-4f61-a35a-17c10d024910 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:28.436783 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 311/623] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:35:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:35:28.437744 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3505bf9-6902-4f61-a35a-17c10d024910 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:28.445422 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f39de-5b9b-4c30-82c9-6efc97a76f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:28.446753 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f39de-5b9b-4c30-82c9-6efc97a76f1a None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:28.446753 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f39de-5b9b-4c30-82c9-6efc97a76f1a None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:28.446957 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f39de-5b9b-4c30-82c9-6efc97a76f1a None admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:28.447563 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4f39de-5b9b-4c30-82c9-6efc97a76f1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:28.447877 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4f39de-5b9b-4c30-82c9-6efc97a76f1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:28.449256 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4f39de-5b9b-4c30-82c9-6efc97a76f1a None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:28.464021 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 313/624] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:35:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:28.465369 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c5167-b42b-4562-9a85-79f3aad9f79e None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:28.465663 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c5167-b42b-4562-9a85-79f3aad9f79e None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:28.465944 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c5167-b42b-4562-9a85-79f3aad9f79e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:28.486386 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-0a7c5167-b42b-4562-9a85-79f3aad9f79e None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:35:28.488198 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-0a7c5167-b42b-4562-9a85-79f3aad9f79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:35:28.550845 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:28.561140 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3505bf9-6902-4f61-a35a-17c10d024910 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:28.574104 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 314/625] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:35:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:35:28.574104 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c5167-b42b-4562-9a85-79f3aad9f79e None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:28.624203 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889065f1-de89-42f0-ad3a-1ee923ac3a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:28.625412 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889065f1-de89-42f0-ad3a-1ee923ac3a11 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:28.625911 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889065f1-de89-42f0-ad3a-1ee923ac3a11 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:28.626982 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889065f1-de89-42f0-ad3a-1ee923ac3a11 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:28.634944 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889065f1-de89-42f0-ad3a-1ee923ac3a11 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:28.636791 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889065f1-de89-42f0-ad3a-1ee923ac3a11 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:28.653039 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-889065f1-de89-42f0-ad3a-1ee923ac3a11 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:35:28.653039 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:28.653039 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:28.653039 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:28.653039 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:28.653039 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:28.653039 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:28.653039 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:28.653039 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:28.653039 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:28.653039 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:28.653039 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:28.653039 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:35:28.653039 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:35:28.653039 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:35:28.654024 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:35:28.654024 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:28.654024 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:28.654024 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:28.654024 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:28.654024 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:28.654024 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:28.654024 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:28.654024 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:28.654024 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:28.654024 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:28.654024 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:28.654024 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:28.654024 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:28.654024 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:28.654024 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:28.654024 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:28.654964 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:35:28.654964 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:35:28.654964 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:35:28.654964 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:35:28.654964 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:35:28.654964 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:35:28.654964 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:35:28.654964 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:28.661924 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 312/626] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Jun 22 08:35:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:28.663183 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889065f1-de89-42f0-ad3a-1ee923ac3a11 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:28.678918 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:28.685576 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c5167-b42b-4562-9a85-79f3aad9f79e None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:28.726065 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468eb0a9-d13e-4280-b6dd-382eb390dcb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:28.727021 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468eb0a9-d13e-4280-b6dd-382eb390dcb0 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:28.727223 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468eb0a9-d13e-4280-b6dd-382eb390dcb0 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:28.727470 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468eb0a9-d13e-4280-b6dd-382eb390dcb0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:28.736449 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468eb0a9-d13e-4280-b6dd-382eb390dcb0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:28.737987 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468eb0a9-d13e-4280-b6dd-382eb390dcb0 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:28.753917 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-468eb0a9-d13e-4280-b6dd-382eb390dcb0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 08:35:28.753917 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:28.753917 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:28.753917 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:28.753917 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:28.753917 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:28.753917 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:28.753917 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:28.753917 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:28.753917 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:28.753917 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:28.753917 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:28.753917 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:35:28.753917 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:35:28.753917 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:35:28.753917 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:35:28.754996 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:28.754996 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:28.754996 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:35:28.754996 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:35:28.754996 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:35:28.754996 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:35:28.754996 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:28.754996 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:28.754996 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:28.754996 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:28.754996 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:28.754996 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:28.754996 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:28.754996 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:28.754996 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:28.754996 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:28.754996 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:28.754996 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:28.755976 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:28.755976 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:28.755976 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:35:28.755976 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:35:28.755976 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:35:28.755976 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:35:28.755976 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:35:28.755976 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:35:28.755976 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 08:35:28.755976 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:28.755976 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 315/627] 10.222.0.42 () {56 vars in 1093 bytes} [Wed Jun 22 08:35:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:28.756584 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468eb0a9-d13e-4280-b6dd-382eb390dcb0 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:28.778337 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889065f1-de89-42f0-ad3a-1ee923ac3a11 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:28.811690 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:28.817550 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b69ce-11af-4771-afb3-09cc7c8e5b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:28.819424 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b69ce-11af-4771-afb3-09cc7c8e5b8c None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:28.819926 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b69ce-11af-4771-afb3-09cc7c8e5b8c None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:28.820413 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b69ce-11af-4771-afb3-09cc7c8e5b8c None admin] PATH_INFO: `/v3/roles/service` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:28.833179 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984b69ce-11af-4771-afb3-09cc7c8e5b8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:35:28.841760 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-984b69ce-11af-4771-afb3-09cc7c8e5b8c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:35:28.841760 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:28.841760 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:28.841760 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:28.841760 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:28.841760 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:28.841760 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:28.841760 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:28.841760 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:28.841760 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:28.841760 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:28.841760 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:28.841760 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:35:28.841760 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:35:28.841760 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:35:28.841760 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:35:28.843018 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:35:28.843018 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:35:28.843018 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:35:28.843018 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:35:28.843018 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:28.843018 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:28.843018 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:28.843018 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:28.843018 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:28.843018 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:28.843018 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:28.843018 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:28.843018 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:28.843018 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:28.843018 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:28.843018 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:28.844016 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:28.844016 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:28.844016 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:28.844016 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:28.844016 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:35:28.844016 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:35:28.844016 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:35:28.844016 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:35:28.844016 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:35:28.844016 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:35:28.844016 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:35:28.844016 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:28.850428 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 313/628] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Jun 22 08:35:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:28.851540 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b69ce-11af-4771-afb3-09cc7c8e5b8c None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:28.869465 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468eb0a9-d13e-4280-b6dd-382eb390dcb0 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:28.908271 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cedb2e5-00a1-459e-aecd-92c02fbe0fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:28.909411 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cedb2e5-00a1-459e-aecd-92c02fbe0fce None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:28.909708 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cedb2e5-00a1-459e-aecd-92c02fbe0fce None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:28.909987 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cedb2e5-00a1-459e-aecd-92c02fbe0fce None admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:28.910906 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cedb2e5-00a1-459e-aecd-92c02fbe0fce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:28.911222 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cedb2e5-00a1-459e-aecd-92c02fbe0fce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:28.912847 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cedb2e5-00a1-459e-aecd-92c02fbe0fce None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:28.929043 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 316/629] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Jun 22 08:35:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:28.930359 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cedb2e5-00a1-459e-aecd-92c02fbe0fce None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:28.931721 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:28.965955 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b69ce-11af-4771-afb3-09cc7c8e5b8c None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:29.000355 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c984308-4577-4d36-8cd2-81f8ca408cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:29.001320 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c984308-4577-4d36-8cd2-81f8ca408cdc None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:29.001609 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c984308-4577-4d36-8cd2-81f8ca408cdc None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:29.001893 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c984308-4577-4d36-8cd2-81f8ca408cdc None admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:29.002775 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c984308-4577-4d36-8cd2-81f8ca408cdc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:29.003090 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c984308-4577-4d36-8cd2-81f8ca408cdc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:29.004540 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c984308-4577-4d36-8cd2-81f8ca408cdc None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:29.022928 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 314/630] 10.222.0.42 () {56 vars in 1133 bytes} [Wed Jun 22 08:35:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:29.024248 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e0784-6e70-42a2-b60e-1ad0e48a727d None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:29.024537 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e0784-6e70-42a2-b60e-1ad0e48a727d None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:29.024818 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e0784-6e70-42a2-b60e-1ad0e48a727d None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:29.026064 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 315/631] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:35:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:35:29.026764 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e0784-6e70-42a2-b60e-1ad0e48a727d None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:29.040486 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cedb2e5-00a1-459e-aecd-92c02fbe0fce None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:29.050327 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:29.076948 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1bd16d-fabc-4e6c-a3b9-7b7b442ac447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:29.077540 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1bd16d-fabc-4e6c-a3b9-7b7b442ac447 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:29.077828 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1bd16d-fabc-4e6c-a3b9-7b7b442ac447 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:29.078145 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1bd16d-fabc-4e6c-a3b9-7b7b442ac447 None admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:29.078897 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1bd16d-fabc-4e6c-a3b9-7b7b442ac447 None admin] RBAC: Adding query filter params (name=service) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:29.079300 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1bd16d-fabc-4e6c-a3b9-7b7b442ac447 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:29.080625 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1bd16d-fabc-4e6c-a3b9-7b7b442ac447 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:29.089045 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 317/632] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Jun 22 08:35:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:29.090595 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21715e8e-1a3d-4ec1-a8a7-53ecc1e8d4b7 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:29.090711 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21715e8e-1a3d-4ec1-a8a7-53ecc1e8d4b7 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:29.090946 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21715e8e-1a3d-4ec1-a8a7-53ecc1e8d4b7 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:29.094125 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 318/633] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:35:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:35:29.094125 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21715e8e-1a3d-4ec1-a8a7-53ecc1e8d4b7 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:29.137570 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e0784-6e70-42a2-b60e-1ad0e48a727d None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:29.167984 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:29.174388 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7664212-9c92-4441-9f98-e0656c413052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:29.175284 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7664212-9c92-4441-9f98-e0656c413052 None admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:29.175572 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7664212-9c92-4441-9f98-e0656c413052 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:29.175848 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7664212-9c92-4441-9f98-e0656c413052 None admin] PATH_INFO: `/v3/projects/e1f161193cb440fa8c4a9d23820a5c28/users/4403cea84ff646b88cdb785975b20346/roles/e67c237283fd404d9a2bdf1333109696` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:29.192776 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7664212-9c92-4441-9f98-e0656c413052 None admin] RBAC: Authorizing `identity:create_grant(project_id=e1f161193cb440fa8c4a9d23820a5c28, user_id=4403cea84ff646b88cdb785975b20346, role_id=e67c237283fd404d9a2bdf1333109696)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:29.194300 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7664212-9c92-4441-9f98-e0656c413052 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:29.201408 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21715e8e-1a3d-4ec1-a8a7-53ecc1e8d4b7 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:29.208941 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 316/634] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Jun 22 08:35:29 2022] PUT /identity/v3/projects/e1f161193cb440fa8c4a9d23820a5c28/users/4403cea84ff646b88cdb785975b20346/roles/e67c237283fd404d9a2bdf1333109696 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:35:29.210255 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965affa-9468-459b-8a54-52329390e669 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:29.210548 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965affa-9468-459b-8a54-52329390e669 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:29.210827 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965affa-9468-459b-8a54-52329390e669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:29.235489 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-0965affa-9468-459b-8a54-52329390e669 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:35:29.236819 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-0965affa-9468-459b-8a54-52329390e669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:35:29.240050 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978e0171-0126-4479-b476-e379706c748d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:29.240720 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e0171-0126-4479-b476-e379706c748d None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:29.241007 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e0171-0126-4479-b476-e379706c748d None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:29.241284 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e0171-0126-4479-b476-e379706c748d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:29.292316 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:29.325906 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978e0171-0126-4479-b476-e379706c748d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:29.327762 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978e0171-0126-4479-b476-e379706c748d None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:29.334244 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 317/635] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:35:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:35:29.334244 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf45cf-50b9-42d1-930c-379f025a334f None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:29.334244 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf45cf-50b9-42d1-930c-379f025a334f None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:29.334244 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf45cf-50b9-42d1-930c-379f025a334f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:29.360180 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-9dcf45cf-50b9-42d1-930c-379f025a334f None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:35:29.361555 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-9dcf45cf-50b9-42d1-930c-379f025a334f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:35:29.444923 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 318/636] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:35:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:35:29.445666 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf45cf-50b9-42d1-930c-379f025a334f None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:29.454249 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 319/637] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Jun 22 08:35:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:35:29.456403 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978e0171-0126-4479-b476-e379706c748d None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:29.495888 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:29.539272 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:29.560745 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf45cf-50b9-42d1-930c-379f025a334f None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:29.574960 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978e0171-0126-4479-b476-e379706c748d None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:29.599254 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a3134-551c-4f8b-bc62-37bd8c90f933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:29.599975 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a3134-551c-4f8b-bc62-37bd8c90f933 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:29.600263 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a3134-551c-4f8b-bc62-37bd8c90f933 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:29.600542 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a3134-551c-4f8b-bc62-37bd8c90f933 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:29.612007 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14a3134-551c-4f8b-bc62-37bd8c90f933 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:29.612378 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5105e218-e707-40c6-90ea-c38c4539bf11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:29.613169 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105e218-e707-40c6-90ea-c38c4539bf11 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:29.613450 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105e218-e707-40c6-90ea-c38c4539bf11 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:29.613549 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14a3134-551c-4f8b-bc62-37bd8c90f933 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:29.613725 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105e218-e707-40c6-90ea-c38c4539bf11 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:29.624742 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5105e218-e707-40c6-90ea-c38c4539bf11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:35:29.632540 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-d14a3134-551c-4f8b-bc62-37bd8c90f933 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:29.632540 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:29.632540 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:29.632540 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:29.632540 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:29.632540 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:29.632540 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:29.632540 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:29.632540 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:29.632540 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:29.632540 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:29.632540 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:29.632540 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:35:29.632540 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:35:29.632540 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:35:29.633404 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:35:29.633404 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:29.633404 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:29.633404 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:29.633404 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:29.633404 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:29.633404 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:29.633404 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:29.633404 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:29.633404 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:29.633404 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:29.633404 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:29.633404 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:29.633404 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:29.633404 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:29.633404 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:29.633404 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:29.639931 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:35:29.639931 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:35:29.639931 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:29.639931 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:29.640157 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-5105e218-e707-40c6-90ea-c38c4539bf11 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:35:29.640157 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:29.640157 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:29.640157 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:29.640157 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:29.640157 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:29.640157 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:29.640157 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:29.640157 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:29.640157 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:29.640157 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:29.640157 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:29.640157 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:35:29.640157 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:35:29.640157 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:35:29.640157 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:35:29.641014 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:35:29.641014 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:35:29.641014 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:35:29.641014 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:35:29.641014 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:29.641014 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:29.641014 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:29.641014 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:29.641014 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:29.641014 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:29.641014 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:29.641014 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:29.641014 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:29.641014 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:29.641014 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:29.641014 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:29.641876 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:29.641876 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:29.641876 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:29.641876 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:29.641876 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:35:29.641876 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:35:29.641876 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:35:29.641876 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:35:29.641876 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:35:29.641876 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:35:29.641876 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:35:29.641876 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:29.643073 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 319/638] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:35:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:29.643144 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 320/639] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Jun 22 08:35:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:29.643144 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5105e218-e707-40c6-90ea-c38c4539bf11 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:29.643265 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a3134-551c-4f8b-bc62-37bd8c90f933 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:29.741558 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:29.751757 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a3134-551c-4f8b-bc62-37bd8c90f933 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:29.754753 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5105e218-e707-40c6-90ea-c38c4539bf11 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:29.785894 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:29.791946 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c7f3ed-c33d-4c1d-b71f-61364f966765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:29.792754 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c7f3ed-c33d-4c1d-b71f-61364f966765 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:29.793039 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c7f3ed-c33d-4c1d-b71f-61364f966765 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:29.793315 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c7f3ed-c33d-4c1d-b71f-61364f966765 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:29.795452 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ae376-b52a-4381-ad7a-70ab63a8ddb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:29.796250 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ae376-b52a-4381-ad7a-70ab63a8ddb7 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:29.796815 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ae376-b52a-4381-ad7a-70ab63a8ddb7 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:29.796815 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ae376-b52a-4381-ad7a-70ab63a8ddb7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:29.806002 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c7f3ed-c33d-4c1d-b71f-61364f966765 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:29.807510 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c7f3ed-c33d-4c1d-b71f-61364f966765 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:29.808492 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ae376-b52a-4381-ad7a-70ab63a8ddb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:35:29.817043 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-1b4ae376-b52a-4381-ad7a-70ab63a8ddb7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:35:29.817043 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:29.817043 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:29.817043 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:29.817043 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:29.817043 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:29.817043 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:29.817043 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:29.817043 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:29.817043 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:29.817043 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:29.817043 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:29.817043 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:35:29.817043 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:35:29.817043 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:35:29.817043 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:35:29.817981 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:35:29.817981 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:35:29.817981 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:35:29.817981 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:35:29.817981 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:29.817981 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:29.817981 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:29.817981 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:29.817981 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:29.817981 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:29.817981 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:29.817981 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:29.817981 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:29.817981 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:29.817981 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:29.817981 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:29.818840 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:29.818840 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:29.818840 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:29.818840 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:29.818840 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:35:29.818840 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:35:29.818840 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:35:29.818840 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:35:29.818840 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:35:29.818840 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:35:29.818840 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:35:29.818840 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:29.818840 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 321/640] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Jun 22 08:35:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:29.819507 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ae376-b52a-4381-ad7a-70ab63a8ddb7 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:29.833823 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-14c7f3ed-c33d-4c1d-b71f-61364f966765 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:29.833823 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:29.833823 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:29.833823 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:29.833823 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:29.833823 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:29.833823 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:29.833823 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:29.833823 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:29.833823 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:29.833823 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:29.833823 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:29.833823 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:35:29.833823 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:35:29.833823 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:35:29.835039 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:35:29.835039 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:29.835039 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:29.835039 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:29.835039 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:29.835039 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:29.835039 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:29.835039 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:29.835039 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:29.835039 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:29.835039 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:29.835039 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:29.835039 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:29.835039 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:29.835039 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:29.835039 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:29.835039 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:29.836128 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:35:29.836128 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:35:29.836128 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:29.836128 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:29.837163 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 320/641] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:35:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:29.837827 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c7f3ed-c33d-4c1d-b71f-61364f966765 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:29.938249 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ae376-b52a-4381-ad7a-70ab63a8ddb7 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:29.952177 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c7f3ed-c33d-4c1d-b71f-61364f966765 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:29.982115 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ceb58-c19a-462a-89b8-d5e0412d179c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:29.983304 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ceb58-c19a-462a-89b8-d5e0412d179c None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:29.983990 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ceb58-c19a-462a-89b8-d5e0412d179c None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:29.984823 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ceb58-c19a-462a-89b8-d5e0412d179c None admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:29.986017 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453ceb58-c19a-462a-89b8-d5e0412d179c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:29.986535 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453ceb58-c19a-462a-89b8-d5e0412d179c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:29.988068 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453ceb58-c19a-462a-89b8-d5e0412d179c None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:29.989349 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f60ab-b3d9-484f-83a6-617dd479cf5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:29.990009 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f60ab-b3d9-484f-83a6-617dd479cf5e None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:29.990325 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f60ab-b3d9-484f-83a6-617dd479cf5e None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:29.990601 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f60ab-b3d9-484f-83a6-617dd479cf5e None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:29.991347 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89f60ab-b3d9-484f-83a6-617dd479cf5e None admin] RBAC: Adding query filter params (name=service) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:29.991651 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89f60ab-b3d9-484f-83a6-617dd479cf5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:29.993021 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89f60ab-b3d9-484f-83a6-617dd479cf5e None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:30.001807 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 321/642] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Jun 22 08:35:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:30.002677 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f60ab-b3d9-484f-83a6-617dd479cf5e None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:30.008835 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 322/643] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:35:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:30.009681 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ceb58-c19a-462a-89b8-d5e0412d179c None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:30.012469 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:30.069309 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:30.113170 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f60ab-b3d9-484f-83a6-617dd479cf5e None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:30.123614 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ceb58-c19a-462a-89b8-d5e0412d179c None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:30.154756 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1b70ee-6c5f-490d-905c-0edeb537ce94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:30.155615 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b70ee-6c5f-490d-905c-0edeb537ce94 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:30.155728 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b70ee-6c5f-490d-905c-0edeb537ce94 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:30.156015 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b70ee-6c5f-490d-905c-0edeb537ce94 None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:30.156817 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1b70ee-6c5f-490d-905c-0edeb537ce94 None admin] RBAC: Adding query filter params (name=service) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:30.157077 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1b70ee-6c5f-490d-905c-0edeb537ce94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:30.158528 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1b70ee-6c5f-490d-905c-0edeb537ce94 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:30.163588 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b655d1-c848-46a3-b445-7a09c51cf248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:30.164257 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b655d1-c848-46a3-b445-7a09c51cf248 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:30.164541 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b655d1-c848-46a3-b445-7a09c51cf248 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:30.164815 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b655d1-c848-46a3-b445-7a09c51cf248 None admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:30.165545 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b655d1-c848-46a3-b445-7a09c51cf248 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:30.165856 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b655d1-c848-46a3-b445-7a09c51cf248 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:30.167282 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b655d1-c848-46a3-b445-7a09c51cf248 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:30.168745 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 322/644] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Jun 22 08:35:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:30.170248 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1b70ee-6c5f-490d-905c-0edeb537ce94 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:30.180074 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 323/645] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:35:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:30.180912 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b655d1-c848-46a3-b445-7a09c51cf248 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:30.250115 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:30.292397 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1b70ee-6c5f-490d-905c-0edeb537ce94 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:30.306447 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b655d1-c848-46a3-b445-7a09c51cf248 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:30.318525 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:30.334719 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370fc240-d559-4de4-9390-a37d78f4fdcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:30.335819 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370fc240-d559-4de4-9390-a37d78f4fdcd None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:30.336319 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370fc240-d559-4de4-9390-a37d78f4fdcd None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:30.336601 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370fc240-d559-4de4-9390-a37d78f4fdcd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:30.349636 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6354987-22bb-4286-98fb-2579b7b4ec12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:30.349995 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370fc240-d559-4de4-9390-a37d78f4fdcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:30.350577 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6354987-22bb-4286-98fb-2579b7b4ec12 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:30.350865 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6354987-22bb-4286-98fb-2579b7b4ec12 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:30.351146 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6354987-22bb-4286-98fb-2579b7b4ec12 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:30.351489 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370fc240-d559-4de4-9390-a37d78f4fdcd None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:30.361999 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6354987-22bb-4286-98fb-2579b7b4ec12 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:30.363672 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6354987-22bb-4286-98fb-2579b7b4ec12 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:30.370657 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-370fc240-d559-4de4-9390-a37d78f4fdcd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:30.370657 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:30.370657 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:30.370657 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:30.370657 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:30.370657 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:30.370657 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:30.370657 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:30.370657 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:30.370657 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:30.370657 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:30.370657 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:30.370657 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:35:30.370657 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:35:30.370657 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:35:30.371682 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:35:30.371682 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:30.371682 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:30.371682 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:30.371682 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:30.371682 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:30.371682 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:30.371682 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:30.371682 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:30.371682 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:30.371682 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:30.371682 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:30.371682 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:30.371682 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:30.371682 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:30.371682 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:30.371682 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:30.373372 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:35:30.373372 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:35:30.373372 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:30.373372 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:30.373372 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 323/646] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:35:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:30.373372 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370fc240-d559-4de4-9390-a37d78f4fdcd None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:30.383666 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-d6354987-22bb-4286-98fb-2579b7b4ec12 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 22 08:35:30.383666 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:30.383666 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:30.383666 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:30.383666 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:30.383666 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:30.383666 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:30.383666 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:30.383666 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:30.383666 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:30.383666 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:30.383666 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:30.383666 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:35:30.383666 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:35:30.383666 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:35:30.383666 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:35:30.384712 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:30.384712 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:30.384712 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:35:30.384712 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:35:30.384712 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:35:30.384712 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:35:30.384712 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:30.384712 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:30.384712 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:30.384712 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:30.384712 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:30.384712 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:30.384712 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:30.384712 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:30.384712 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:30.384712 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:30.384712 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:30.384712 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:30.385650 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:30.385650 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:30.385650 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:35:30.385650 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:35:30.385650 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:35:30.385650 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:35:30.385650 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:35:30.385650 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:35:30.385650 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 22 08:35:30.385650 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:30.389507 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 324/647] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Jun 22 08:35:30 2022] GET /identity/v3/users/glance => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:30.390284 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6354987-22bb-4286-98fb-2579b7b4ec12 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:30.492973 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370fc240-d559-4de4-9390-a37d78f4fdcd None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:30.500638 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6354987-22bb-4286-98fb-2579b7b4ec12 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:30.515133 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:30.532343 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff542b3-4757-4497-9ddd-0d5c6e201c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:30.534050 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff542b3-4757-4497-9ddd-0d5c6e201c3a None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:30.534485 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff542b3-4757-4497-9ddd-0d5c6e201c3a None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:30.534767 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff542b3-4757-4497-9ddd-0d5c6e201c3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:30.539982 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b28358-45b2-4bed-99dd-e852f67197f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:30.540782 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b28358-45b2-4bed-99dd-e852f67197f3 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:30.541069 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b28358-45b2-4bed-99dd-e852f67197f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:30.541350 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b28358-45b2-4bed-99dd-e852f67197f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:30.546314 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff542b3-4757-4497-9ddd-0d5c6e201c3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:30.547790 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff542b3-4757-4497-9ddd-0d5c6e201c3a None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:30.548835 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b28358-45b2-4bed-99dd-e852f67197f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:30.550330 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b28358-45b2-4bed-99dd-e852f67197f3 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:30.565267 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-b5b28358-45b2-4bed-99dd-e852f67197f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:35:30.565267 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:30.565267 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:30.565267 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:30.565267 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:30.565267 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:30.565267 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:30.565267 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:30.565267 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:30.565267 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:30.565267 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:30.565267 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:30.565267 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:35:30.565267 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:35:30.565267 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:35:30.566346 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:35:30.566346 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:30.566346 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:30.566346 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:30.566346 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:30.566346 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:30.566346 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:30.566346 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:30.566346 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:30.566346 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:30.566346 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:30.566346 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:30.566346 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:30.566346 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:30.566346 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:30.566346 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:30.566346 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:30.567268 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:35:30.567268 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:35:30.567268 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:35:30.567268 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:35:30.567268 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:35:30.567268 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:35:30.567268 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:35:30.567268 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:30.567692 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-dff542b3-4757-4497-9ddd-0d5c6e201c3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:30.567692 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:30.567692 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:30.567692 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:30.567692 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:30.567692 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:30.567692 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:30.567692 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:30.567692 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:30.567692 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:30.567692 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:30.567692 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:30.567692 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:35:30.567692 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:35:30.567692 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:35:30.568475 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:35:30.568475 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:30.568475 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:30.568475 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:30.568475 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:30.568475 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:30.568475 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:30.568475 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:30.568475 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:30.568475 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:30.568475 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:30.568475 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:30.568475 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:30.568475 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:30.568475 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:30.568475 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:30.568475 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:30.569353 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:35:30.569353 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:35:30.569353 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:30.569353 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:30.569567 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 325/648] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Jun 22 08:35:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:30.569567 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b28358-45b2-4bed-99dd-e852f67197f3 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:30.571769 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 324/649] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:35:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:30.572557 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff542b3-4757-4497-9ddd-0d5c6e201c3a None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:30.607902 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:30.685766 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b28358-45b2-4bed-99dd-e852f67197f3 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:30.691296 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff542b3-4757-4497-9ddd-0d5c6e201c3a None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:30.728633 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab3e9a-9267-4571-ad9a-f3ac64eb0f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:30.729309 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab3e9a-9267-4571-ad9a-f3ac64eb0f4d None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:30.729597 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab3e9a-9267-4571-ad9a-f3ac64eb0f4d None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:30.729878 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab3e9a-9267-4571-ad9a-f3ac64eb0f4d None admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:30.730762 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab3e9a-9267-4571-ad9a-f3ac64eb0f4d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:30.731079 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab3e9a-9267-4571-ad9a-f3ac64eb0f4d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:30.731250 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598bfb34-d043-4dde-880e-00fe81000472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:30.732365 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598bfb34-d043-4dde-880e-00fe81000472 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:30.732517 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab3e9a-9267-4571-ad9a-f3ac64eb0f4d None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:30.733020 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598bfb34-d043-4dde-880e-00fe81000472 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:30.733571 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598bfb34-d043-4dde-880e-00fe81000472 None admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:30.735068 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598bfb34-d043-4dde-880e-00fe81000472 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:30.736283 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598bfb34-d043-4dde-880e-00fe81000472 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:30.738888 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598bfb34-d043-4dde-880e-00fe81000472 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:30.757270 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 325/650] 10.222.0.42 () {56 vars in 1137 bytes} [Wed Jun 22 08:35:30 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:30.757270 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab3e9a-9267-4571-ad9a-f3ac64eb0f4d None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:30.763700 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 326/651] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:35:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:30.768681 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598bfb34-d043-4dde-880e-00fe81000472 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:30.787198 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:30.868375 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:30.868638 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab3e9a-9267-4571-ad9a-f3ac64eb0f4d None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:30.881608 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598bfb34-d043-4dde-880e-00fe81000472 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:30.908137 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af3a72-fb7c-4e15-bacc-b901c0d40e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:30.909141 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af3a72-fb7c-4e15-bacc-b901c0d40e72 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:30.909428 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af3a72-fb7c-4e15-bacc-b901c0d40e72 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:30.909705 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af3a72-fb7c-4e15-bacc-b901c0d40e72 None admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:30.910542 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00af3a72-fb7c-4e15-bacc-b901c0d40e72 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:30.910857 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00af3a72-fb7c-4e15-bacc-b901c0d40e72 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:30.912306 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00af3a72-fb7c-4e15-bacc-b901c0d40e72 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:30.922208 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3013c-836d-4f25-8bfe-159d2a47464e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:30.923799 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3013c-836d-4f25-8bfe-159d2a47464e None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:30.924270 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3013c-836d-4f25-8bfe-159d2a47464e None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:30.924757 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3013c-836d-4f25-8bfe-159d2a47464e None admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:30.931016 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 326/652] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Jun 22 08:35:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:30.931016 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af3a72-fb7c-4e15-bacc-b901c0d40e72 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:30.931298 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d3013c-836d-4f25-8bfe-159d2a47464e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:30.931298 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d3013c-836d-4f25-8bfe-159d2a47464e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:30.931298 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d3013c-836d-4f25-8bfe-159d2a47464e None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:30.949996 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 327/653] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:35:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:30.950899 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3013c-836d-4f25-8bfe-159d2a47464e None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:31.048975 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:31.058595 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3013c-836d-4f25-8bfe-159d2a47464e None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:31.061038 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af3a72-fb7c-4e15-bacc-b901c0d40e72 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:31.096463 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67641f5-54eb-44a4-8d12-bf7fe09079a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:31.097457 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67641f5-54eb-44a4-8d12-bf7fe09079a2 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:31.097827 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67641f5-54eb-44a4-8d12-bf7fe09079a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:31.098212 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67641f5-54eb-44a4-8d12-bf7fe09079a2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:31.098542 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e924da56-0083-4d4e-adce-01d1c404233e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:31.099456 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924da56-0083-4d4e-adce-01d1c404233e None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:31.099809 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924da56-0083-4d4e-adce-01d1c404233e None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:31.100157 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924da56-0083-4d4e-adce-01d1c404233e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:31.106269 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67641f5-54eb-44a4-8d12-bf7fe09079a2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:31.107833 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67641f5-54eb-44a4-8d12-bf7fe09079a2 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:31.122910 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-b67641f5-54eb-44a4-8d12-bf7fe09079a2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 08:35:31.122910 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:31.122910 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:31.122910 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:31.122910 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:31.122910 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:31.122910 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:31.122910 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:31.122910 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:31.122910 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:31.122910 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:31.122910 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:31.122910 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:35:31.122910 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:35:31.122910 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:35:31.122910 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:35:31.123895 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:31.123895 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:31.123895 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:35:31.123895 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:35:31.123895 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:35:31.123895 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:35:31.123895 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:31.123895 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:31.123895 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:31.123895 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:31.123895 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:31.123895 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:31.123895 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:31.123895 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:31.123895 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:31.123895 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:31.123895 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:31.123895 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:31.124812 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:31.124812 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:31.124812 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:35:31.124812 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:35:31.124812 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:35:31.124812 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:35:31.124812 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:35:31.124812 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:35:31.124812 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 08:35:31.124812 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:31.124812 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 328/654] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Jun 22 08:35:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:31.125406 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67641f5-54eb-44a4-8d12-bf7fe09079a2 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:31.138211 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:31.181571 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e924da56-0083-4d4e-adce-01d1c404233e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:31.183104 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e924da56-0083-4d4e-adce-01d1c404233e None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:31.234966 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67641f5-54eb-44a4-8d12-bf7fe09079a2 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:31.277201 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc551a-4016-4329-bb24-e77b6444b637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:31.278154 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc551a-4016-4329-bb24-e77b6444b637 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:31.278455 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc551a-4016-4329-bb24-e77b6444b637 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:31.278731 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc551a-4016-4329-bb24-e77b6444b637 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:31.279584 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abc551a-4016-4329-bb24-e77b6444b637 None admin] RBAC: Adding query filter params (role.id=e67c237283fd404d9a2bdf1333109696, scope.project.id=e1f161193cb440fa8c4a9d23820a5c28, user.id=4f1809a35b244c1db7a185d82859369e) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:31.279899 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abc551a-4016-4329-bb24-e77b6444b637 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:31.281366 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abc551a-4016-4329-bb24-e77b6444b637 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:31.288518 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 329/655] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Jun 22 08:35:31 2022] GET /identity/v3/role_assignments?user.id=4f1809a35b244c1db7a185d82859369e&scope.project.id=e1f161193cb440fa8c4a9d23820a5c28&role.id=e67c237283fd404d9a2bdf1333109696 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:31.288695 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:31.289144 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc551a-4016-4329-bb24-e77b6444b637 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:31.310857 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 327/656] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Jun 22 08:35:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:35:31.316953 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e924da56-0083-4d4e-adce-01d1c404233e None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:31.395746 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:31.426802 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc551a-4016-4329-bb24-e77b6444b637 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:31.444448 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e924da56-0083-4d4e-adce-01d1c404233e None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:31.472889 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938a0ceb-68eb-464e-833d-34c5addf8abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:31.473737 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a0ceb-68eb-464e-833d-34c5addf8abe None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:31.474024 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a0ceb-68eb-464e-833d-34c5addf8abe None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:31.474334 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a0ceb-68eb-464e-833d-34c5addf8abe None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:31.489891 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938a0ceb-68eb-464e-833d-34c5addf8abe None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:31.491954 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938a0ceb-68eb-464e-833d-34c5addf8abe None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:31.509086 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679f875b-4468-4b13-992e-6ad07199dcb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:31.509855 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f875b-4468-4b13-992e-6ad07199dcb6 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:31.510232 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f875b-4468-4b13-992e-6ad07199dcb6 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:31.510522 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f875b-4468-4b13-992e-6ad07199dcb6 None admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:31.511382 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679f875b-4468-4b13-992e-6ad07199dcb6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:31.511700 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679f875b-4468-4b13-992e-6ad07199dcb6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:31.513181 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679f875b-4468-4b13-992e-6ad07199dcb6 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:31.517457 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-938a0ceb-68eb-464e-833d-34c5addf8abe None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 22 08:35:31.517457 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:31.517457 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:31.517457 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:31.517457 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:31.517457 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:31.517457 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:31.517457 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:31.517457 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:31.517457 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:31.517457 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:31.517457 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:31.517457 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:35:31.517457 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:35:31.517457 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:35:31.517457 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:35:31.519852 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:31.519852 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:31.519852 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:35:31.519852 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:35:31.519852 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:35:31.519852 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:35:31.519852 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:31.519852 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:31.519852 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:31.519852 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:31.519852 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:31.519852 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:31.519852 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:31.519852 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:31.519852 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:31.519852 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:31.519852 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:31.519852 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:31.520807 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:31.520807 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:31.520807 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:35:31.520807 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:35:31.520807 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:35:31.520807 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:35:31.520807 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:35:31.520807 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:35:31.520807 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 22 08:35:31.520807 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:31.520807 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 330/657] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Jun 22 08:35:31 2022] GET /identity/v3/users/neutron => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:31.521910 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b204e-e403-401b-821d-792c5a612cb7 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:31.526122 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b204e-e403-401b-821d-792c5a612cb7 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:31.526122 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b204e-e403-401b-821d-792c5a612cb7 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:31.526122 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 331/658] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:35:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:35:31.527346 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b204e-e403-401b-821d-792c5a612cb7 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:31.539094 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 328/659] 10.222.0.42 () {56 vars in 1137 bytes} [Wed Jun 22 08:35:31 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:31.539959 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679f875b-4468-4b13-992e-6ad07199dcb6 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:31.615889 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:31.696337 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b204e-e403-401b-821d-792c5a612cb7 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:31.698279 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679f875b-4468-4b13-992e-6ad07199dcb6 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:31.743832 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5380d7-4da9-4c96-8c61-077cba2a1fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:31.744861 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5380d7-4da9-4c96-8c61-077cba2a1fa7 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:31.745323 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5380d7-4da9-4c96-8c61-077cba2a1fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:31.745733 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5380d7-4da9-4c96-8c61-077cba2a1fa7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:31.746839 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e188af8-ba8b-470e-9841-5321f8803c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:31.747617 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e188af8-ba8b-470e-9841-5321f8803c11 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:31.747951 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e188af8-ba8b-470e-9841-5321f8803c11 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:31.748282 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e188af8-ba8b-470e-9841-5321f8803c11 None admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:31.748540 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:31.749351 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e188af8-ba8b-470e-9841-5321f8803c11 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:31.749784 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e188af8-ba8b-470e-9841-5321f8803c11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:31.751751 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e188af8-ba8b-470e-9841-5321f8803c11 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:31.760301 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5380d7-4da9-4c96-8c61-077cba2a1fa7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:31.761986 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5380d7-4da9-4c96-8c61-077cba2a1fa7 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:31.775314 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 329/660] 10.222.0.42 () {56 vars in 1139 bytes} [Wed Jun 22 08:35:31 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:31.777848 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897c38d-3f51-4d20-b79e-221e9b800e90 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:31.778681 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897c38d-3f51-4d20-b79e-221e9b800e90 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:31.779469 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897c38d-3f51-4d20-b79e-221e9b800e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:31.781857 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-ff5380d7-4da9-4c96-8c61-077cba2a1fa7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:31.781857 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:31.781857 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:31.781857 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:31.781857 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:31.781857 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:31.781857 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:31.781857 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:31.781857 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:31.781857 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:31.781857 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:31.781857 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:31.781857 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:35:31.781857 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:35:31.781857 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:35:31.783990 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:35:31.783990 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:31.783990 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:31.783990 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:31.783990 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:31.783990 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:31.783990 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:31.783990 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:31.783990 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:31.783990 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:31.783990 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:31.783990 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:31.783990 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:31.783990 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:31.783990 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:31.783990 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:31.783990 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:31.786551 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:35:31.786551 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:35:31.786551 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:31.786551 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:31.786551 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 332/661] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:35:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:31.786551 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5380d7-4da9-4c96-8c61-077cba2a1fa7 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:31.808877 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-1897c38d-3f51-4d20-b79e-221e9b800e90 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:35:31.810586 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-1897c38d-3f51-4d20-b79e-221e9b800e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:35:31.918118 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5380d7-4da9-4c96-8c61-077cba2a1fa7 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:31.918707 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 330/662] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:35:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:35:31.920252 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1897c38d-3f51-4d20-b79e-221e9b800e90 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:31.973730 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2826d83d-a570-4252-9f6a-b45976675dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:31.974797 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2826d83d-a570-4252-9f6a-b45976675dab None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:31.975278 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2826d83d-a570-4252-9f6a-b45976675dab None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:31.975754 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2826d83d-a570-4252-9f6a-b45976675dab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:31.988716 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:32.064519 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:32.086125 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2826d83d-a570-4252-9f6a-b45976675dab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:32.088995 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2826d83d-a570-4252-9f6a-b45976675dab None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:32.096822 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1897c38d-3f51-4d20-b79e-221e9b800e90 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:32.159092 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa75e683-c3b6-4199-b6ae-2f5f4e7780f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:32.159745 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75e683-c3b6-4199-b6ae-2f5f4e7780f9 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:32.160138 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75e683-c3b6-4199-b6ae-2f5f4e7780f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:32.160298 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75e683-c3b6-4199-b6ae-2f5f4e7780f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:32.228877 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 333/663] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Jun 22 08:35:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:35:32.230057 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2826d83d-a570-4252-9f6a-b45976675dab None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:32.258922 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa75e683-c3b6-4199-b6ae-2f5f4e7780f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:32.261697 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa75e683-c3b6-4199-b6ae-2f5f4e7780f9 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:32.312670 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:32.332220 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:32.350386 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2826d83d-a570-4252-9f6a-b45976675dab None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:32.394717 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e7e80-8081-4cf5-97d4-01ee16a1581c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:32.395970 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e7e80-8081-4cf5-97d4-01ee16a1581c None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:32.396461 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e7e80-8081-4cf5-97d4-01ee16a1581c None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:32.396976 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e7e80-8081-4cf5-97d4-01ee16a1581c None admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:32.398436 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137e7e80-8081-4cf5-97d4-01ee16a1581c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:32.399007 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137e7e80-8081-4cf5-97d4-01ee16a1581c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:32.400796 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 331/664] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Jun 22 08:35:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:35:32.401796 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa75e683-c3b6-4199-b6ae-2f5f4e7780f9 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:32.401922 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137e7e80-8081-4cf5-97d4-01ee16a1581c None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:32.425117 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 334/665] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:35:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:32.426743 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e7e80-8081-4cf5-97d4-01ee16a1581c None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:32.570190 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e7e80-8081-4cf5-97d4-01ee16a1581c None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:32.582860 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa75e683-c3b6-4199-b6ae-2f5f4e7780f9 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:32.628240 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a05544f-c7ed-4b73-896b-c35e043b4dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:32.629505 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05544f-c7ed-4b73-896b-c35e043b4dff None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:32.629981 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05544f-c7ed-4b73-896b-c35e043b4dff None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:32.630470 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05544f-c7ed-4b73-896b-c35e043b4dff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:32.646800 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea83b586-76ad-48f0-961c-3f09523c5215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:32.647818 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83b586-76ad-48f0-961c-3f09523c5215 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:32.648279 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83b586-76ad-48f0-961c-3f09523c5215 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:32.648809 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83b586-76ad-48f0-961c-3f09523c5215 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:32.651325 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a05544f-c7ed-4b73-896b-c35e043b4dff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:32.653606 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a05544f-c7ed-4b73-896b-c35e043b4dff None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:32.653961 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:32.673685 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:32.681137 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea83b586-76ad-48f0-961c-3f09523c5215 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:35:32.694967 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-5a05544f-c7ed-4b73-896b-c35e043b4dff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:32.694967 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:32.694967 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:32.694967 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:32.694967 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:32.694967 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:32.694967 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:32.694967 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:32.694967 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:32.694967 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:32.694967 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:32.694967 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:32.694967 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:35:32.694967 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:35:32.694967 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:35:32.695918 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:35:32.695918 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:32.695918 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:32.695918 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:32.695918 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:32.695918 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:32.695918 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:32.695918 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:32.695918 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:32.695918 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:32.695918 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:32.695918 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:32.695918 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:32.695918 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:32.695918 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:32.695918 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:32.695918 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:32.696828 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:35:32.696828 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:35:32.696828 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:32.696828 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:32.697051 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-ea83b586-76ad-48f0-961c-3f09523c5215 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:35:32.697051 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:32.697051 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:32.697051 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:32.697051 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:32.697051 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:32.697051 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:32.697051 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:32.697051 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:32.697051 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:32.697051 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:32.697051 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:32.697051 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:35:32.697051 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:35:32.697051 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:35:32.697051 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:35:32.697870 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:35:32.697870 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:35:32.697870 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:35:32.697870 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:35:32.697870 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:32.697870 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:32.697870 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:32.697870 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:32.697870 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:32.697870 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:32.697870 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:32.697870 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:32.697870 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:32.697870 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:32.697870 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:32.697870 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:32.699891 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:32.699891 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:32.699891 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:32.699891 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:32.699891 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:35:32.699891 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:35:32.699891 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:35:32.699891 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:35:32.699891 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:35:32.699891 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:35:32.699891 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:35:32.699891 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:32.702420 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 332/666] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Jun 22 08:35:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:32.703734 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 335/667] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:35:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:32.704078 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea83b586-76ad-48f0-961c-3f09523c5215 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:32.704896 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a05544f-c7ed-4b73-896b-c35e043b4dff None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:32.811279 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea83b586-76ad-48f0-961c-3f09523c5215 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:32.811499 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a05544f-c7ed-4b73-896b-c35e043b4dff None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:32.848834 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa4019-5dee-416d-95bf-8d7ca7ba2a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:32.849028 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61355c40-1e8a-4fca-819e-661653267c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:32.849540 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61355c40-1e8a-4fca-819e-661653267c16 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:32.849662 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa4019-5dee-416d-95bf-8d7ca7ba2a9b None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:32.849817 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa4019-5dee-416d-95bf-8d7ca7ba2a9b None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:32.849911 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61355c40-1e8a-4fca-819e-661653267c16 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:32.850116 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61355c40-1e8a-4fca-819e-661653267c16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:32.850213 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa4019-5dee-416d-95bf-8d7ca7ba2a9b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:32.857627 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa4019-5dee-416d-95bf-8d7ca7ba2a9b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:32.859521 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa4019-5dee-416d-95bf-8d7ca7ba2a9b None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:32.861720 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61355c40-1e8a-4fca-819e-661653267c16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:32.863191 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61355c40-1e8a-4fca-819e-661653267c16 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:32.874632 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-96fa4019-5dee-416d-95bf-8d7ca7ba2a9b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:35:32.874632 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:32.874632 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:32.874632 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:32.874632 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:32.874632 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:32.874632 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:32.874632 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:32.874632 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:32.874632 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:32.874632 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:32.874632 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:32.874632 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:35:32.874632 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:35:32.874632 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:35:32.875571 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:35:32.875571 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:32.875571 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:32.875571 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:32.875571 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:32.875571 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:32.875571 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:32.875571 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:32.875571 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:32.875571 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:32.875571 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:32.875571 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:32.875571 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:32.875571 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:32.875571 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:32.875571 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:32.875571 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:32.877058 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:35:32.877058 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:35:32.877058 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:35:32.877058 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:35:32.877058 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:35:32.877058 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:35:32.877058 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:35:32.877058 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:32.881239 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 336/668] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Jun 22 08:35:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:32.881868 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa4019-5dee-416d-95bf-8d7ca7ba2a9b None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:32.881974 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-61355c40-1e8a-4fca-819e-661653267c16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:32.881974 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:32.881974 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:32.881974 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:32.881974 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:32.881974 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:32.881974 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:32.881974 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:32.881974 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:32.881974 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:32.881974 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:32.881974 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:32.881974 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:35:32.881974 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:35:32.881974 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:35:32.883044 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:35:32.883044 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:32.883044 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:32.883044 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:32.883044 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:32.883044 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:32.883044 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:32.883044 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:32.883044 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:32.883044 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:32.883044 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:32.883044 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:32.883044 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:32.883044 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:32.883044 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:32.883044 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:32.883044 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:32.885784 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:35:32.885784 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:35:32.885784 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:32.885784 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:32.885784 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 333/669] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:35:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:32.885784 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61355c40-1e8a-4fca-819e-661653267c16 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:32.938266 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:32.949587 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:32.997557 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa4019-5dee-416d-95bf-8d7ca7ba2a9b None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:32.997795 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61355c40-1e8a-4fca-819e-661653267c16 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:33.037623 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ccf19e-8844-40bc-b77f-f9d0edcaa1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:33.038332 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ccf19e-8844-40bc-b77f-f9d0edcaa1de None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:33.038621 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ccf19e-8844-40bc-b77f-f9d0edcaa1de None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:33.038937 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ccf19e-8844-40bc-b77f-f9d0edcaa1de None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:33.039700 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ccf19e-8844-40bc-b77f-f9d0edcaa1de None admin] RBAC: Adding query filter params (name=service) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:33.039818 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a205b3-e53c-4f8f-a7ea-2c9656f303ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:33.040009 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ccf19e-8844-40bc-b77f-f9d0edcaa1de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:33.040458 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a205b3-e53c-4f8f-a7ea-2c9656f303ff None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:33.040714 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a205b3-e53c-4f8f-a7ea-2c9656f303ff None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:33.040985 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a205b3-e53c-4f8f-a7ea-2c9656f303ff None admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:33.041402 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ccf19e-8844-40bc-b77f-f9d0edcaa1de None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:33.041711 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a205b3-e53c-4f8f-a7ea-2c9656f303ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:33.042014 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a205b3-e53c-4f8f-a7ea-2c9656f303ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:33.043402 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a205b3-e53c-4f8f-a7ea-2c9656f303ff None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:33.050988 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 334/670] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Jun 22 08:35:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:33.051571 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ccf19e-8844-40bc-b77f-f9d0edcaa1de None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:33.064278 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 337/671] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:35:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:33.064278 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a205b3-e53c-4f8f-a7ea-2c9656f303ff None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:33.171626 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ccf19e-8844-40bc-b77f-f9d0edcaa1de None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:33.175537 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a205b3-e53c-4f8f-a7ea-2c9656f303ff None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:33.184594 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:33.195882 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:33.214041 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c49dca-a642-427b-823d-3ea2ea7f8df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:33.214392 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296450d2-491a-40af-a6fa-1fae99530492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:33.214858 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c49dca-a642-427b-823d-3ea2ea7f8df1 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:33.215146 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296450d2-491a-40af-a6fa-1fae99530492 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:33.215267 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c49dca-a642-427b-823d-3ea2ea7f8df1 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:33.215420 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c49dca-a642-427b-823d-3ea2ea7f8df1 None admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:33.215511 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296450d2-491a-40af-a6fa-1fae99530492 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:33.215714 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296450d2-491a-40af-a6fa-1fae99530492 None admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:33.216267 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c49dca-a642-427b-823d-3ea2ea7f8df1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:33.216451 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296450d2-491a-40af-a6fa-1fae99530492 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:33.216598 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c49dca-a642-427b-823d-3ea2ea7f8df1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:33.216744 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296450d2-491a-40af-a6fa-1fae99530492 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:33.218052 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c49dca-a642-427b-823d-3ea2ea7f8df1 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:33.218178 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296450d2-491a-40af-a6fa-1fae99530492 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:33.235528 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 338/672] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:35:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:33.235742 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 335/673] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Jun 22 08:35:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:33.235742 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c49dca-a642-427b-823d-3ea2ea7f8df1 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:33.235925 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296450d2-491a-40af-a6fa-1fae99530492 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:33.350917 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c49dca-a642-427b-823d-3ea2ea7f8df1 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:33.351273 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296450d2-491a-40af-a6fa-1fae99530492 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:33.388475 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca2460-1305-4473-ae8a-0ea127f4491f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:33.389267 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca2460-1305-4473-ae8a-0ea127f4491f None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:33.389546 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca2460-1305-4473-ae8a-0ea127f4491f None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:33.389816 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca2460-1305-4473-ae8a-0ea127f4491f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:33.390542 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000419aa-b161-43d9-84d3-3e92d9b54617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:33.391504 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000419aa-b161-43d9-84d3-3e92d9b54617 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:33.392538 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000419aa-b161-43d9-84d3-3e92d9b54617 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:33.392908 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000419aa-b161-43d9-84d3-3e92d9b54617 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:33.401602 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000419aa-b161-43d9-84d3-3e92d9b54617 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:33.402029 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ca2460-1305-4473-ae8a-0ea127f4491f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:33.403106 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000419aa-b161-43d9-84d3-3e92d9b54617 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:33.403730 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ca2460-1305-4473-ae8a-0ea127f4491f None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:33.418264 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-000419aa-b161-43d9-84d3-3e92d9b54617 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:35:33.418264 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:33.418264 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:33.418264 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:33.418264 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:33.418264 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:33.418264 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:33.418264 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:33.418264 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:33.418264 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:33.418264 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:33.418264 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:33.418264 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:35:33.418264 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:35:33.418264 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:35:33.419389 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:35:33.419389 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:33.419389 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:33.419389 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:33.419389 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:33.419389 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:33.419389 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:33.419389 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:33.419389 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:33.419389 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:33.419389 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:33.419389 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:33.419389 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:33.419389 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:33.419389 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:33.419389 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:33.419389 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:33.420512 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:35:33.420512 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:35:33.420512 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:35:33.420512 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:35:33.420512 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:35:33.420512 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:35:33.420512 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:35:33.420512 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:33.424261 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 336/674] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Jun 22 08:35:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:33.425297 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000419aa-b161-43d9-84d3-3e92d9b54617 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:33.426760 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-02ca2460-1305-4473-ae8a-0ea127f4491f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:33.426760 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:33.426760 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:33.426760 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:33.426760 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:33.426760 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:33.426760 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:33.426760 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:33.426760 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:33.426760 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:33.426760 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:33.426760 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:33.426760 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:35:33.426760 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:35:33.426760 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:35:33.427868 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:35:33.427868 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:33.427868 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:33.427868 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:33.427868 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:33.427868 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:33.427868 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:33.427868 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:33.427868 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:33.427868 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:33.427868 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:33.427868 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:33.427868 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:33.427868 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:33.427868 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:33.427868 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:33.427868 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:33.429052 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:35:33.429052 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:35:33.429052 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:33.429052 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:33.433845 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 339/675] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:35:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:33.434580 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca2460-1305-4473-ae8a-0ea127f4491f None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:33.459795 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:33.471909 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:33.535971 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000419aa-b161-43d9-84d3-3e92d9b54617 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:33.546113 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca2460-1305-4473-ae8a-0ea127f4491f None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:33.573454 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ca586a-7c10-4c17-88c8-bf2a35c3a4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:33.574425 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca586a-7c10-4c17-88c8-bf2a35c3a4a7 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:33.574818 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca586a-7c10-4c17-88c8-bf2a35c3a4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:33.575203 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca586a-7c10-4c17-88c8-bf2a35c3a4a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:33.581252 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ff71a-2d62-45fe-a2d3-65e93e52ac22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:33.581905 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ff71a-2d62-45fe-a2d3-65e93e52ac22 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:33.582261 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ff71a-2d62-45fe-a2d3-65e93e52ac22 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:33.582543 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ff71a-2d62-45fe-a2d3-65e93e52ac22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:33.582874 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ca586a-7c10-4c17-88c8-bf2a35c3a4a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:33.583375 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5ff71a-2d62-45fe-a2d3-65e93e52ac22 None admin] RBAC: Adding query filter params (role.id=e67c237283fd404d9a2bdf1333109696, scope.project.id=e1f161193cb440fa8c4a9d23820a5c28, user.id=589eb8cc97714580840ac7a48ea38ee8) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:33.583684 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5ff71a-2d62-45fe-a2d3-65e93e52ac22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:33.584342 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ca586a-7c10-4c17-88c8-bf2a35c3a4a7 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:33.585113 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5ff71a-2d62-45fe-a2d3-65e93e52ac22 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:33.591174 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 340/676] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Jun 22 08:35:33 2022] GET /identity/v3/role_assignments?user.id=589eb8cc97714580840ac7a48ea38ee8&scope.project.id=e1f161193cb440fa8c4a9d23820a5c28&role.id=e67c237283fd404d9a2bdf1333109696 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:33.591975 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ff71a-2d62-45fe-a2d3-65e93e52ac22 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:33.599592 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-44ca586a-7c10-4c17-88c8-bf2a35c3a4a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:35:33.599592 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:33.599592 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:33.599592 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:33.599592 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:33.599592 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:33.599592 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:33.599592 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:33.599592 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:33.599592 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:33.599592 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:33.599592 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:33.599592 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:35:33.599592 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:35:33.599592 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:35:33.607164 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:35:33.607164 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:33.607164 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:33.607164 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:33.607164 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:33.607164 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:33.607164 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:33.607164 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:33.607164 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:33.607164 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:33.607164 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:33.607164 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:33.607164 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:33.607164 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:33.607164 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:33.607164 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:33.607164 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:33.608293 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:35:33.608293 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:35:33.608293 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:35:33.608293 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:35:33.608293 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:35:33.608293 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:35:33.608293 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:35:33.608293 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:33.608293 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 337/677] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Jun 22 08:35:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:33.608293 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ca586a-7c10-4c17-88c8-bf2a35c3a4a7 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:33.712407 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:33.714567 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:33.721678 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ff71a-2d62-45fe-a2d3-65e93e52ac22 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:33.729237 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ca586a-7c10-4c17-88c8-bf2a35c3a4a7 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:33.767913 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1886dcd2-4b45-4726-8303-16305dbd05f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:33.768704 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886dcd2-4b45-4726-8303-16305dbd05f9 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:33.769078 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886dcd2-4b45-4726-8303-16305dbd05f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:33.769366 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886dcd2-4b45-4726-8303-16305dbd05f9 None admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:33.770462 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1886dcd2-4b45-4726-8303-16305dbd05f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:33.770779 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1886dcd2-4b45-4726-8303-16305dbd05f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:33.771884 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d957c89-deb2-4f4d-9f1d-565aff0fef13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:33.772234 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1886dcd2-4b45-4726-8303-16305dbd05f9 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:33.772413 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d957c89-deb2-4f4d-9f1d-565aff0fef13 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:33.773093 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d957c89-deb2-4f4d-9f1d-565aff0fef13 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:33.773093 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d957c89-deb2-4f4d-9f1d-565aff0fef13 None admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:33.773784 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d957c89-deb2-4f4d-9f1d-565aff0fef13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:33.773974 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d957c89-deb2-4f4d-9f1d-565aff0fef13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:33.775481 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d957c89-deb2-4f4d-9f1d-565aff0fef13 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:33.785622 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 341/678] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Jun 22 08:35:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:33.787003 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7eadb-c576-4416-b1c0-eb3993058375 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:33.787294 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7eadb-c576-4416-b1c0-eb3993058375 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:33.787572 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7eadb-c576-4416-b1c0-eb3993058375 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:33.788854 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 342/679] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:35:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:35:33.789657 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd7eadb-c576-4416-b1c0-eb3993058375 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:33.790061 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 338/680] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:35:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:33.796091 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d957c89-deb2-4f4d-9f1d-565aff0fef13 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:33.909809 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd7eadb-c576-4416-b1c0-eb3993058375 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:33.915638 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d957c89-deb2-4f4d-9f1d-565aff0fef13 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:33.946853 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e581cd44-f04a-4694-925a-dae26a8516ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:33.947516 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581cd44-f04a-4694-925a-dae26a8516ee None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:33.947789 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581cd44-f04a-4694-925a-dae26a8516ee None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:33.948070 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581cd44-f04a-4694-925a-dae26a8516ee None admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:33.948864 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e581cd44-f04a-4694-925a-dae26a8516ee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:33.949170 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e581cd44-f04a-4694-925a-dae26a8516ee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:33.950748 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e581cd44-f04a-4694-925a-dae26a8516ee None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:33.953304 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf5a80-2e3b-41b6-85a6-559e15d9d606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:33.954117 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf5a80-2e3b-41b6-85a6-559e15d9d606 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:33.954565 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf5a80-2e3b-41b6-85a6-559e15d9d606 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:33.954943 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf5a80-2e3b-41b6-85a6-559e15d9d606 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:33.955919 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbf5a80-2e3b-41b6-85a6-559e15d9d606 None admin] RBAC: Adding query filter params (role.id=e67c237283fd404d9a2bdf1333109696, scope.project.id=e1f161193cb440fa8c4a9d23820a5c28, user.id=b4a2701c65144851ad87ac77fccb686f) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:33.956362 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbf5a80-2e3b-41b6-85a6-559e15d9d606 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:33.957876 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbf5a80-2e3b-41b6-85a6-559e15d9d606 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:33.969709 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 343/681] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Jun 22 08:35:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:33.970454 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 339/682] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Jun 22 08:35:33 2022] GET /identity/v3/role_assignments?user.id=b4a2701c65144851ad87ac77fccb686f&scope.project.id=e1f161193cb440fa8c4a9d23820a5c28&role.id=e67c237283fd404d9a2bdf1333109696 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:33.970556 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f2e86-2bdf-42f5-a02c-32ff306da601 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:33.970641 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf5a80-2e3b-41b6-85a6-559e15d9d606 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:33.970723 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f2e86-2bdf-42f5-a02c-32ff306da601 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:33.970723 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f2e86-2bdf-42f5-a02c-32ff306da601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:33.993399 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:33.994153 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-ce6f2e86-2bdf-42f5-a02c-32ff306da601 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:35:33.995690 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-ce6f2e86-2bdf-42f5-a02c-32ff306da601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:35:34.009101 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:34.094502 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 344/683] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:35:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:35:34.096210 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f2e86-2bdf-42f5-a02c-32ff306da601 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:34.144868 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf5a80-2e3b-41b6-85a6-559e15d9d606 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:34.200259 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8c3296-004e-4c07-9710-54b1f4350028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:34.201771 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c3296-004e-4c07-9710-54b1f4350028 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:34.202387 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c3296-004e-4c07-9710-54b1f4350028 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:34.203165 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c3296-004e-4c07-9710-54b1f4350028 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:34.215564 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8c3296-004e-4c07-9710-54b1f4350028 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:34.218226 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8c3296-004e-4c07-9710-54b1f4350028 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:34.237840 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-7a8c3296-004e-4c07-9710-54b1f4350028 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 22 08:35:34.237840 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:34.237840 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:34.237840 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:34.237840 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:34.237840 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:34.237840 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:34.237840 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:34.237840 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:34.237840 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:34.237840 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:34.237840 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:34.237840 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:35:34.237840 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:35:34.237840 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:35:34.237840 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:35:34.238984 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:34.238984 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:34.238984 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:35:34.238984 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:35:34.238984 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:35:34.238984 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:35:34.238984 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:34.238984 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:34.238984 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:34.238984 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:34.238984 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:34.238984 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:34.238984 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:34.238984 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:34.238984 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:34.238984 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:34.238984 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:34.238984 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:34.240135 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:34.240135 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:34.240135 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:35:34.240135 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:35:34.240135 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:35:34.240135 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:35:34.240135 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:35:34.240135 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:35:34.240135 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 22 08:35:34.240135 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:34.242501 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 340/684] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Jun 22 08:35:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:34.243494 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8c3296-004e-4c07-9710-54b1f4350028 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:34.264512 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f2e86-2bdf-42f5-a02c-32ff306da601 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:34.303039 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a188a74-d277-4ee1-a865-607c0edb38a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:34.304141 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a188a74-d277-4ee1-a865-607c0edb38a4 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:34.304557 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a188a74-d277-4ee1-a865-607c0edb38a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:34.304933 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a188a74-d277-4ee1-a865-607c0edb38a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:34.306109 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a188a74-d277-4ee1-a865-607c0edb38a4 None admin] RBAC: Adding query filter params (role.id=e67c237283fd404d9a2bdf1333109696, scope.project.id=e1f161193cb440fa8c4a9d23820a5c28, user.id=751f037ff70d4eb8acb4e8d4c5c487ad) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:34.306876 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a188a74-d277-4ee1-a865-607c0edb38a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:34.308571 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a188a74-d277-4ee1-a865-607c0edb38a4 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:34.317068 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 345/685] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Jun 22 08:35:34 2022] GET /identity/v3/role_assignments?user.id=751f037ff70d4eb8acb4e8d4c5c487ad&scope.project.id=e1f161193cb440fa8c4a9d23820a5c28&role.id=e67c237283fd404d9a2bdf1333109696 => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:34.318262 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a188a74-d277-4ee1-a865-607c0edb38a4 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:34.331720 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:34.338557 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:34.375330 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8c3296-004e-4c07-9710-54b1f4350028 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:34.460411 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa06fc-823c-4eb2-927e-e2f28c35648a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:34.461653 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa06fc-823c-4eb2-927e-e2f28c35648a None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:34.462175 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa06fc-823c-4eb2-927e-e2f28c35648a None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:34.462664 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa06fc-823c-4eb2-927e-e2f28c35648a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:34.481921 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaa06fc-823c-4eb2-927e-e2f28c35648a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:35:34.491887 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-baaa06fc-823c-4eb2-927e-e2f28c35648a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:35:34.491887 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:34.491887 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:34.491887 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:34.491887 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:34.491887 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:34.491887 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:34.491887 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:34.491887 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:34.491887 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:34.491887 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:34.491887 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:34.491887 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:35:34.491887 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:35:34.491887 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:35:34.491887 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:35:34.492878 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:35:34.492878 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:35:34.492878 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:35:34.492878 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:35:34.492878 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:34.492878 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:34.492878 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:34.492878 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:34.492878 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:34.492878 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:34.492878 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:34.492878 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:34.492878 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:34.492878 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:34.492878 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:34.492878 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:34.493708 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:34.493708 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:34.493708 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:34.493708 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:34.493708 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:35:34.493708 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:35:34.493708 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:35:34.493708 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:35:34.493708 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:35:34.493708 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:35:34.493708 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:35:34.493708 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:34.496674 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 341/686] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Jun 22 08:35:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:34.502951 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa06fc-823c-4eb2-927e-e2f28c35648a None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:34.526629 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a188a74-d277-4ee1-a865-607c0edb38a4 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:34.569025 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de3500a-a04e-4e72-9cf4-d85f0285be4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:34.569704 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3500a-a04e-4e72-9cf4-d85f0285be4e None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:34.570037 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3500a-a04e-4e72-9cf4-d85f0285be4e None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:34.570359 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3500a-a04e-4e72-9cf4-d85f0285be4e None admin] PATH_INFO: `/v3/users` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:34.571261 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de3500a-a04e-4e72-9cf4-d85f0285be4e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:34.571571 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de3500a-a04e-4e72-9cf4-d85f0285be4e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:34.573071 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de3500a-a04e-4e72-9cf4-d85f0285be4e None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:34.594604 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 346/687] 10.222.0.42 () {56 vars in 1135 bytes} [Wed Jun 22 08:35:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:34.602466 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de3500a-a04e-4e72-9cf4-d85f0285be4e None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:34.647363 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa06fc-823c-4eb2-927e-e2f28c35648a None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:34.687938 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432e1c0-8d8f-4e48-824c-995ae39d4fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:34.689175 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432e1c0-8d8f-4e48-824c-995ae39d4fac None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:34.689456 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432e1c0-8d8f-4e48-824c-995ae39d4fac None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:34.689732 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432e1c0-8d8f-4e48-824c-995ae39d4fac None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:34.691678 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4432e1c0-8d8f-4e48-824c-995ae39d4fac None admin] RBAC: Adding query filter params (name=admin) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:34.691990 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4432e1c0-8d8f-4e48-824c-995ae39d4fac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:34.693380 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4432e1c0-8d8f-4e48-824c-995ae39d4fac None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:34.694320 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:34.695169 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:34.708275 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 342/688] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Jun 22 08:35:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:34.714038 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432e1c0-8d8f-4e48-824c-995ae39d4fac None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:34.747799 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de3500a-a04e-4e72-9cf4-d85f0285be4e None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:34.796254 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec92a03a-06e2-451a-bb4a-96af503098ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:34.797170 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec92a03a-06e2-451a-bb4a-96af503098ee None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:34.797526 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec92a03a-06e2-451a-bb4a-96af503098ee None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:34.797999 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec92a03a-06e2-451a-bb4a-96af503098ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:34.843105 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432e1c0-8d8f-4e48-824c-995ae39d4fac None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:34.879121 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec92a03a-06e2-451a-bb4a-96af503098ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:34.880690 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec92a03a-06e2-451a-bb4a-96af503098ee None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:34.883073 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa75a3-6a92-46d7-93ae-918e7b9f851a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:34.884300 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa75a3-6a92-46d7-93ae-918e7b9f851a None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:34.884827 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa75a3-6a92-46d7-93ae-918e7b9f851a None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:34.885337 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa75a3-6a92-46d7-93ae-918e7b9f851a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:34.898938 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa75a3-6a92-46d7-93ae-918e7b9f851a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:34.900893 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa75a3-6a92-46d7-93ae-918e7b9f851a None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:34.937164 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-67fa75a3-6a92-46d7-93ae-918e7b9f851a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:34.937164 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:34.937164 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:34.937164 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:34.937164 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:34.937164 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:34.937164 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:34.937164 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:34.937164 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:34.937164 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:34.937164 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:34.937164 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:34.937164 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:35:34.937164 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:35:34.937164 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:35:34.939570 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:35:34.939570 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:34.939570 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:34.939570 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:34.939570 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:34.939570 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:34.939570 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:34.939570 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:34.939570 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:34.939570 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:34.939570 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:34.939570 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:34.939570 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:34.939570 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:34.939570 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:34.939570 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:34.939570 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:34.940478 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:35:34.940478 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:35:34.940478 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:34.940478 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:34.940478 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 343/689] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:35:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:34.956334 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa75a3-6a92-46d7-93ae-918e7b9f851a None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:34.959623 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:34.999722 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 347/690] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Jun 22 08:35:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:35:35.007140 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec92a03a-06e2-451a-bb4a-96af503098ee None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:35.093123 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:35.151225 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec92a03a-06e2-451a-bb4a-96af503098ee None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:35.198161 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa75a3-6a92-46d7-93ae-918e7b9f851a None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:35.214870 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc96fc8-0f36-498c-96c6-e13120a0c260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:35.215695 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc96fc8-0f36-498c-96c6-e13120a0c260 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:35.215980 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc96fc8-0f36-498c-96c6-e13120a0c260 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:35.216285 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc96fc8-0f36-498c-96c6-e13120a0c260 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:35.239830 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc96fc8-0f36-498c-96c6-e13120a0c260 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:35.241349 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc96fc8-0f36-498c-96c6-e13120a0c260 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:35.276614 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af99d2b7-300d-4e53-892e-55c9c2e1d092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:35.277522 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-9fc96fc8-0f36-498c-96c6-e13120a0c260 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:35.277522 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:35.277522 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:35.277522 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:35.277522 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:35.277522 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:35.277522 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:35.277522 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:35.277522 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:35.277522 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:35.277522 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:35.277522 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:35.277522 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:35:35.277522 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:35:35.277522 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:35:35.278630 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:35:35.278630 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:35.278630 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:35.278630 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:35.278630 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:35.278630 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:35.278630 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:35.278630 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:35.278630 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:35.278630 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:35.278630 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:35.278630 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:35.278630 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:35.278630 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:35.278630 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:35.278630 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:35.278630 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:35.279719 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:35:35.279719 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:35:35.279719 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:35.279719 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:35.279719 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 348/691] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:35:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:35.280306 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99d2b7-300d-4e53-892e-55c9c2e1d092 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:35.280800 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99d2b7-300d-4e53-892e-55c9c2e1d092 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:35.281235 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99d2b7-300d-4e53-892e-55c9c2e1d092 None admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:35.285502 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc96fc8-0f36-498c-96c6-e13120a0c260 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:35.285911 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af99d2b7-300d-4e53-892e-55c9c2e1d092 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:35.286477 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af99d2b7-300d-4e53-892e-55c9c2e1d092 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:35.288112 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af99d2b7-300d-4e53-892e-55c9c2e1d092 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:35.310375 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 344/692] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:35:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:35:35.317487 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af99d2b7-300d-4e53-892e-55c9c2e1d092 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:35.322522 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:35.477055 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc96fc8-0f36-498c-96c6-e13120a0c260 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:35.533484 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af99d2b7-300d-4e53-892e-55c9c2e1d092 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:35.548128 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a077d-4917-4dcc-b812-c9bc5a1f33c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:35.549111 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a077d-4917-4dcc-b812-c9bc5a1f33c0 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:35.549407 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a077d-4917-4dcc-b812-c9bc5a1f33c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:35.549689 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a077d-4917-4dcc-b812-c9bc5a1f33c0 None admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:35.550463 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1a077d-4917-4dcc-b812-c9bc5a1f33c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:35.550775 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1a077d-4917-4dcc-b812-c9bc5a1f33c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:35.552161 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1a077d-4917-4dcc-b812-c9bc5a1f33c0 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:35.555657 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:35.585428 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 349/693] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:35:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:35.591508 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a077d-4917-4dcc-b812-c9bc5a1f33c0 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:35.613280 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365fa7c-d35b-4676-9eba-1004a7202556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:35.614103 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365fa7c-d35b-4676-9eba-1004a7202556 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:35.617350 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365fa7c-d35b-4676-9eba-1004a7202556 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:35.617673 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365fa7c-d35b-4676-9eba-1004a7202556 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:35.638947 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b365fa7c-d35b-4676-9eba-1004a7202556 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:35.640442 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b365fa7c-d35b-4676-9eba-1004a7202556 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:35.661697 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-b365fa7c-d35b-4676-9eba-1004a7202556 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 08:35:35.661697 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:35.661697 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:35.661697 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:35.661697 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:35.661697 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:35.661697 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:35.661697 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:35.661697 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:35.661697 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:35.661697 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:35.661697 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:35.661697 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:35:35.661697 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:35:35.661697 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:35:35.661697 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:35:35.662759 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:35.662759 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:35.662759 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:35:35.662759 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:35:35.662759 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:35:35.662759 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:35:35.662759 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:35.662759 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:35.662759 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:35.662759 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:35.662759 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:35.662759 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:35.662759 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:35.662759 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:35.662759 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:35.662759 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:35.662759 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:35.662759 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:35.663672 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:35.663672 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:35.663672 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:35:35.663672 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:35:35.663672 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:35:35.663672 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:35:35.663672 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:35:35.663672 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:35:35.663672 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 08:35:35.663672 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:35.667524 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 345/694] 10.222.0.42 () {56 vars in 1093 bytes} [Wed Jun 22 08:35:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:35.668790 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365fa7c-d35b-4676-9eba-1004a7202556 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:35.711945 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:35.739311 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a077d-4917-4dcc-b812-c9bc5a1f33c0 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:35.773563 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365fa7c-d35b-4676-9eba-1004a7202556 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:35.777869 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a950b88-0250-45c9-870e-66e672c53867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:35.778711 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a950b88-0250-45c9-870e-66e672c53867 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:35.779000 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a950b88-0250-45c9-870e-66e672c53867 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:35.779279 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a950b88-0250-45c9-870e-66e672c53867 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:35.787900 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a950b88-0250-45c9-870e-66e672c53867 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:35.789682 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a950b88-0250-45c9-870e-66e672c53867 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:35.805664 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-8a950b88-0250-45c9-870e-66e672c53867 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:35:35.805664 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:35.805664 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:35.805664 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:35.805664 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:35.805664 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:35.805664 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:35.805664 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:35.805664 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:35.805664 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:35.805664 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:35.805664 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:35.805664 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:35:35.805664 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:35:35.805664 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:35:35.807599 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:35:35.807599 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:35.807599 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:35.807599 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:35.807599 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:35.807599 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:35.807599 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:35.807599 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:35.807599 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:35.807599 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:35.807599 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:35.807599 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:35.807599 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:35.807599 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:35.807599 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:35.807599 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:35.807599 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:35.808941 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:35:35.808941 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:35:35.808941 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:35:35.808941 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:35:35.808941 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:35:35.808941 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:35:35.808941 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:35:35.808941 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:35.808941 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 350/695] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Jun 22 08:35:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:35.813067 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a950b88-0250-45c9-870e-66e672c53867 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:35.814787 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa48553-a236-4327-9dbd-3c1f683d780d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:35.815475 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa48553-a236-4327-9dbd-3c1f683d780d None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:35.815765 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa48553-a236-4327-9dbd-3c1f683d780d None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:35.816043 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa48553-a236-4327-9dbd-3c1f683d780d None admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:35.816903 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa48553-a236-4327-9dbd-3c1f683d780d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:35.817213 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa48553-a236-4327-9dbd-3c1f683d780d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:35.818735 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa48553-a236-4327-9dbd-3c1f683d780d None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:35.842578 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 346/696] 10.222.0.42 () {56 vars in 1133 bytes} [Wed Jun 22 08:35:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:35.843875 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa48553-a236-4327-9dbd-3c1f683d780d None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:35.874837 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:35.955643 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa48553-a236-4327-9dbd-3c1f683d780d None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:35.976878 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a950b88-0250-45c9-870e-66e672c53867 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:35.996140 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9165074-3da4-4e26-a1dd-6acc6dd19c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:35.996971 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9165074-3da4-4e26-a1dd-6acc6dd19c56 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:35.997314 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9165074-3da4-4e26-a1dd-6acc6dd19c56 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:35.997676 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9165074-3da4-4e26-a1dd-6acc6dd19c56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:36.028340 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63adf6e-e9b3-4446-b4e1-4e074aba1fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:36.029435 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63adf6e-e9b3-4446-b4e1-4e074aba1fe1 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:36.029837 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63adf6e-e9b3-4446-b4e1-4e074aba1fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:36.030486 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63adf6e-e9b3-4446-b4e1-4e074aba1fe1 None admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:36.031947 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63adf6e-e9b3-4446-b4e1-4e074aba1fe1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:36.033138 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63adf6e-e9b3-4446-b4e1-4e074aba1fe1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:36.034852 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63adf6e-e9b3-4446-b4e1-4e074aba1fe1 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:36.043437 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:36.049894 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 351/697] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Jun 22 08:35:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:35:36.051828 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ff7a6-497c-43bb-a9bb-df6912713a4e None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:36.052268 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ff7a6-497c-43bb-a9bb-df6912713a4e None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:36.052684 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ff7a6-497c-43bb-a9bb-df6912713a4e None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:36.054863 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 352/698] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:35:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:35:36.056045 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55ff7a6-497c-43bb-a9bb-df6912713a4e None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:36.091471 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9165074-3da4-4e26-a1dd-6acc6dd19c56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:36.093437 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9165074-3da4-4e26-a1dd-6acc6dd19c56 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:36.130868 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:36.201451 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55ff7a6-497c-43bb-a9bb-df6912713a4e None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:36.236071 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 347/699] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Jun 22 08:35:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:35:36.237708 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70701fb-bafc-4871-8db5-82ea0b4a6b39 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:36.238006 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70701fb-bafc-4871-8db5-82ea0b4a6b39 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:36.238325 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70701fb-bafc-4871-8db5-82ea0b4a6b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:36.246617 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa361d94-7133-469e-826d-f0788a5e09b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:36.247284 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa361d94-7133-469e-826d-f0788a5e09b0 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:36.247568 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa361d94-7133-469e-826d-f0788a5e09b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:36.247845 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa361d94-7133-469e-826d-f0788a5e09b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:36.248684 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa361d94-7133-469e-826d-f0788a5e09b0 None admin] RBAC: Adding query filter params (role.id=e67c237283fd404d9a2bdf1333109696, scope.project.id=e1f161193cb440fa8c4a9d23820a5c28, user.id=4403cea84ff646b88cdb785975b20346) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:36.248995 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa361d94-7133-469e-826d-f0788a5e09b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:36.252980 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa361d94-7133-469e-826d-f0788a5e09b0 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:36.261446 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-a70701fb-bafc-4871-8db5-82ea0b4a6b39 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:35:36.262486 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-a70701fb-bafc-4871-8db5-82ea0b4a6b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:35:36.269335 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 353/700] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Jun 22 08:35:36 2022] GET /identity/v3/role_assignments?user.id=4403cea84ff646b88cdb785975b20346&scope.project.id=e1f161193cb440fa8c4a9d23820a5c28&role.id=e67c237283fd404d9a2bdf1333109696 => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:36.270807 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa361d94-7133-469e-826d-f0788a5e09b0 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:36.349466 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:36.413452 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 348/701] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:35:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:35:36.414897 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16969468-598d-45c2-9507-7658610c006e None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:36.415194 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16969468-598d-45c2-9507-7658610c006e None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:36.415477 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16969468-598d-45c2-9507-7658610c006e None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:36.417244 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 349/702] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:35:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:35:36.419656 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa361d94-7133-469e-826d-f0788a5e09b0 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:36.422678 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f08e055-00a7-44ff-addb-74983031122d None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:36.423551 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f08e055-00a7-44ff-addb-74983031122d None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:36.423839 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f08e055-00a7-44ff-addb-74983031122d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:36.454812 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-2f08e055-00a7-44ff-addb-74983031122d None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:35:36.456369 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-2f08e055-00a7-44ff-addb-74983031122d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:35:36.458120 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2051952-fbac-46f2-aca1-968ad7d6bd46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:36.458944 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2051952-fbac-46f2-aca1-968ad7d6bd46 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:36.459230 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2051952-fbac-46f2-aca1-968ad7d6bd46 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:36.459512 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2051952-fbac-46f2-aca1-968ad7d6bd46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:36.472953 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2051952-fbac-46f2-aca1-968ad7d6bd46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:36.474538 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2051952-fbac-46f2-aca1-968ad7d6bd46 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:36.494434 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-c2051952-fbac-46f2-aca1-968ad7d6bd46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:36.494434 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:36.494434 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:36.494434 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:36.494434 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:36.494434 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:36.494434 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:36.494434 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:36.494434 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:36.494434 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:36.494434 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:36.494434 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:36.494434 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:35:36.494434 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:35:36.494434 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:35:36.495460 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:35:36.495460 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:36.495460 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:36.495460 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:36.495460 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:36.495460 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:36.495460 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:36.495460 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:36.495460 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:36.495460 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:36.495460 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:36.495460 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:36.495460 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:36.495460 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:36.495460 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:36.495460 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:36.495460 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:36.496397 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:35:36.496397 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:35:36.496397 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:36.496397 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:36.496397 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 354/703] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:35:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:36.496716 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2051952-fbac-46f2-aca1-968ad7d6bd46 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:36.523969 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:36.547678 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 350/704] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:35:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:35:36.548636 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f08e055-00a7-44ff-addb-74983031122d None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:36.619970 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2051952-fbac-46f2-aca1-968ad7d6bd46 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:36.637326 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:36.669839 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aa6632-4c6c-4a6e-93a5-4edafce58fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:36.670716 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa6632-4c6c-4a6e-93a5-4edafce58fba None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:36.671028 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa6632-4c6c-4a6e-93a5-4edafce58fba None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:36.671498 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa6632-4c6c-4a6e-93a5-4edafce58fba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:36.691935 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aa6632-4c6c-4a6e-93a5-4edafce58fba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:36.694928 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aa6632-4c6c-4a6e-93a5-4edafce58fba None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:36.703276 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f08e055-00a7-44ff-addb-74983031122d None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:36.727887 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-42aa6632-4c6c-4a6e-93a5-4edafce58fba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:36.727887 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:36.727887 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:36.727887 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:36.727887 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:36.727887 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:36.727887 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:36.727887 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:36.727887 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:36.727887 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:36.727887 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:36.727887 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:36.727887 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:35:36.727887 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:35:36.727887 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:35:36.729907 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:35:36.729907 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:36.729907 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:36.729907 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:36.729907 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:36.729907 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:36.729907 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:36.729907 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:36.729907 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:36.729907 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:36.729907 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:36.729907 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:36.729907 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:36.729907 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:36.729907 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:36.729907 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:36.729907 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:36.731447 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:35:36.731447 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:35:36.731447 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:36.731447 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:36.735114 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 355/705] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:35:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:36.744232 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aa6632-4c6c-4a6e-93a5-4edafce58fba None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:36.758806 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674fdc8c-c79a-4dc3-8158-265c93dd0d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:36.759906 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674fdc8c-c79a-4dc3-8158-265c93dd0d7c None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:36.760350 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674fdc8c-c79a-4dc3-8158-265c93dd0d7c None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:36.760859 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674fdc8c-c79a-4dc3-8158-265c93dd0d7c None admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:36.762139 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674fdc8c-c79a-4dc3-8158-265c93dd0d7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:36.762670 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674fdc8c-c79a-4dc3-8158-265c93dd0d7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:36.765196 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674fdc8c-c79a-4dc3-8158-265c93dd0d7c None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:36.787300 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 351/706] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:35:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:36.794589 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674fdc8c-c79a-4dc3-8158-265c93dd0d7c None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:36.873182 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:36.930525 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aa6632-4c6c-4a6e-93a5-4edafce58fba None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:36.980851 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674fdc8c-c79a-4dc3-8158-265c93dd0d7c None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:36.991508 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63246f20-a771-491a-86b6-2950332f7ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:36.992593 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63246f20-a771-491a-86b6-2950332f7ca5 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:36.993036 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63246f20-a771-491a-86b6-2950332f7ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:36.993499 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63246f20-a771-491a-86b6-2950332f7ca5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:36.994349 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63246f20-a771-491a-86b6-2950332f7ca5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:36.995943 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63246f20-a771-491a-86b6-2950332f7ca5 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:37.011771 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-63246f20-a771-491a-86b6-2950332f7ca5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 08:35:37.011771 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:37.011771 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:35:37.011771 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:35:37.011771 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:35:37.011771 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:35:37.011771 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:35:37.011771 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:35:37.011771 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 08:35:37.011771 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:37.011771 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:35:37.011771 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:37.011771 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:37.011771 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:37.011771 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:37.011771 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:37.012889 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:37.012889 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:37.012889 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:37.012889 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:37.012889 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:37.012889 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:37.012889 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:37.012889 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:35:37.012889 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:35:37.012889 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:35:37.012889 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:35:37.012889 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:37.012889 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:37.012889 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:37.012889 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:37.012889 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:37.013720 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:37.013720 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:37.013720 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:37.013720 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:37.013720 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:37.013720 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:37.013720 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:37.013720 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:37.013720 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:37.013720 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:37.013720 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:37.013720 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:35:37.013720 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:35:37.013720 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 08:35:37.013720 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:37.021381 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 356/707] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Jun 22 08:35:36 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:37.022555 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63246f20-a771-491a-86b6-2950332f7ca5 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:37.045859 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2054ce65-5d2d-4617-a5a8-ce6d698b01c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:37.047116 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054ce65-5d2d-4617-a5a8-ce6d698b01c8 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:37.047729 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054ce65-5d2d-4617-a5a8-ce6d698b01c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:37.048891 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054ce65-5d2d-4617-a5a8-ce6d698b01c8 None admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:37.050414 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2054ce65-5d2d-4617-a5a8-ce6d698b01c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:37.051085 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2054ce65-5d2d-4617-a5a8-ce6d698b01c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:37.053766 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2054ce65-5d2d-4617-a5a8-ce6d698b01c8 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:37.060637 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:37.081047 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 352/708] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:35:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:37.081047 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2054ce65-5d2d-4617-a5a8-ce6d698b01c8 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:37.148678 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63246f20-a771-491a-86b6-2950332f7ca5 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:37.191491 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a6c871-6584-4bf9-b27c-c7807f305f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:37.192292 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a6c871-6584-4bf9-b27c-c7807f305f4b None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:37.192579 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a6c871-6584-4bf9-b27c-c7807f305f4b None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:37.192858 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a6c871-6584-4bf9-b27c-c7807f305f4b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:37.195919 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2054ce65-5d2d-4617-a5a8-ce6d698b01c8 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:37.199945 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a6c871-6584-4bf9-b27c-c7807f305f4b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:37.201398 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a6c871-6584-4bf9-b27c-c7807f305f4b None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:37.205682 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:37.216346 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-28a6c871-6584-4bf9-b27c-c7807f305f4b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:35:37.216346 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:37.216346 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:37.216346 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:37.216346 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:37.216346 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:37.216346 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:37.216346 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:37.216346 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:37.216346 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:37.216346 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:37.216346 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:37.216346 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:35:37.216346 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:35:37.216346 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:35:37.217289 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:35:37.217289 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:37.217289 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:37.217289 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:37.217289 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:37.217289 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:37.217289 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:37.217289 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:37.217289 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:37.217289 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:37.217289 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:37.217289 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:37.217289 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:37.217289 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:37.217289 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:37.217289 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:37.217289 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:37.218216 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:35:37.218216 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:35:37.218216 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:35:37.218216 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:35:37.218216 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:35:37.218216 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:35:37.218216 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:35:37.218216 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:37.218216 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 357/709] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Jun 22 08:35:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:37.219273 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a6c871-6584-4bf9-b27c-c7807f305f4b None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:37.239936 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5bb295-d0dc-4dd5-a43f-5dd542199fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:37.240630 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5bb295-d0dc-4dd5-a43f-5dd542199fd1 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:37.240913 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5bb295-d0dc-4dd5-a43f-5dd542199fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:37.241534 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5bb295-d0dc-4dd5-a43f-5dd542199fd1 None admin] PATH_INFO: `/v3/services` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:37.241931 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5bb295-d0dc-4dd5-a43f-5dd542199fd1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:37.242266 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5bb295-d0dc-4dd5-a43f-5dd542199fd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:37.243658 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5bb295-d0dc-4dd5-a43f-5dd542199fd1 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:37.253765 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 353/710] 10.222.0.42 () {56 vars in 1124 bytes} [Wed Jun 22 08:35:37 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:37.253765 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb319a-77ac-4a05-b1c1-30ea89ae003e None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:37.253765 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb319a-77ac-4a05-b1c1-30ea89ae003e None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:37.253765 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb319a-77ac-4a05-b1c1-30ea89ae003e None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:37.253765 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 354/711] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:35:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:35:37.253765 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb319a-77ac-4a05-b1c1-30ea89ae003e None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:37.341030 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:37.352850 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a6c871-6584-4bf9-b27c-c7807f305f4b None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:37.370917 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb319a-77ac-4a05-b1c1-30ea89ae003e None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:37.390093 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad4ab31-9464-41a2-9057-5244adf37550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:37.390841 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4ab31-9464-41a2-9057-5244adf37550 None admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:37.391130 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4ab31-9464-41a2-9057-5244adf37550 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:37.391411 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4ab31-9464-41a2-9057-5244adf37550 None admin] PATH_INFO: `/v3/users` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:37.392169 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad4ab31-9464-41a2-9057-5244adf37550 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:37.393611 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad4ab31-9464-41a2-9057-5244adf37550 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:37.415513 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 358/712] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Jun 22 08:35:37 2022] POST /identity/v3/users => generated 254 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:35:37.416274 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad4ab31-9464-41a2-9057-5244adf37550 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:37.417627 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ac9376-c843-4b6f-a71d-06287783743c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:37.418534 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac9376-c843-4b6f-a71d-06287783743c None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:37.419094 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac9376-c843-4b6f-a71d-06287783743c None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:37.419378 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac9376-c843-4b6f-a71d-06287783743c None admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:37.420209 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ac9376-c843-4b6f-a71d-06287783743c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:37.420526 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ac9376-c843-4b6f-a71d-06287783743c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:37.422061 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ac9376-c843-4b6f-a71d-06287783743c None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:37.443994 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 355/713] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Jun 22 08:35:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:37.445730 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8efb6-9102-4255-a5e2-46f4372beb39 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:37.446180 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8efb6-9102-4255-a5e2-46f4372beb39 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:37.446509 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8efb6-9102-4255-a5e2-46f4372beb39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:37.466734 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-b3b8efb6-9102-4255-a5e2-46f4372beb39 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:35:37.468333 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-b3b8efb6-9102-4255-a5e2-46f4372beb39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:35:37.500803 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:37.553570 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad4ab31-9464-41a2-9057-5244adf37550 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:37.573351 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 356/714] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:35:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:35:37.574485 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b8efb6-9102-4255-a5e2-46f4372beb39 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:37.604054 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0673a251-b2d3-4768-b4b8-1e59476c9bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:37.605152 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673a251-b2d3-4768-b4b8-1e59476c9bd7 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:37.605726 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673a251-b2d3-4768-b4b8-1e59476c9bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:37.606250 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673a251-b2d3-4768-b4b8-1e59476c9bd7 None admin] PATH_INFO: `/v3/services` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:37.607682 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0673a251-b2d3-4768-b4b8-1e59476c9bd7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:37.608224 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0673a251-b2d3-4768-b4b8-1e59476c9bd7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:37.609997 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0673a251-b2d3-4768-b4b8-1e59476c9bd7 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:37.619179 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 359/715] 10.222.0.42 () {56 vars in 1124 bytes} [Wed Jun 22 08:35:37 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:37.626108 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0673a251-b2d3-4768-b4b8-1e59476c9bd7 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:37.647612 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:37.763633 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b8efb6-9102-4255-a5e2-46f4372beb39 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:37.772741 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0673a251-b2d3-4768-b4b8-1e59476c9bd7 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:37.816746 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d079eb52-cd16-43e6-9c2f-c012315bf41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:37.817474 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079eb52-cd16-43e6-9c2f-c012315bf41e None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:37.817763 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079eb52-cd16-43e6-9c2f-c012315bf41e None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:37.818041 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079eb52-cd16-43e6-9c2f-c012315bf41e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:37.819319 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d079eb52-cd16-43e6-9c2f-c012315bf41e None admin] RBAC: Adding query filter params (role.id=c7518e0f532945af80c33860f2ac506d, scope.project.id=e1f161193cb440fa8c4a9d23820a5c28, user.id=4f1809a35b244c1db7a185d82859369e) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:37.819481 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d079eb52-cd16-43e6-9c2f-c012315bf41e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:37.821354 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d079eb52-cd16-43e6-9c2f-c012315bf41e None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:37.824318 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c63821e-3a07-4e0c-8b5e-34d364029d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:37.825534 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63821e-3a07-4e0c-8b5e-34d364029d19 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:37.826029 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63821e-3a07-4e0c-8b5e-34d364029d19 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:37.826620 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63821e-3a07-4e0c-8b5e-34d364029d19 None admin] PATH_INFO: `/v3/services/network` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:37.827567 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c63821e-3a07-4e0c-8b5e-34d364029d19 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:37.830306 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 357/716] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Jun 22 08:35:37 2022] GET /identity/v3/role_assignments?user.id=4f1809a35b244c1db7a185d82859369e&scope.project.id=e1f161193cb440fa8c4a9d23820a5c28&role.id=c7518e0f532945af80c33860f2ac506d => generated 259 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:37.831018 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c63821e-3a07-4e0c-8b5e-34d364029d19 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:37.846372 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-7c63821e-3a07-4e0c-8b5e-34d364029d19 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 08:35:37.846372 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:37.846372 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:35:37.846372 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:35:37.846372 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:35:37.846372 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:35:37.846372 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:35:37.846372 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:35:37.846372 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 08:35:37.846372 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:37.846372 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:35:37.846372 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:37.846372 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:37.846372 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:37.846372 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:37.846372 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:37.846372 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:37.847523 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:37.847523 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:37.847523 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:37.847523 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:37.847523 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:37.847523 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:37.847523 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:35:37.847523 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:35:37.847523 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:35:37.847523 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:35:37.847523 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:37.847523 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:37.847523 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:37.847523 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:37.847523 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:37.847523 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:37.848435 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:37.848435 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:37.848435 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:37.848435 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:37.848435 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:37.848435 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:37.848435 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:37.848435 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:37.848435 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:37.848435 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:37.848435 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:35:37.848435 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:35:37.848435 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 08:35:37.848435 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:37.854163 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 360/717] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Jun 22 08:35:37 2022] GET /identity/v3/services/network => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:37.856263 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d079eb52-cd16-43e6-9c2f-c012315bf41e None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:37.893666 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:38.038874 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d079eb52-cd16-43e6-9c2f-c012315bf41e None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:38.095845 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cff8d8-61fe-48a2-bbef-71e076c61af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:38.097296 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cff8d8-61fe-48a2-bbef-71e076c61af9 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:38.097845 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cff8d8-61fe-48a2-bbef-71e076c61af9 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:38.098404 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cff8d8-61fe-48a2-bbef-71e076c61af9 None admin] PATH_INFO: `/v3/services` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:38.099371 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cff8d8-61fe-48a2-bbef-71e076c61af9 None admin] RBAC: Adding query filter params (name=network) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:38.099944 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cff8d8-61fe-48a2-bbef-71e076c61af9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:38.102123 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cff8d8-61fe-48a2-bbef-71e076c61af9 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:38.112127 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 358/718] 10.222.0.42 () {56 vars in 1112 bytes} [Wed Jun 22 08:35:37 2022] GET /identity/v3/services?name=network => generated 124 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:38.117631 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c63821e-3a07-4e0c-8b5e-34d364029d19 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:38.244885 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:38.285672 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c63821e-3a07-4e0c-8b5e-34d364029d19 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:38.324247 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af170434-9d54-488d-89df-2255cb719d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:38.324838 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af170434-9d54-488d-89df-2255cb719d43 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:38.325127 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af170434-9d54-488d-89df-2255cb719d43 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:38.325412 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af170434-9d54-488d-89df-2255cb719d43 None admin] PATH_INFO: `/v3/services` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:38.326162 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af170434-9d54-488d-89df-2255cb719d43 None admin] RBAC: Adding query filter params (type=network) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:38.326480 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af170434-9d54-488d-89df-2255cb719d43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:38.327871 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af170434-9d54-488d-89df-2255cb719d43 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:38.333918 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 361/719] 10.222.0.42 () {56 vars in 1112 bytes} [Wed Jun 22 08:35:38 2022] GET /identity/v3/services?type=network => generated 124 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:39.005732 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88423a-3b0b-48ef-b2ca-91b11a350d32 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:39.006282 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88423a-3b0b-48ef-b2ca-91b11a350d32 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:39.006644 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88423a-3b0b-48ef-b2ca-91b11a350d32 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:39.009323 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 359/720] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:35:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:35:39.014232 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0a5cc-78b3-4897-8c4c-273fa7af4965 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:39.014697 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0a5cc-78b3-4897-8c4c-273fa7af4965 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:39.014998 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0a5cc-78b3-4897-8c4c-273fa7af4965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:39.035106 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-d5d0a5cc-78b3-4897-8c4c-273fa7af4965 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:35:39.036520 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-d5d0a5cc-78b3-4897-8c4c-273fa7af4965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:35:39.114790 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 362/721] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:35:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:35:39.138787 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de88423a-3b0b-48ef-b2ca-91b11a350d32 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:39.301245 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:39.325283 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de88423a-3b0b-48ef-b2ca-91b11a350d32 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:39.373956 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cecb6d-c76d-4247-92f4-39aa0b38b3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:39.374788 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cecb6d-c76d-4247-92f4-39aa0b38b3b5 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:39.375073 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cecb6d-c76d-4247-92f4-39aa0b38b3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:39.375347 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cecb6d-c76d-4247-92f4-39aa0b38b3b5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:39.386732 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cecb6d-c76d-4247-92f4-39aa0b38b3b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:35:39.395525 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-57cecb6d-c76d-4247-92f4-39aa0b38b3b5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:35:39.395525 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:39.395525 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:39.395525 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:39.395525 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:39.395525 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:39.395525 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:39.395525 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:39.395525 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:39.395525 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:39.395525 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:39.395525 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:39.395525 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:35:39.395525 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:35:39.395525 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:35:39.395525 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:35:39.396452 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:35:39.396452 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:35:39.396452 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:35:39.396452 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:35:39.396452 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:39.396452 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:39.396452 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:39.396452 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:39.396452 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:39.396452 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:39.396452 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:39.396452 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:39.396452 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:39.396452 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:39.396452 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:39.396452 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:39.397296 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:39.397296 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:39.397296 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:39.397296 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:39.397296 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:35:39.397296 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:35:39.397296 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:35:39.397296 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:35:39.397296 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:35:39.397296 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:35:39.397296 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:35:39.397296 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:39.397296 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 360/722] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Jun 22 08:35:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:39.402835 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0a5cc-78b3-4897-8c4c-273fa7af4965 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:39.477724 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:39.522066 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0a5cc-78b3-4897-8c4c-273fa7af4965 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:39.564072 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47c62ec-1d88-436b-9b49-dbfb1a292928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:39.564787 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c62ec-1d88-436b-9b49-dbfb1a292928 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:39.565075 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c62ec-1d88-436b-9b49-dbfb1a292928 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:39.565355 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c62ec-1d88-436b-9b49-dbfb1a292928 None admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:39.566170 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47c62ec-1d88-436b-9b49-dbfb1a292928 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:39.566572 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47c62ec-1d88-436b-9b49-dbfb1a292928 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:39.568063 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47c62ec-1d88-436b-9b49-dbfb1a292928 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:39.582372 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 363/723] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Jun 22 08:35:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:39.583861 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cecb6d-c76d-4247-92f4-39aa0b38b3b5 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:39.796597 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cecb6d-c76d-4247-92f4-39aa0b38b3b5 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:39.843915 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba3ca6-f77a-4225-ab3b-6aab8523d7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:39.845314 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba3ca6-f77a-4225-ab3b-6aab8523d7d4 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:39.845599 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba3ca6-f77a-4225-ab3b-6aab8523d7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:39.845874 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba3ca6-f77a-4225-ab3b-6aab8523d7d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:39.857090 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ba3ca6-f77a-4225-ab3b-6aab8523d7d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:39.858578 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ba3ca6-f77a-4225-ab3b-6aab8523d7d4 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:39.867170 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:39.878491 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-10ba3ca6-f77a-4225-ab3b-6aab8523d7d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:39.878491 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:39.878491 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:39.878491 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:39.878491 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:39.878491 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:39.878491 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:39.878491 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:39.878491 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:39.878491 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:39.878491 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:39.878491 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:39.878491 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:35:39.878491 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:35:39.878491 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:35:39.880220 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:35:39.880220 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:39.880220 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:39.880220 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:39.880220 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:39.880220 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:39.880220 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:39.880220 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:39.880220 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:39.880220 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:39.880220 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:39.880220 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:39.880220 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:39.880220 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:39.880220 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:39.880220 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:39.880220 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:39.882164 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:35:39.882164 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:35:39.882164 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:39.882164 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:39.882164 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 361/724] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:35:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:39.885449 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47c62ec-1d88-436b-9b49-dbfb1a292928 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:40.017183 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47c62ec-1d88-436b-9b49-dbfb1a292928 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:40.049378 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:40.061188 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c92bda-cf7d-4a2b-bf2d-d0acbdab422f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:40.061867 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c92bda-cf7d-4a2b-bf2d-d0acbdab422f None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:40.062181 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c92bda-cf7d-4a2b-bf2d-d0acbdab422f None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:40.062468 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c92bda-cf7d-4a2b-bf2d-d0acbdab422f None admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:40.063234 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c92bda-cf7d-4a2b-bf2d-d0acbdab422f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:40.063553 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c92bda-cf7d-4a2b-bf2d-d0acbdab422f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:40.064936 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c92bda-cf7d-4a2b-bf2d-d0acbdab422f None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:40.078035 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 364/725] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:35:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:40.085474 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba3ca6-f77a-4225-ab3b-6aab8523d7d4 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:40.182167 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22541979-7665-4614-8cdd-3b1d527cd928 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:40.182498 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22541979-7665-4614-8cdd-3b1d527cd928 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:40.182727 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22541979-7665-4614-8cdd-3b1d527cd928 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:40.184357 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 365/726] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:35:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:35:40.190516 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065666a-a3a8-4bdf-b0e2-89a7036a610b None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:40.190810 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065666a-a3a8-4bdf-b0e2-89a7036a610b None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:40.191071 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065666a-a3a8-4bdf-b0e2-89a7036a610b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:40.225274 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-8065666a-a3a8-4bdf-b0e2-89a7036a610b None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:35:40.226552 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-8065666a-a3a8-4bdf-b0e2-89a7036a610b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:35:40.271769 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba3ca6-f77a-4225-ab3b-6aab8523d7d4 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:40.348432 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bde4f3-9ae8-4e67-8be1-c89123048ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:40.349189 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bde4f3-9ae8-4e67-8be1-c89123048ba3 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:40.349601 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bde4f3-9ae8-4e67-8be1-c89123048ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:40.349882 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bde4f3-9ae8-4e67-8be1-c89123048ba3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:40.365470 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bde4f3-9ae8-4e67-8be1-c89123048ba3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:40.368164 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bde4f3-9ae8-4e67-8be1-c89123048ba3 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:40.393435 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-21bde4f3-9ae8-4e67-8be1-c89123048ba3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 22 08:35:40.393435 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:40.393435 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:40.393435 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:40.393435 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:40.393435 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:40.393435 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:40.393435 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:40.393435 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:40.393435 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:40.393435 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:40.393435 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:40.393435 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:35:40.393435 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:35:40.393435 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:35:40.393435 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:35:40.396037 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:40.396037 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:40.396037 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:35:40.396037 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:35:40.396037 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:35:40.396037 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:35:40.396037 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:40.396037 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:40.396037 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:40.396037 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:40.396037 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:40.396037 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:40.396037 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:40.396037 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:40.396037 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:40.396037 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:40.396037 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:40.396037 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:40.398332 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:40.398332 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:40.398332 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:35:40.398332 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:35:40.398332 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:35:40.398332 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:35:40.398332 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:35:40.398332 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:35:40.398332 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 22 08:35:40.398332 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:40.400716 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 362/727] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Jun 22 08:35:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:40.402127 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bde4f3-9ae8-4e67-8be1-c89123048ba3 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:40.419812 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 366/728] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:35:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:35:40.440516 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b189e78-12ea-46f9-8470-4ce476558c26 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:40.440828 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b189e78-12ea-46f9-8470-4ce476558c26 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:40.441066 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b189e78-12ea-46f9-8470-4ce476558c26 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:40.442486 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 367/729] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:35:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:35:40.447863 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b189e78-12ea-46f9-8470-4ce476558c26 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:40.482947 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:40.533399 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bde4f3-9ae8-4e67-8be1-c89123048ba3 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:40.573744 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3ec7cb-9960-4df5-b70f-9d60a0989dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:40.574535 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ec7cb-9960-4df5-b70f-9d60a0989dc3 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:40.574824 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ec7cb-9960-4df5-b70f-9d60a0989dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:40.575098 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ec7cb-9960-4df5-b70f-9d60a0989dc3 None admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:40.575954 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3ec7cb-9960-4df5-b70f-9d60a0989dc3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:40.576257 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3ec7cb-9960-4df5-b70f-9d60a0989dc3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:40.577707 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3ec7cb-9960-4df5-b70f-9d60a0989dc3 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:40.598245 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b189e78-12ea-46f9-8470-4ce476558c26 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:40.606503 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 363/730] 10.222.0.42 () {56 vars in 1135 bytes} [Wed Jun 22 08:35:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:35:40.606503 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86022d90-fd25-40be-b203-c61241e7dfc7 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:40.606503 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86022d90-fd25-40be-b203-c61241e7dfc7 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:40.606503 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86022d90-fd25-40be-b203-c61241e7dfc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:40.619997 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-86022d90-fd25-40be-b203-c61241e7dfc7 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:35:40.621218 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-86022d90-fd25-40be-b203-c61241e7dfc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:35:40.628616 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:40.648790 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60659fb-3d0f-43ff-ad3d-51edc635f0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:40.649688 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60659fb-3d0f-43ff-ad3d-51edc635f0b3 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:40.649982 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60659fb-3d0f-43ff-ad3d-51edc635f0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:40.650305 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60659fb-3d0f-43ff-ad3d-51edc635f0b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:40.667947 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60659fb-3d0f-43ff-ad3d-51edc635f0b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:35:40.676499 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-e60659fb-3d0f-43ff-ad3d-51edc635f0b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:35:40.676499 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:40.676499 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:40.676499 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:40.676499 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:40.676499 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:40.676499 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:40.676499 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:40.676499 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:40.676499 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:40.676499 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:40.676499 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:40.676499 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:35:40.676499 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:35:40.676499 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:35:40.676499 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:35:40.677666 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:35:40.677666 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:35:40.677666 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:35:40.677666 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:35:40.677666 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:40.677666 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:40.677666 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:40.677666 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:40.677666 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:40.677666 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:40.677666 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:40.677666 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:40.677666 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:40.677666 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:40.677666 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:40.677666 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:40.678546 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:40.678546 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:40.678546 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:40.678546 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:40.678546 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:35:40.678546 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:35:40.678546 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:35:40.678546 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:35:40.678546 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:35:40.678546 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:35:40.678546 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:35:40.678546 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:40.678546 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 368/731] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Jun 22 08:35:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:40.679247 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486ccfb-8ef0-4bdf-9b78-766cfe3344b2 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:40.679315 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486ccfb-8ef0-4bdf-9b78-766cfe3344b2 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:40.679757 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486ccfb-8ef0-4bdf-9b78-766cfe3344b2 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:40.684905 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 369/732] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:35:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:35:40.684905 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486ccfb-8ef0-4bdf-9b78-766cfe3344b2 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:40.712236 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 364/733] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:35:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:35:40.713117 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86022d90-fd25-40be-b203-c61241e7dfc7 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:40.779660 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:40.823525 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486ccfb-8ef0-4bdf-9b78-766cfe3344b2 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:40.844419 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86022d90-fd25-40be-b203-c61241e7dfc7 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:40.875594 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907b9311-25a0-4135-97b0-e6ce3f2e6794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:40.876193 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b9311-25a0-4135-97b0-e6ce3f2e6794 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:40.876481 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b9311-25a0-4135-97b0-e6ce3f2e6794 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:40.876823 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b9311-25a0-4135-97b0-e6ce3f2e6794 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:40.889363 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f55a8-7520-4ba9-a0cd-9bdfe3abbeb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:40.890469 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f55a8-7520-4ba9-a0cd-9bdfe3abbeb2 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:40.890773 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f55a8-7520-4ba9-a0cd-9bdfe3abbeb2 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:40.891019 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f55a8-7520-4ba9-a0cd-9bdfe3abbeb2 None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:40.891827 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f55a8-7520-4ba9-a0cd-9bdfe3abbeb2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:40.892138 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f55a8-7520-4ba9-a0cd-9bdfe3abbeb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:40.893526 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f55a8-7520-4ba9-a0cd-9bdfe3abbeb2 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:40.907775 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 365/734] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Jun 22 08:35:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:40.907775 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d84dcdd-4ad9-413c-99c7-40d79f3f22f7 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:40.907775 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d84dcdd-4ad9-413c-99c7-40d79f3f22f7 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:40.907775 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d84dcdd-4ad9-413c-99c7-40d79f3f22f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:40.924412 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-9d84dcdd-4ad9-413c-99c7-40d79f3f22f7 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:35:40.925616 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-9d84dcdd-4ad9-413c-99c7-40d79f3f22f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:35:40.953154 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:40.979531 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907b9311-25a0-4135-97b0-e6ce3f2e6794 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:40.981125 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907b9311-25a0-4135-97b0-e6ce3f2e6794 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:41.012727 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 366/735] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:35:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:35:41.013705 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d84dcdd-4ad9-413c-99c7-40d79f3f22f7 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:41.068702 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:41.124937 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 370/736] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Jun 22 08:35:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:35:41.127480 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907b9311-25a0-4135-97b0-e6ce3f2e6794 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:41.148431 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d84dcdd-4ad9-413c-99c7-40d79f3f22f7 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:41.189479 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb1dae-a4d6-43e3-a55e-4b78a979a7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:41.190299 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb1dae-a4d6-43e3-a55e-4b78a979a7e9 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:41.190588 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb1dae-a4d6-43e3-a55e-4b78a979a7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:41.190865 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb1dae-a4d6-43e3-a55e-4b78a979a7e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:41.206123 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb1dae-a4d6-43e3-a55e-4b78a979a7e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:35:41.219825 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-d5bb1dae-a4d6-43e3-a55e-4b78a979a7e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:35:41.219825 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:41.219825 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:41.219825 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:41.219825 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:41.219825 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:41.219825 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:41.219825 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:41.219825 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:41.219825 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:41.219825 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:41.219825 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:41.219825 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:35:41.219825 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:35:41.219825 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:35:41.219825 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:35:41.220751 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:35:41.220751 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:35:41.220751 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:35:41.220751 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:35:41.220751 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:41.220751 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:41.220751 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:41.220751 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:41.220751 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:41.220751 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:41.220751 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:41.220751 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:41.220751 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:41.220751 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:41.220751 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:41.220751 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:41.221639 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:41.221639 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:41.221639 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:41.221639 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:41.221639 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:35:41.221639 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:35:41.221639 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:35:41.221639 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:35:41.221639 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:35:41.221639 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:35:41.221639 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:35:41.221639 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:41.222602 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 367/737] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Jun 22 08:35:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:41.223162 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb1dae-a4d6-43e3-a55e-4b78a979a7e9 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:41.236055 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:41.268136 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907b9311-25a0-4135-97b0-e6ce3f2e6794 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:41.307925 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca2a8f-7b9e-4b1b-9dce-cc6cefc2c580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:41.308720 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca2a8f-7b9e-4b1b-9dce-cc6cefc2c580 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:41.309005 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca2a8f-7b9e-4b1b-9dce-cc6cefc2c580 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:41.309280 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca2a8f-7b9e-4b1b-9dce-cc6cefc2c580 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:41.320335 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bca2a8f-7b9e-4b1b-9dce-cc6cefc2c580 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:41.321806 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bca2a8f-7b9e-4b1b-9dce-cc6cefc2c580 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:41.339203 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-2bca2a8f-7b9e-4b1b-9dce-cc6cefc2c580 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:41.339203 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:41.339203 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:41.339203 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:41.339203 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:41.339203 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:41.339203 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:41.339203 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:41.339203 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:41.339203 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:41.339203 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:41.339203 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:41.339203 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:35:41.339203 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:35:41.339203 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:35:41.340158 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:35:41.340158 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:41.340158 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:41.340158 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:41.340158 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:41.340158 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:41.340158 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:41.340158 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:41.340158 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:41.340158 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:41.340158 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:41.340158 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:41.340158 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:41.340158 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:41.340158 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:41.340158 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:41.340158 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:41.341280 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:35:41.341280 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:35:41.341280 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:41.341280 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:41.341675 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:41.342946 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb1dae-a4d6-43e3-a55e-4b78a979a7e9 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:41.343282 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 371/738] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:35:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:41.344196 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca2a8f-7b9e-4b1b-9dce-cc6cefc2c580 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:41.382019 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe6f9d-27b5-4fe5-9925-898c6b104f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:41.382714 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe6f9d-27b5-4fe5-9925-898c6b104f14 None admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:41.382997 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe6f9d-27b5-4fe5-9925-898c6b104f14 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:41.383271 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe6f9d-27b5-4fe5-9925-898c6b104f14 None admin] PATH_INFO: `/v3/services` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:41.384000 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fe6f9d-27b5-4fe5-9925-898c6b104f14 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:41.385395 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fe6f9d-27b5-4fe5-9925-898c6b104f14 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:41.401683 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 368/739] 10.222.0.42 () {60 vars in 1141 bytes} [Wed Jun 22 08:35:41 2022] POST /identity/v3/services => generated 251 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:35:41.403002 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e9592-7845-4402-8e7a-b4527c6b5a02 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:41.403296 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e9592-7845-4402-8e7a-b4527c6b5a02 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:41.403587 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e9592-7845-4402-8e7a-b4527c6b5a02 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:41.404805 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 369/740] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:35:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:35:41.405492 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e9592-7845-4402-8e7a-b4527c6b5a02 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:41.480770 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca2a8f-7b9e-4b1b-9dce-cc6cefc2c580 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:41.524136 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:41.542349 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e9592-7845-4402-8e7a-b4527c6b5a02 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:41.544403 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1615db2-e500-40f7-a585-b01fc24e949f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:41.546424 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1615db2-e500-40f7-a585-b01fc24e949f None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:41.546884 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1615db2-e500-40f7-a585-b01fc24e949f None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:41.547328 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1615db2-e500-40f7-a585-b01fc24e949f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:41.571182 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1615db2-e500-40f7-a585-b01fc24e949f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:41.572692 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1615db2-e500-40f7-a585-b01fc24e949f None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:41.592959 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528a633c-f4df-4cfb-aca4-662689959fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:41.593255 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-b1615db2-e500-40f7-a585-b01fc24e949f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:41.593255 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:41.593255 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:41.593255 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:41.593255 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:41.593255 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:41.593255 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:41.593255 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:41.593255 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:41.593255 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:41.593255 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:41.593255 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:41.593255 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:35:41.593255 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:35:41.593255 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:35:41.594199 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:35:41.594199 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:41.594199 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:41.594199 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:41.594199 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:41.594199 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:41.594199 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:41.594199 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:41.594199 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:41.594199 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:41.594199 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:41.594199 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:41.594199 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:41.594199 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:41.594199 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:41.594199 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:41.594199 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:41.595164 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:35:41.595164 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:35:41.595164 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:41.595164 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:41.595397 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a633c-f4df-4cfb-aca4-662689959fcf None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:41.595397 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a633c-f4df-4cfb-aca4-662689959fcf None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:41.595397 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a633c-f4df-4cfb-aca4-662689959fcf None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:41.595397 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528a633c-f4df-4cfb-aca4-662689959fcf None admin] RBAC: Adding query filter params (name=service) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:41.595397 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528a633c-f4df-4cfb-aca4-662689959fcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:41.595710 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 372/741] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:35:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:41.596509 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1615db2-e500-40f7-a585-b01fc24e949f None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:41.596767 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528a633c-f4df-4cfb-aca4-662689959fcf None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:41.610137 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 370/742] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Jun 22 08:35:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:41.611535 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e67911-cd51-4a73-84f8-9f3954451b7a None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:41.611836 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e67911-cd51-4a73-84f8-9f3954451b7a None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:41.612121 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e67911-cd51-4a73-84f8-9f3954451b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:41.631752 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-e9e67911-cd51-4a73-84f8-9f3954451b7a None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:35:41.633031 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-e9e67911-cd51-4a73-84f8-9f3954451b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:35:41.654130 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:41.754103 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 371/743] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:35:41 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:35:41.754103 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e67911-cd51-4a73-84f8-9f3954451b7a None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:41.777236 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1615db2-e500-40f7-a585-b01fc24e949f None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:41.812914 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a884e-a382-43c8-81fe-df94ead2b4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:41.813617 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a884e-a382-43c8-81fe-df94ead2b4b6 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:41.813907 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a884e-a382-43c8-81fe-df94ead2b4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:41.814233 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a884e-a382-43c8-81fe-df94ead2b4b6 None admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:41.815137 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8a884e-a382-43c8-81fe-df94ead2b4b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:41.815457 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8a884e-a382-43c8-81fe-df94ead2b4b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:41.816848 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8a884e-a382-43c8-81fe-df94ead2b4b6 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:41.833690 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 373/744] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:35:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:41.833690 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a884e-a382-43c8-81fe-df94ead2b4b6 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:41.861428 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e67911-cd51-4a73-84f8-9f3954451b7a None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:41.876639 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:41.906169 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe96e3-ae4e-4a13-a5e1-4fd65c879342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:41.907150 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe96e3-ae4e-4a13-a5e1-4fd65c879342 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:41.907618 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe96e3-ae4e-4a13-a5e1-4fd65c879342 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:41.908087 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe96e3-ae4e-4a13-a5e1-4fd65c879342 None admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:41.909355 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abe96e3-ae4e-4a13-a5e1-4fd65c879342 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:41.909789 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abe96e3-ae4e-4a13-a5e1-4fd65c879342 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:41.911996 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abe96e3-ae4e-4a13-a5e1-4fd65c879342 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:41.932431 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 372/745] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:35:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:41.933851 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe96e3-ae4e-4a13-a5e1-4fd65c879342 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:41.949618 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:41.968959 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a884e-a382-43c8-81fe-df94ead2b4b6 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:42.011006 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badaf2fa-c6b0-4b9a-af82-aae14823586a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:42.011815 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badaf2fa-c6b0-4b9a-af82-aae14823586a None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:42.012099 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badaf2fa-c6b0-4b9a-af82-aae14823586a None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:42.012376 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badaf2fa-c6b0-4b9a-af82-aae14823586a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:42.024995 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badaf2fa-c6b0-4b9a-af82-aae14823586a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:42.026553 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badaf2fa-c6b0-4b9a-af82-aae14823586a None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:42.046231 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-badaf2fa-c6b0-4b9a-af82-aae14823586a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:42.046231 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:42.046231 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:42.046231 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:42.046231 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:42.046231 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:42.046231 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:42.046231 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:42.046231 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:42.046231 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:42.046231 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:42.046231 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:42.046231 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:35:42.046231 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:35:42.046231 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:35:42.048505 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:35:42.048505 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:42.048505 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:42.048505 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:42.048505 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:42.048505 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:42.048505 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:42.048505 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:42.048505 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:42.048505 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:42.048505 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:42.048505 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:42.048505 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:42.048505 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:42.048505 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:42.048505 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:42.048505 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:42.050292 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:35:42.050292 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:35:42.050292 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:42.050292 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:42.050292 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 374/746] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:35:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:42.050292 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badaf2fa-c6b0-4b9a-af82-aae14823586a None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:42.131212 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe96e3-ae4e-4a13-a5e1-4fd65c879342 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:42.159983 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:42.173565 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badaf2fa-c6b0-4b9a-af82-aae14823586a None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:42.189715 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a6e75-05d0-4198-8ac6-2f602910b273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:42.190460 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a6e75-05d0-4198-8ac6-2f602910b273 None admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:42.190680 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a6e75-05d0-4198-8ac6-2f602910b273 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:42.190973 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a6e75-05d0-4198-8ac6-2f602910b273 None admin] PATH_INFO: `/v3/services` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:42.191696 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68a6e75-05d0-4198-8ac6-2f602910b273 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:42.193082 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68a6e75-05d0-4198-8ac6-2f602910b273 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:42.213769 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 373/747] 10.222.0.42 () {60 vars in 1141 bytes} [Wed Jun 22 08:35:41 2022] POST /identity/v3/services => generated 240 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:35:42.215531 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a6e75-05d0-4198-8ac6-2f602910b273 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:42.255299 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd60e9a-709b-4cf3-ba1d-c4ee65ece31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:42.256993 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd60e9a-709b-4cf3-ba1d-c4ee65ece31e None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:42.257837 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd60e9a-709b-4cf3-ba1d-c4ee65ece31e None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:42.258708 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd60e9a-709b-4cf3-ba1d-c4ee65ece31e None admin] PATH_INFO: `/v3/users/nova` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:42.276807 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd60e9a-709b-4cf3-ba1d-c4ee65ece31e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:42.280498 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd60e9a-709b-4cf3-ba1d-c4ee65ece31e None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:42.312107 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-dcd60e9a-709b-4cf3-ba1d-c4ee65ece31e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 08:35:42.312107 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:42.312107 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:42.312107 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:42.312107 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:42.312107 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:42.312107 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:42.312107 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:42.312107 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:42.312107 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:42.312107 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:42.312107 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:42.312107 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:35:42.312107 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:35:42.312107 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:35:42.312107 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:35:42.314011 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:42.314011 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:42.314011 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:35:42.314011 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:35:42.314011 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:35:42.314011 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:35:42.314011 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:42.314011 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:42.314011 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:42.314011 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:42.314011 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:42.314011 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:42.314011 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:42.314011 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:42.314011 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:42.314011 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:42.314011 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:42.314011 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:42.316533 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:42.316533 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:42.316533 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:35:42.316533 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:35:42.316533 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:35:42.316533 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:35:42.316533 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:35:42.316533 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:35:42.316533 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 08:35:42.316533 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:42.322514 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 375/748] 10.222.0.42 () {56 vars in 1093 bytes} [Wed Jun 22 08:35:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:42.324680 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd60e9a-709b-4cf3-ba1d-c4ee65ece31e None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:42.380625 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:42.445556 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a6e75-05d0-4198-8ac6-2f602910b273 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:42.518328 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046cc108-4a2e-4d7d-937e-668073cbc61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:42.519917 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046cc108-4a2e-4d7d-937e-668073cbc61e None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:42.520447 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046cc108-4a2e-4d7d-937e-668073cbc61e None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:42.520935 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046cc108-4a2e-4d7d-937e-668073cbc61e None admin] PATH_INFO: `/v3/projects/service` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:42.524884 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd60e9a-709b-4cf3-ba1d-c4ee65ece31e None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:42.533389 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046cc108-4a2e-4d7d-937e-668073cbc61e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:42.535326 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046cc108-4a2e-4d7d-937e-668073cbc61e None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:42.552960 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-046cc108-4a2e-4d7d-937e-668073cbc61e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:35:42.552960 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:42.552960 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:42.552960 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:42.552960 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:42.552960 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:42.552960 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:42.552960 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:42.552960 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:42.552960 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:42.552960 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:42.552960 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:42.552960 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:35:42.552960 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:35:42.552960 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:35:42.554066 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:35:42.554066 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:42.554066 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:42.554066 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:42.554066 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:42.554066 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:42.554066 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:42.554066 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:42.554066 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:42.554066 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:42.554066 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:42.554066 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:42.554066 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:42.554066 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:42.554066 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:42.554066 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:42.554066 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:42.555771 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:35:42.555771 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:35:42.555771 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:35:42.555771 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:35:42.555771 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:35:42.555771 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:35:42.555771 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:35:42.555771 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:42.555771 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 374/749] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Jun 22 08:35:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:42.555771 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046cc108-4a2e-4d7d-937e-668073cbc61e None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:42.593615 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da63b69c-2f80-4c3b-b484-d3f4adae816e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:42.594322 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da63b69c-2f80-4c3b-b484-d3f4adae816e None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:42.594646 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da63b69c-2f80-4c3b-b484-d3f4adae816e None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:42.595050 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da63b69c-2f80-4c3b-b484-d3f4adae816e None admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:42.595871 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da63b69c-2f80-4c3b-b484-d3f4adae816e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:42.596183 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da63b69c-2f80-4c3b-b484-d3f4adae816e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:42.597682 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da63b69c-2f80-4c3b-b484-d3f4adae816e None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:42.617834 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 376/750] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:35:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:42.618864 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da63b69c-2f80-4c3b-b484-d3f4adae816e None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:42.633323 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:42.732703 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046cc108-4a2e-4d7d-937e-668073cbc61e None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:42.768586 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:42.780046 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c936d0f5-b363-43f0-9764-446392b29476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:42.780645 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da63b69c-2f80-4c3b-b484-d3f4adae816e None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:42.781159 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936d0f5-b363-43f0-9764-446392b29476 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:42.781589 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936d0f5-b363-43f0-9764-446392b29476 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:42.782585 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936d0f5-b363-43f0-9764-446392b29476 None admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:42.783581 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c936d0f5-b363-43f0-9764-446392b29476 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:42.784237 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c936d0f5-b363-43f0-9764-446392b29476 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:42.790325 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c936d0f5-b363-43f0-9764-446392b29476 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:42.812184 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 375/751] 10.222.0.42 () {56 vars in 1133 bytes} [Wed Jun 22 08:35:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:42.813456 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c936d0f5-b363-43f0-9764-446392b29476 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:42.845342 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3dfb0-9473-4655-b789-39eb7c0682dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:42.846594 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3dfb0-9473-4655-b789-39eb7c0682dc None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:42.847080 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3dfb0-9473-4655-b789-39eb7c0682dc None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:42.847585 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3dfb0-9473-4655-b789-39eb7c0682dc None admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:42.849106 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb3dfb0-9473-4655-b789-39eb7c0682dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:42.849734 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb3dfb0-9473-4655-b789-39eb7c0682dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:42.852351 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb3dfb0-9473-4655-b789-39eb7c0682dc None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:42.879818 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 377/752] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Jun 22 08:35:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:42.879818 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3dfb0-9473-4655-b789-39eb7c0682dc None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:42.945806 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c936d0f5-b363-43f0-9764-446392b29476 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:42.997512 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:43.012568 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10fbf2-4e91-40d3-8176-5d5d362923ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:43.013863 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10fbf2-4e91-40d3-8176-5d5d362923ae None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:43.014360 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10fbf2-4e91-40d3-8176-5d5d362923ae None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:43.014836 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10fbf2-4e91-40d3-8176-5d5d362923ae None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:43.030734 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe10fbf2-4e91-40d3-8176-5d5d362923ae None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:43.034173 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe10fbf2-4e91-40d3-8176-5d5d362923ae None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:43.060599 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3dfb0-9473-4655-b789-39eb7c0682dc None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:43.067685 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-fe10fbf2-4e91-40d3-8176-5d5d362923ae None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 08:35:43.067685 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:43.067685 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:43.067685 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:43.067685 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:43.067685 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:43.067685 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:43.067685 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:43.067685 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:43.067685 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:43.067685 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:43.067685 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:43.067685 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:35:43.067685 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:35:43.067685 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:35:43.067685 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:35:43.069664 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:43.069664 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:43.069664 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:35:43.069664 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:35:43.069664 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:35:43.069664 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:35:43.069664 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:43.069664 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:43.069664 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:43.069664 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:43.069664 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:43.069664 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:43.069664 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:43.069664 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:43.069664 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:43.069664 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:43.069664 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:43.069664 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:43.077122 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:43.077122 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:43.077122 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:35:43.077122 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:35:43.077122 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:35:43.077122 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:35:43.077122 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:35:43.077122 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:35:43.077122 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 08:35:43.077122 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:43.077122 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 376/753] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Jun 22 08:35:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:43.077122 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10fbf2-4e91-40d3-8176-5d5d362923ae None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:43.133436 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e67592b-4bb2-4c6f-ac2a-48f1585a4129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:43.135514 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e67592b-4bb2-4c6f-ac2a-48f1585a4129 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:43.136342 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e67592b-4bb2-4c6f-ac2a-48f1585a4129 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:43.137204 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e67592b-4bb2-4c6f-ac2a-48f1585a4129 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:43.157519 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e67592b-4bb2-4c6f-ac2a-48f1585a4129 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:43.159524 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:43.162465 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e67592b-4bb2-4c6f-ac2a-48f1585a4129 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:43.198516 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-5e67592b-4bb2-4c6f-ac2a-48f1585a4129 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:43.198516 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:43.198516 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:43.198516 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:43.198516 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:43.198516 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:43.198516 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:43.198516 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:43.198516 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:43.198516 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:43.198516 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:43.198516 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:43.198516 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:35:43.198516 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:35:43.198516 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:35:43.200281 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:35:43.200281 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:43.200281 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:43.200281 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:43.200281 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:43.200281 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:43.200281 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:43.200281 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:43.200281 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:43.200281 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:43.200281 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:43.200281 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:43.200281 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:43.200281 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:43.200281 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:43.200281 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:43.200281 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:43.202006 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:35:43.202006 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:35:43.202006 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:43.202006 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:43.205082 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 378/754] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:35:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:43.207005 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e67592b-4bb2-4c6f-ac2a-48f1585a4129 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:43.253226 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10fbf2-4e91-40d3-8176-5d5d362923ae None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:43.326856 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e157309f-fa45-472f-b0c8-2622c08ee24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:43.327540 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157309f-fa45-472f-b0c8-2622c08ee24d None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:43.327829 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157309f-fa45-472f-b0c8-2622c08ee24d None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:43.328129 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157309f-fa45-472f-b0c8-2622c08ee24d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:43.329050 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e157309f-fa45-472f-b0c8-2622c08ee24d None admin] RBAC: Adding query filter params (role.id=c7518e0f532945af80c33860f2ac506d, scope.project.id=e1f161193cb440fa8c4a9d23820a5c28, user.id=4403cea84ff646b88cdb785975b20346) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:43.329373 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e157309f-fa45-472f-b0c8-2622c08ee24d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:43.331797 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e157309f-fa45-472f-b0c8-2622c08ee24d None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:43.341107 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 377/755] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Jun 22 08:35:43 2022] GET /identity/v3/role_assignments?user.id=4403cea84ff646b88cdb785975b20346&scope.project.id=e1f161193cb440fa8c4a9d23820a5c28&role.id=c7518e0f532945af80c33860f2ac506d => generated 259 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:43.342065 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e157309f-fa45-472f-b0c8-2622c08ee24d None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:43.342194 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e67592b-4bb2-4c6f-ac2a-48f1585a4129 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:43.370477 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:43.387002 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e5b396-1df7-4d99-9ccd-74635c689e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:43.388300 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5b396-1df7-4d99-9ccd-74635c689e8c None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:43.388817 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5b396-1df7-4d99-9ccd-74635c689e8c None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:43.389113 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5b396-1df7-4d99-9ccd-74635c689e8c None admin] PATH_INFO: `/v3/users` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:43.390017 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e5b396-1df7-4d99-9ccd-74635c689e8c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:43.390364 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e5b396-1df7-4d99-9ccd-74635c689e8c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:43.392267 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e5b396-1df7-4d99-9ccd-74635c689e8c None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:43.434330 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 379/756] 10.222.0.42 () {56 vars in 1149 bytes} [Wed Jun 22 08:35:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:43.435419 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e5b396-1df7-4d99-9ccd-74635c689e8c None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:43.501813 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e157309f-fa45-472f-b0c8-2622c08ee24d None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:43.513724 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:43.541356 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206e87e6-f746-46a1-87e0-be413a4155cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:43.542030 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e87e6-f746-46a1-87e0-be413a4155cb None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:43.542348 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e87e6-f746-46a1-87e0-be413a4155cb None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:43.542624 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e87e6-f746-46a1-87e0-be413a4155cb None admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:43.543385 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206e87e6-f746-46a1-87e0-be413a4155cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:43.543662 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206e87e6-f746-46a1-87e0-be413a4155cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:43.545068 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206e87e6-f746-46a1-87e0-be413a4155cb None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:43.559794 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 378/757] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:35:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:43.566113 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206e87e6-f746-46a1-87e0-be413a4155cb None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:43.646293 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e5b396-1df7-4d99-9ccd-74635c689e8c None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:43.696017 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e1deec-4821-452d-93d4-9dc653f8a006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:43.696684 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e1deec-4821-452d-93d4-9dc653f8a006 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:43.696966 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e1deec-4821-452d-93d4-9dc653f8a006 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:43.697241 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e1deec-4821-452d-93d4-9dc653f8a006 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:43.704468 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206e87e6-f746-46a1-87e0-be413a4155cb None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:43.742538 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae2431d-82b7-4eab-a526-c1784ffb2dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:43.743877 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2431d-82b7-4eab-a526-c1784ffb2dd8 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:43.745162 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2431d-82b7-4eab-a526-c1784ffb2dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:43.745651 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2431d-82b7-4eab-a526-c1784ffb2dd8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:43.754299 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae2431d-82b7-4eab-a526-c1784ffb2dd8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:43.756477 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae2431d-82b7-4eab-a526-c1784ffb2dd8 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:43.757444 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:43.775770 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-6ae2431d-82b7-4eab-a526-c1784ffb2dd8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:35:43.775770 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:43.775770 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:43.775770 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:43.775770 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:43.775770 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:43.775770 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:43.775770 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:43.775770 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:43.775770 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:43.775770 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:43.775770 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:43.775770 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:35:43.775770 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:35:43.775770 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:35:43.776671 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:35:43.776671 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:43.776671 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:43.776671 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:43.776671 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:43.776671 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:43.776671 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:43.776671 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:43.776671 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:43.776671 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:43.776671 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:43.776671 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:43.776671 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:43.776671 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:43.776671 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:43.776671 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:43.776671 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:43.777545 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:35:43.777545 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:35:43.777545 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:35:43.777545 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:35:43.777545 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:35:43.777545 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:35:43.777545 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:35:43.777545 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:43.779966 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 379/758] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Jun 22 08:35:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:43.781337 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eaa4f4-7aae-4272-b6a7-1197983b05a6 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:43.781762 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eaa4f4-7aae-4272-b6a7-1197983b05a6 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:43.782776 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eaa4f4-7aae-4272-b6a7-1197983b05a6 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:43.784204 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 380/759] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:35:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:35:43.786928 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eaa4f4-7aae-4272-b6a7-1197983b05a6 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:43.790325 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e1deec-4821-452d-93d4-9dc653f8a006 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:43.792191 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e1deec-4821-452d-93d4-9dc653f8a006 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:43.827517 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:43.942133 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 380/760] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Jun 22 08:35:43 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 08:35:43.942133 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647dcdf-770f-42f2-887b-e99be28af5d3 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:43.942133 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647dcdf-770f-42f2-887b-e99be28af5d3 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:43.942133 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647dcdf-770f-42f2-887b-e99be28af5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:43.942560 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eaa4f4-7aae-4272-b6a7-1197983b05a6 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:43.976478 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-7647dcdf-770f-42f2-887b-e99be28af5d3 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:35:43.978648 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-7647dcdf-770f-42f2-887b-e99be28af5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:35:43.985857 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a12ef6b-b535-479a-9045-a2182c9ea782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:43.986555 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12ef6b-b535-479a-9045-a2182c9ea782 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:43.986841 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12ef6b-b535-479a-9045-a2182c9ea782 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:43.987116 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12ef6b-b535-479a-9045-a2182c9ea782 None admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:43.987916 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a12ef6b-b535-479a-9045-a2182c9ea782 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:43.988225 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a12ef6b-b535-479a-9045-a2182c9ea782 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:43.990164 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a12ef6b-b535-479a-9045-a2182c9ea782 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:44.006259 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 381/761] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Jun 22 08:35:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:44.007237 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a12ef6b-b535-479a-9045-a2182c9ea782 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:44.081225 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 381/762] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:35:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:35:44.082171 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7647dcdf-770f-42f2-887b-e99be28af5d3 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:44.093779 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:44.157567 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:44.175300 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a12ef6b-b535-479a-9045-a2182c9ea782 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:44.192142 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7647dcdf-770f-42f2-887b-e99be28af5d3 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:44.229824 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fe1993-bc5c-4d14-8bb4-16c9f3b53fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:44.230747 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe1993-bc5c-4d14-8bb4-16c9f3b53fbb None admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:44.231030 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe1993-bc5c-4d14-8bb4-16c9f3b53fbb None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:44.231310 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe1993-bc5c-4d14-8bb4-16c9f3b53fbb None admin] PATH_INFO: `/v3/projects/e1f161193cb440fa8c4a9d23820a5c28/users/4f1809a35b244c1db7a185d82859369e/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:44.233357 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fe1993-bc5c-4d14-8bb4-16c9f3b53fbb None admin] RBAC: Authorizing `identity:create_grant(project_id=e1f161193cb440fa8c4a9d23820a5c28, user_id=4f1809a35b244c1db7a185d82859369e, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:44.234856 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fe1993-bc5c-4d14-8bb4-16c9f3b53fbb None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:44.236166 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1803d0fa-2c45-4974-9e4b-fb2428ca2717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:44.237461 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1803d0fa-2c45-4974-9e4b-fb2428ca2717 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:44.238117 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1803d0fa-2c45-4974-9e4b-fb2428ca2717 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:44.238673 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1803d0fa-2c45-4974-9e4b-fb2428ca2717 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:44.256952 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1803d0fa-2c45-4974-9e4b-fb2428ca2717 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:44.259741 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1803d0fa-2c45-4974-9e4b-fb2428ca2717 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:44.264767 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 382/763] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Jun 22 08:35:44 2022] PUT /identity/v3/projects/e1f161193cb440fa8c4a9d23820a5c28/users/4f1809a35b244c1db7a185d82859369e/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:35:44.265613 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fe1993-bc5c-4d14-8bb4-16c9f3b53fbb None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:44.299152 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-1803d0fa-2c45-4974-9e4b-fb2428ca2717 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:44.299152 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:44.299152 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:44.299152 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:44.299152 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:44.299152 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:44.299152 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:44.299152 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:44.299152 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:44.299152 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:44.299152 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:44.299152 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:44.299152 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:35:44.299152 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:35:44.299152 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:35:44.301307 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:35:44.301307 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:44.301307 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:44.301307 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:44.301307 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:44.301307 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:44.301307 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:44.301307 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:44.301307 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:44.301307 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:44.301307 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:44.301307 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:44.301307 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:44.301307 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:44.301307 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:44.301307 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:44.301307 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:44.303431 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:35:44.303431 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:35:44.303431 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:44.303431 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:44.307936 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 382/764] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:35:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:44.318584 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1803d0fa-2c45-4974-9e4b-fb2428ca2717 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:44.352112 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:44.416373 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fe1993-bc5c-4d14-8bb4-16c9f3b53fbb None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:44.453686 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1803d0fa-2c45-4974-9e4b-fb2428ca2717 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:44.491061 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c9e71c-d181-43ca-b7ec-50d5fc44a8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:44.492292 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9e71c-d181-43ca-b7ec-50d5fc44a8ec None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:44.492816 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9e71c-d181-43ca-b7ec-50d5fc44a8ec None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:44.493317 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9e71c-d181-43ca-b7ec-50d5fc44a8ec None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:44.494884 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b4594c-7221-4c87-90f7-ccc7d634cca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:44.494884 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4594c-7221-4c87-90f7-ccc7d634cca4 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:44.495334 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c9e71c-d181-43ca-b7ec-50d5fc44a8ec None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:44.495439 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4594c-7221-4c87-90f7-ccc7d634cca4 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:44.495789 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4594c-7221-4c87-90f7-ccc7d634cca4 None admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:44.496612 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b4594c-7221-4c87-90f7-ccc7d634cca4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:44.496997 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b4594c-7221-4c87-90f7-ccc7d634cca4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:44.497705 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c9e71c-d181-43ca-b7ec-50d5fc44a8ec None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:44.498885 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b4594c-7221-4c87-90f7-ccc7d634cca4 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:44.512807 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 383/765] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:35:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:44.517917 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-18c9e71c-d181-43ca-b7ec-50d5fc44a8ec None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 08:35:44.517917 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:44.517917 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:35:44.517917 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:35:44.517917 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:35:44.517917 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:35:44.517917 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:35:44.517917 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:35:44.517917 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 08:35:44.517917 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:44.517917 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:35:44.517917 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:44.517917 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:44.517917 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:44.517917 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:44.517917 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:44.519163 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:44.519163 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:44.519163 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:44.519163 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:44.519163 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:44.519163 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:44.519163 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:44.519163 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:35:44.519163 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:35:44.519163 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:35:44.519163 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:35:44.519163 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:44.519163 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:44.519163 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:44.519163 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:44.519163 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:44.520449 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:44.520449 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:44.520449 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:44.520449 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:44.520449 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:44.520449 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:44.520449 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:44.520449 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:44.520449 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:44.520449 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:44.520449 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:44.520449 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:35:44.520449 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:35:44.520449 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 08:35:44.520449 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:44.521417 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b4594c-7221-4c87-90f7-ccc7d634cca4 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:44.523393 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 383/766] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Jun 22 08:35:44 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:44.524957 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:44.532959 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c9e71c-d181-43ca-b7ec-50d5fc44a8ec None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:44.635064 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b4594c-7221-4c87-90f7-ccc7d634cca4 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:44.671735 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3977c49b-637d-450a-ab2c-9ae0d3f7e803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:44.672746 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977c49b-637d-450a-ab2c-9ae0d3f7e803 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:44.673129 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977c49b-637d-450a-ab2c-9ae0d3f7e803 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:44.673507 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977c49b-637d-450a-ab2c-9ae0d3f7e803 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:44.681086 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3977c49b-637d-450a-ab2c-9ae0d3f7e803 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:44.682720 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3977c49b-637d-450a-ab2c-9ae0d3f7e803 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:44.698953 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-3977c49b-637d-450a-ab2c-9ae0d3f7e803 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:35:44.698953 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:44.698953 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:44.698953 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:44.698953 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:44.698953 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:44.698953 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:44.698953 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:44.698953 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:44.698953 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:44.698953 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:44.698953 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:44.698953 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:35:44.698953 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:35:44.698953 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:35:44.700047 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:35:44.700047 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:44.700047 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:44.700047 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:44.700047 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:44.700047 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:44.700047 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:44.700047 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:44.700047 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:44.700047 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:44.700047 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:44.700047 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:44.700047 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:44.700047 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:44.700047 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:44.700047 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:44.700047 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:44.701132 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:35:44.701132 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:35:44.701132 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:35:44.701132 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:35:44.701132 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:35:44.701132 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:35:44.701132 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:35:44.701132 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:44.703052 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 384/767] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Jun 22 08:35:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:35:44.709939 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3977c49b-637d-450a-ab2c-9ae0d3f7e803 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:44.729787 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c9e71c-d181-43ca-b7ec-50d5fc44a8ec None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:44.776484 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:44.777542 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:44.798841 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451f6417-d56d-4b05-8553-7e221c34409b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:44.799525 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f6417-d56d-4b05-8553-7e221c34409b None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:44.799812 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f6417-d56d-4b05-8553-7e221c34409b None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:44.800096 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f6417-d56d-4b05-8553-7e221c34409b None admin] PATH_INFO: `/v3/services` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:44.800991 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451f6417-d56d-4b05-8553-7e221c34409b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:44.801145 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451f6417-d56d-4b05-8553-7e221c34409b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:44.802537 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451f6417-d56d-4b05-8553-7e221c34409b None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:44.808047 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 384/768] 10.222.0.42 () {56 vars in 1124 bytes} [Wed Jun 22 08:35:44 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:35:44.816696 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451f6417-d56d-4b05-8553-7e221c34409b None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:44.821562 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3977c49b-637d-450a-ab2c-9ae0d3f7e803 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:44.861828 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4378b79e-a3e5-4f29-bd50-6e200e9e608f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:44.862652 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378b79e-a3e5-4f29-bd50-6e200e9e608f None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:44.862877 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378b79e-a3e5-4f29-bd50-6e200e9e608f None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:44.863150 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378b79e-a3e5-4f29-bd50-6e200e9e608f None admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:44.863946 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4378b79e-a3e5-4f29-bd50-6e200e9e608f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:44.864253 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4378b79e-a3e5-4f29-bd50-6e200e9e608f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:44.865894 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4378b79e-a3e5-4f29-bd50-6e200e9e608f None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:44.883209 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 385/769] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Jun 22 08:35:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:35:44.883209 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9df41-66db-4689-8f6a-9effdc3e5ee8 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:44.883209 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9df41-66db-4689-8f6a-9effdc3e5ee8 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:44.883209 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9df41-66db-4689-8f6a-9effdc3e5ee8 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:44.883209 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 386/770] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:35:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:35:44.887958 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca9df41-66db-4689-8f6a-9effdc3e5ee8 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:44.941030 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451f6417-d56d-4b05-8553-7e221c34409b None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:44.980360 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded3d7cd-9c60-4aed-8aee-bb128671a7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:44.981435 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded3d7cd-9c60-4aed-8aee-bb128671a7b1 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:44.981974 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded3d7cd-9c60-4aed-8aee-bb128671a7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:44.982510 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded3d7cd-9c60-4aed-8aee-bb128671a7b1 None admin] PATH_INFO: `/v3/services` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:44.983468 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded3d7cd-9c60-4aed-8aee-bb128671a7b1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:44.983977 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded3d7cd-9c60-4aed-8aee-bb128671a7b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:44.985698 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded3d7cd-9c60-4aed-8aee-bb128671a7b1 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:44.992083 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 385/771] 10.222.0.42 () {56 vars in 1124 bytes} [Wed Jun 22 08:35:44 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:44.993877 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d5e03-a449-4ea0-8d01-66cfa8df13bc None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:44.994402 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d5e03-a449-4ea0-8d01-66cfa8df13bc None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:44.994889 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d5e03-a449-4ea0-8d01-66cfa8df13bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:45.021316 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-9c3d5e03-a449-4ea0-8d01-66cfa8df13bc None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:35:45.023067 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-9c3d5e03-a449-4ea0-8d01-66cfa8df13bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:35:45.023918 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca9df41-66db-4689-8f6a-9effdc3e5ee8 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:45.057199 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:45.070886 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a6f6f7-b1b4-4daa-ae33-e588b1eb75ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:45.071883 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6f6f7-b1b4-4daa-ae33-e588b1eb75ab None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:45.072372 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6f6f7-b1b4-4daa-ae33-e588b1eb75ab None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:45.072861 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6f6f7-b1b4-4daa-ae33-e588b1eb75ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:45.073939 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a6f6f7-b1b4-4daa-ae33-e588b1eb75ab None admin] RBAC: Adding query filter params (role.id=e67c237283fd404d9a2bdf1333109696, scope.project.id=e1f161193cb440fa8c4a9d23820a5c28, user.id=2bf91272d78b4e8f854c760622465af9) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:45.074489 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a6f6f7-b1b4-4daa-ae33-e588b1eb75ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:45.076312 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a6f6f7-b1b4-4daa-ae33-e588b1eb75ab None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:45.090254 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 387/772] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Jun 22 08:35:44 2022] GET /identity/v3/role_assignments?user.id=2bf91272d78b4e8f854c760622465af9&scope.project.id=e1f161193cb440fa8c4a9d23820a5c28&role.id=e67c237283fd404d9a2bdf1333109696 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:45.091638 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a6f6f7-b1b4-4daa-ae33-e588b1eb75ab None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:45.094396 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:45.117030 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 386/773] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:35:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:35:45.139307 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3d5e03-a449-4ea0-8d01-66cfa8df13bc None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:45.262476 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3d5e03-a449-4ea0-8d01-66cfa8df13bc None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:45.311055 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a6f6f7-b1b4-4daa-ae33-e588b1eb75ab None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:45.385891 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc41352-1e67-495c-914c-37a0bebb5ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:45.389179 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc41352-1e67-495c-914c-37a0bebb5ab9 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:45.389517 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc41352-1e67-495c-914c-37a0bebb5ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:45.389746 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc41352-1e67-495c-914c-37a0bebb5ab9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:45.390601 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc41352-1e67-495c-914c-37a0bebb5ab9 None admin] RBAC: Adding query filter params (interface=public, service_id=e3f98889d8e34f1db2d73b0a1bee33b6, region_id=RegionOne) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:45.390920 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc41352-1e67-495c-914c-37a0bebb5ab9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:45.393342 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc41352-1e67-495c-914c-37a0bebb5ab9 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:45.402605 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 388/774] 10.222.0.42 () {56 vars in 1251 bytes} [Wed Jun 22 08:35:45 2022] GET /identity/v3/endpoints?service_id=e3f98889d8e34f1db2d73b0a1bee33b6&interface=public®ion_id=RegionOne => generated 194 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:45.419152 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc41352-1e67-495c-914c-37a0bebb5ab9 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:45.442221 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c707cd8e-bb4d-4d65-b3c8-26c5a90a105c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:45.443281 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c707cd8e-bb4d-4d65-b3c8-26c5a90a105c None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:45.443733 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c707cd8e-bb4d-4d65-b3c8-26c5a90a105c None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:45.444151 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c707cd8e-bb4d-4d65-b3c8-26c5a90a105c None admin] PATH_INFO: `/v3/services/network` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:45.444957 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c707cd8e-bb4d-4d65-b3c8-26c5a90a105c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:45.446721 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c707cd8e-bb4d-4d65-b3c8-26c5a90a105c None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:45.461614 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-c707cd8e-bb4d-4d65-b3c8-26c5a90a105c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 08:35:45.461614 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:45.461614 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:35:45.461614 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:35:45.461614 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:35:45.461614 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:35:45.461614 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:35:45.461614 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:35:45.461614 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 08:35:45.461614 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:45.461614 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:35:45.461614 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:45.461614 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:45.461614 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:45.461614 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:45.461614 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:45.461614 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:45.462782 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:45.462782 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:45.462782 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:45.462782 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:45.462782 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:45.462782 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:45.462782 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:35:45.462782 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:35:45.462782 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:35:45.462782 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:35:45.462782 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:45.462782 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:45.462782 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:45.462782 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:45.462782 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:45.462782 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:45.463673 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:45.463673 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:45.463673 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:45.463673 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:45.463673 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:45.463673 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:45.463673 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:45.463673 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:45.463673 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:45.463673 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:45.463673 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:35:45.463673 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:35:45.463673 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 08:35:45.463673 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:45.466519 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 387/775] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Jun 22 08:35:45 2022] GET /identity/v3/services/network => generated 88 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:45.472488 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c707cd8e-bb4d-4d65-b3c8-26c5a90a105c None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:45.539813 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:45.554814 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:45.645634 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc41352-1e67-495c-914c-37a0bebb5ab9 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:45.674603 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c707cd8e-bb4d-4d65-b3c8-26c5a90a105c None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:45.709953 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269e58df-103d-49a2-9308-1a5273a6f980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:45.711005 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e58df-103d-49a2-9308-1a5273a6f980 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:45.711491 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e58df-103d-49a2-9308-1a5273a6f980 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:45.711989 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e58df-103d-49a2-9308-1a5273a6f980 None admin] PATH_INFO: `/v3/services` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:45.712878 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269e58df-103d-49a2-9308-1a5273a6f980 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:45.714518 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269e58df-103d-49a2-9308-1a5273a6f980 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:45.721112 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 389/776] 10.222.0.42 () {56 vars in 1087 bytes} [Wed Jun 22 08:35:45 2022] GET /identity/v3/services => generated 772 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:45.731746 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58ee6f-4bdc-4825-9c34-fd434e3d2dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:45.732829 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58ee6f-4bdc-4825-9c34-fd434e3d2dc5 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:45.733316 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58ee6f-4bdc-4825-9c34-fd434e3d2dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:45.733798 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58ee6f-4bdc-4825-9c34-fd434e3d2dc5 None admin] PATH_INFO: `/v3/services` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:45.739066 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa58ee6f-4bdc-4825-9c34-fd434e3d2dc5 None admin] RBAC: Adding query filter params (name=network) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:45.739706 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa58ee6f-4bdc-4825-9c34-fd434e3d2dc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:45.741347 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa58ee6f-4bdc-4825-9c34-fd434e3d2dc5 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:45.750412 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 388/777] 10.222.0.42 () {56 vars in 1112 bytes} [Wed Jun 22 08:35:45 2022] GET /identity/v3/services?name=network => generated 124 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:35:45.757270 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269e58df-103d-49a2-9308-1a5273a6f980 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:45.879020 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d6abf-3222-4df5-816b-64e97f2f83fd None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:45.879327 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d6abf-3222-4df5-816b-64e97f2f83fd None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:45.879589 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d6abf-3222-4df5-816b-64e97f2f83fd None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:45.881235 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 389/778] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:35:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:35:45.886707 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df03104-75bd-49f0-8d4e-76f19fdf26f5 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:45.886988 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df03104-75bd-49f0-8d4e-76f19fdf26f5 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:45.887258 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df03104-75bd-49f0-8d4e-76f19fdf26f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:45.905940 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-0df03104-75bd-49f0-8d4e-76f19fdf26f5 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:35:45.907183 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-0df03104-75bd-49f0-8d4e-76f19fdf26f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:35:45.956657 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269e58df-103d-49a2-9308-1a5273a6f980 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:45.976987 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:45.983546 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 390/779] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:35:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:35:46.001702 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac407703-29ce-4aed-9ff6-627760203ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:46.002462 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac407703-29ce-4aed-9ff6-627760203ba5 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:46.002745 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac407703-29ce-4aed-9ff6-627760203ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:46.003019 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac407703-29ce-4aed-9ff6-627760203ba5 None admin] PATH_INFO: `/v3/services` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:46.003740 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac407703-29ce-4aed-9ff6-627760203ba5 None admin] RBAC: Adding query filter params (type=network) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:46.004110 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac407703-29ce-4aed-9ff6-627760203ba5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:46.005616 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac407703-29ce-4aed-9ff6-627760203ba5 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:46.009055 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df03104-75bd-49f0-8d4e-76f19fdf26f5 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:46.017879 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 390/780] 10.222.0.42 () {56 vars in 1112 bytes} [Wed Jun 22 08:35:45 2022] GET /identity/v3/services?type=network => generated 350 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:35:46.020164 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac407703-29ce-4aed-9ff6-627760203ba5 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:46.069588 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:46.165480 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df03104-75bd-49f0-8d4e-76f19fdf26f5 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:46.172848 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac407703-29ce-4aed-9ff6-627760203ba5 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:46.214108 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a32ec-f95d-4734-9973-ba960b1e040d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:46.214108 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a32ec-f95d-4734-9973-ba960b1e040d None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:46.214108 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a32ec-f95d-4734-9973-ba960b1e040d None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:46.214108 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a32ec-f95d-4734-9973-ba960b1e040d None admin] PATH_INFO: `/v3/endpoints` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:46.214743 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060a32ec-f95d-4734-9973-ba960b1e040d None admin] RBAC: Adding query filter params (interface=public, service_id=6603d830bfcf4960ac6d83070919a16d, region_id=RegionOne) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:46.215047 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060a32ec-f95d-4734-9973-ba960b1e040d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:46.216458 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060a32ec-f95d-4734-9973-ba960b1e040d None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:46.223419 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 391/781] 10.222.0.42 () {56 vars in 1251 bytes} [Wed Jun 22 08:35:46 2022] GET /identity/v3/endpoints?service_id=6603d830bfcf4960ac6d83070919a16d&interface=public®ion_id=RegionOne => generated 194 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:35:46.231543 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a32ec-f95d-4734-9973-ba960b1e040d None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:46.240274 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc2c330-3ae5-4ac6-92f2-4994d619c1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:46.241077 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2c330-3ae5-4ac6-92f2-4994d619c1de None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:46.241360 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2c330-3ae5-4ac6-92f2-4994d619c1de None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:46.241635 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2c330-3ae5-4ac6-92f2-4994d619c1de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:46.275407 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc2c330-3ae5-4ac6-92f2-4994d619c1de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:35:46.283897 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-0dc2c330-3ae5-4ac6-92f2-4994d619c1de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:35:46.283897 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:46.283897 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:46.283897 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:46.283897 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:46.283897 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:46.283897 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:46.283897 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:46.283897 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:46.283897 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:46.283897 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:46.283897 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:46.283897 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:35:46.283897 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:35:46.283897 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:35:46.283897 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:35:46.286264 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:35:46.286264 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:35:46.286264 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:35:46.286264 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:35:46.286264 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:46.286264 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:46.286264 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:46.286264 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:46.286264 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:46.286264 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:46.286264 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:46.286264 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:46.286264 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:46.286264 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:46.286264 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:46.286264 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:46.287073 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:46.287073 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:46.287073 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:46.287073 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:46.287073 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:35:46.287073 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:35:46.287073 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:35:46.287073 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:35:46.287073 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:35:46.287073 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:35:46.287073 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:35:46.287073 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:46.287073 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 391/782] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Jun 22 08:35:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:35:46.297960 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc2c330-3ae5-4ac6-92f2-4994d619c1de None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:46.335578 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:46.469190 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a32ec-f95d-4734-9973-ba960b1e040d None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:46.499654 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc2c330-3ae5-4ac6-92f2-4994d619c1de None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:46.518268 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:46.527359 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efad48c3-fc58-4b50-a042-fb45417852f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:46.528026 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad48c3-fc58-4b50-a042-fb45417852f3 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:46.528308 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad48c3-fc58-4b50-a042-fb45417852f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:46.528583 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad48c3-fc58-4b50-a042-fb45417852f3 None admin] PATH_INFO: `/v3/services` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:46.529278 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efad48c3-fc58-4b50-a042-fb45417852f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:46.530678 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efad48c3-fc58-4b50-a042-fb45417852f3 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:46.542583 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 392/783] 10.222.0.42 () {56 vars in 1087 bytes} [Wed Jun 22 08:35:46 2022] GET /identity/v3/services => generated 772 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:46.587747 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f148967-b85c-453f-b495-98d8e142012f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:46.588891 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f148967-b85c-453f-b495-98d8e142012f None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:46.589367 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f148967-b85c-453f-b495-98d8e142012f None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:46.589834 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f148967-b85c-453f-b495-98d8e142012f None admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:46.591361 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f148967-b85c-453f-b495-98d8e142012f None admin] RBAC: Adding query filter params (name=admin) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:46.591925 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f148967-b85c-453f-b495-98d8e142012f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:46.595210 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f148967-b85c-453f-b495-98d8e142012f None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:46.612933 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 392/784] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Jun 22 08:35:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:46.618408 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efad48c3-fc58-4b50-a042-fb45417852f3 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:46.769592 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efad48c3-fc58-4b50-a042-fb45417852f3 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:46.776815 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:46.804951 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a6a588-7968-435d-97d3-7de17bf06486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:46.805748 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a6a588-7968-435d-97d3-7de17bf06486 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:46.806029 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a6a588-7968-435d-97d3-7de17bf06486 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:46.806337 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a6a588-7968-435d-97d3-7de17bf06486 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:46.818374 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a6a588-7968-435d-97d3-7de17bf06486 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:46.819841 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a6a588-7968-435d-97d3-7de17bf06486 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:46.838010 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-96a6a588-7968-435d-97d3-7de17bf06486 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:46.838010 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:46.838010 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:46.838010 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:46.838010 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:46.838010 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:46.838010 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:46.838010 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:46.838010 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:46.838010 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:46.838010 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:46.838010 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:46.838010 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:35:46.838010 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:35:46.838010 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:35:46.838979 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:35:46.838979 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:46.838979 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:46.838979 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:46.838979 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:46.838979 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:46.838979 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:46.838979 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:46.838979 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:46.838979 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:46.838979 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:46.838979 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:46.838979 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:46.838979 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:46.838979 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:46.838979 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:46.838979 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:46.839832 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:35:46.839832 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:35:46.839832 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:46.839832 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:46.839832 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 393/785] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:35:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:46.851816 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f148967-b85c-453f-b495-98d8e142012f None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:47.056633 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f148967-b85c-453f-b495-98d8e142012f None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:47.111875 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c83a843-346d-448d-9f91-dcca07176712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:47.112576 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c83a843-346d-448d-9f91-dcca07176712 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:47.113045 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c83a843-346d-448d-9f91-dcca07176712 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:47.113462 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c83a843-346d-448d-9f91-dcca07176712 None admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:47.114775 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c83a843-346d-448d-9f91-dcca07176712 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:47.115271 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c83a843-346d-448d-9f91-dcca07176712 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:47.117693 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c83a843-346d-448d-9f91-dcca07176712 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:47.132798 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 393/786] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:35:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:47.138488 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a6a588-7968-435d-97d3-7de17bf06486 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:47.181376 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff40a78-2cb8-43a5-931b-b54e09e35999 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:47.181707 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff40a78-2cb8-43a5-931b-b54e09e35999 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:47.181938 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff40a78-2cb8-43a5-931b-b54e09e35999 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:47.183433 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 394/787] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:35:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:35:47.189783 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa18f0-d842-4500-8582-b4a97e4e55c0 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:47.190052 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa18f0-d842-4500-8582-b4a97e4e55c0 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:47.191513 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa18f0-d842-4500-8582-b4a97e4e55c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:47.224461 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-c3aa18f0-d842-4500-8582-b4a97e4e55c0 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:35:47.225770 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-c3aa18f0-d842-4500-8582-b4a97e4e55c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:35:47.281183 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:47.364786 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a6a588-7968-435d-97d3-7de17bf06486 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:47.383823 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 395/788] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:35:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 08:35:47.407651 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aa18f0-d842-4500-8582-b4a97e4e55c0 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:47.409844 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54004437-0aae-4b52-9dc8-3f1562182cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:47.410737 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54004437-0aae-4b52-9dc8-3f1562182cf0 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:47.411026 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54004437-0aae-4b52-9dc8-3f1562182cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:47.411303 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54004437-0aae-4b52-9dc8-3f1562182cf0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:47.428654 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54004437-0aae-4b52-9dc8-3f1562182cf0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:47.430175 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54004437-0aae-4b52-9dc8-3f1562182cf0 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:47.456326 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-54004437-0aae-4b52-9dc8-3f1562182cf0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 22 08:35:47.456326 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:47.456326 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:47.456326 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:47.456326 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:47.456326 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:47.456326 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:47.456326 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:47.456326 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:47.456326 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:47.456326 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:47.456326 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:47.456326 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:35:47.456326 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:35:47.456326 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:35:47.456326 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:35:47.457333 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:47.457333 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:47.457333 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:35:47.457333 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:35:47.457333 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:35:47.457333 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:35:47.457333 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:47.457333 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:47.457333 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:47.457333 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:47.457333 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:47.457333 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:47.457333 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:47.457333 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:47.457333 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:47.457333 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:47.457333 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:47.457333 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:47.459802 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:47.459802 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:47.459802 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:35:47.459802 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:35:47.459802 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:35:47.459802 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:35:47.459802 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:35:47.459802 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:35:47.459802 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 22 08:35:47.459802 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:47.463892 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 394/789] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Jun 22 08:35:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:47.475159 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54004437-0aae-4b52-9dc8-3f1562182cf0 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:47.522487 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:47.545249 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aa18f0-d842-4500-8582-b4a97e4e55c0 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:47.580695 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1acfd83-36ab-48ba-a04d-209dcd0329cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:47.581495 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1acfd83-36ab-48ba-a04d-209dcd0329cd None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:47.581775 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1acfd83-36ab-48ba-a04d-209dcd0329cd None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:47.582053 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1acfd83-36ab-48ba-a04d-209dcd0329cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:47.593817 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1acfd83-36ab-48ba-a04d-209dcd0329cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:35:47.602580 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-a1acfd83-36ab-48ba-a04d-209dcd0329cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:35:47.602580 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:47.602580 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:47.602580 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:47.602580 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:47.602580 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:47.602580 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:47.602580 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:47.602580 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:47.602580 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:47.602580 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:47.602580 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:47.602580 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:35:47.602580 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:35:47.602580 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:35:47.602580 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:35:47.604641 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:35:47.604641 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:35:47.604641 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:35:47.604641 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:35:47.604641 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:47.604641 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:47.604641 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:47.604641 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:47.604641 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:47.604641 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:47.604641 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:47.604641 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:47.604641 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:47.604641 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:47.604641 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:47.604641 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:47.605728 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:47.605728 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:47.605728 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:47.605728 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:47.605728 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:35:47.605728 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:35:47.605728 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:35:47.605728 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:35:47.605728 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:35:47.605728 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:35:47.605728 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:35:47.605728 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:47.605728 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 396/790] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Jun 22 08:35:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:35:47.616512 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1acfd83-36ab-48ba-a04d-209dcd0329cd None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:47.670480 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:47.694468 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54004437-0aae-4b52-9dc8-3f1562182cf0 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:47.743773 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e659ea-9461-4737-9668-d7733f0e1443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:47.744448 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e659ea-9461-4737-9668-d7733f0e1443 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:47.744734 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e659ea-9461-4737-9668-d7733f0e1443 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:47.745005 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e659ea-9461-4737-9668-d7733f0e1443 None admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:47.745853 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e659ea-9461-4737-9668-d7733f0e1443 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:47.746192 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e659ea-9461-4737-9668-d7733f0e1443 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:47.747697 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e659ea-9461-4737-9668-d7733f0e1443 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:47.773231 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 395/791] 10.222.0.42 () {56 vars in 1135 bytes} [Wed Jun 22 08:35:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:47.776243 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1acfd83-36ab-48ba-a04d-209dcd0329cd None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:47.779449 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb33b6-c805-4d7f-b095-7a590e454e20 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:47.779747 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb33b6-c805-4d7f-b095-7a590e454e20 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:47.780017 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb33b6-c805-4d7f-b095-7a590e454e20 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:47.786262 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 396/792] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:35:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:35:47.786262 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb33b6-c805-4d7f-b095-7a590e454e20 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:47.825647 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f3593-1617-4ace-a9c2-324361e6975b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:47.826355 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f3593-1617-4ace-a9c2-324361e6975b None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:47.826640 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f3593-1617-4ace-a9c2-324361e6975b None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:47.826916 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f3593-1617-4ace-a9c2-324361e6975b None admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:47.827675 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757f3593-1617-4ace-a9c2-324361e6975b None admin] RBAC: Adding query filter params (name=admin) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:47.827982 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757f3593-1617-4ace-a9c2-324361e6975b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:47.830149 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757f3593-1617-4ace-a9c2-324361e6975b None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:47.845251 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 397/793] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Jun 22 08:35:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:47.847451 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30354cd7-0828-4853-b791-e0ff5f9ac810 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:47.848943 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30354cd7-0828-4853-b791-e0ff5f9ac810 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:47.849615 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30354cd7-0828-4853-b791-e0ff5f9ac810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:47.874063 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-30354cd7-0828-4853-b791-e0ff5f9ac810 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:35:47.875208 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-30354cd7-0828-4853-b791-e0ff5f9ac810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:35:47.892148 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:47.924992 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb33b6-c805-4d7f-b095-7a590e454e20 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:47.974099 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 398/794] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:35:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:35:47.974099 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30354cd7-0828-4853-b791-e0ff5f9ac810 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:47.976269 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e421d0be-8a22-4330-839d-1089b87f9c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:47.982313 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421d0be-8a22-4330-839d-1089b87f9c59 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:47.982639 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421d0be-8a22-4330-839d-1089b87f9c59 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:47.982943 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421d0be-8a22-4330-839d-1089b87f9c59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:47.987496 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:48.006704 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e421d0be-8a22-4330-839d-1089b87f9c59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:48.008179 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e421d0be-8a22-4330-839d-1089b87f9c59 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:48.028141 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-e421d0be-8a22-4330-839d-1089b87f9c59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:48.028141 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:48.028141 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:48.028141 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:48.028141 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:48.028141 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:48.028141 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:48.028141 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:48.028141 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:48.028141 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:48.028141 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:48.028141 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:48.028141 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:35:48.028141 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:35:48.028141 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:35:48.029076 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:35:48.029076 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:48.029076 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:48.029076 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:48.029076 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:48.029076 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:48.029076 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:48.029076 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:48.029076 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:48.029076 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:48.029076 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:48.029076 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:48.029076 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:48.029076 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:48.029076 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:48.029076 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:48.029076 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:48.030047 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:35:48.030047 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:35:48.030047 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:48.030047 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:48.030047 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 397/795] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:35:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:48.030369 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e421d0be-8a22-4330-839d-1089b87f9c59 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:48.112811 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30354cd7-0828-4853-b791-e0ff5f9ac810 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:48.151891 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e421d0be-8a22-4330-839d-1089b87f9c59 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:48.163069 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f6e26-7ca4-4457-bc56-803432007494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:48.164047 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f6e26-7ca4-4457-bc56-803432007494 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:48.164449 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f6e26-7ca4-4457-bc56-803432007494 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:48.164832 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f6e26-7ca4-4457-bc56-803432007494 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:48.179149 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1f6e26-7ca4-4457-bc56-803432007494 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:48.180616 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1f6e26-7ca4-4457-bc56-803432007494 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:48.188406 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:48.198776 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd342c4-5b93-4946-9388-7ba9df0d9d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:48.199961 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd342c4-5b93-4946-9388-7ba9df0d9d5b None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:48.200466 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd342c4-5b93-4946-9388-7ba9df0d9d5b None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:48.200967 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd342c4-5b93-4946-9388-7ba9df0d9d5b None admin] PATH_INFO: `/v3/roles/service` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:48.205145 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-1d1f6e26-7ca4-4457-bc56-803432007494 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:48.205145 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:48.205145 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:48.205145 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:48.205145 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:48.205145 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:48.205145 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:48.205145 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:48.205145 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:48.205145 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:48.205145 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:48.205145 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:48.205145 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:35:48.205145 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:35:48.205145 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:35:48.206035 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:35:48.206035 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:48.206035 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:48.206035 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:48.206035 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:48.206035 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:48.206035 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:48.206035 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:48.206035 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:48.206035 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:48.206035 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:48.206035 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:48.206035 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:48.206035 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:48.206035 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:48.206035 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:48.206035 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:48.206959 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:35:48.206959 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:35:48.206959 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:48.206959 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:48.206959 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 399/796] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:35:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:48.208542 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f6e26-7ca4-4457-bc56-803432007494 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:48.218473 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd342c4-5b93-4946-9388-7ba9df0d9d5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:35:48.226970 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-4dd342c4-5b93-4946-9388-7ba9df0d9d5b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:35:48.226970 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:48.226970 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:48.226970 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:48.226970 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:48.226970 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:48.226970 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:48.226970 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:48.226970 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:48.226970 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:48.226970 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:48.226970 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:48.226970 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:35:48.226970 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:35:48.226970 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:35:48.226970 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:35:48.227920 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:35:48.227920 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:35:48.227920 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:35:48.227920 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:35:48.227920 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:48.227920 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:48.227920 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:48.227920 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:48.227920 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:48.227920 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:48.227920 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:48.227920 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:48.227920 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:48.227920 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:48.227920 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:48.227920 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:48.228744 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:48.228744 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:48.228744 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:48.228744 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:48.228744 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:35:48.228744 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:35:48.228744 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:35:48.228744 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:35:48.228744 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:35:48.228744 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:35:48.228744 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:35:48.228744 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:48.232556 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 398/797] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Jun 22 08:35:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:48.233647 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd342c4-5b93-4946-9388-7ba9df0d9d5b None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:48.291339 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:48.337287 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f6e26-7ca4-4457-bc56-803432007494 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:48.350129 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd342c4-5b93-4946-9388-7ba9df0d9d5b None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:48.374814 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2e405-79c6-4695-81fe-8e8c35fecdaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:48.376041 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2e405-79c6-4695-81fe-8e8c35fecdaf None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:48.376326 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2e405-79c6-4695-81fe-8e8c35fecdaf None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:48.376895 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2e405-79c6-4695-81fe-8e8c35fecdaf None admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:48.377337 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a2e405-79c6-4695-81fe-8e8c35fecdaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:48.377646 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a2e405-79c6-4695-81fe-8e8c35fecdaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:48.379048 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a2e405-79c6-4695-81fe-8e8c35fecdaf None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:48.389088 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0973bc4-10c9-49f5-9b7c-daf033ecb5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:48.390497 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0973bc4-10c9-49f5-9b7c-daf033ecb5c2 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:48.391071 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0973bc4-10c9-49f5-9b7c-daf033ecb5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:48.392076 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0973bc4-10c9-49f5-9b7c-daf033ecb5c2 None admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:48.393033 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0973bc4-10c9-49f5-9b7c-daf033ecb5c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:48.393226 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 400/798] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:35:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:48.393739 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0973bc4-10c9-49f5-9b7c-daf033ecb5c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:48.394381 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2e405-79c6-4695-81fe-8e8c35fecdaf None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:48.395936 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0973bc4-10c9-49f5-9b7c-daf033ecb5c2 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:48.410192 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 399/799] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:35:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:48.411427 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0973bc4-10c9-49f5-9b7c-daf033ecb5c2 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:48.468112 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:48.508287 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2e405-79c6-4695-81fe-8e8c35fecdaf None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:48.528784 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0973bc4-10c9-49f5-9b7c-daf033ecb5c2 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:48.535631 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:48.547218 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76756d46-e5fb-4d20-8d75-72d0f6a2650f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:48.547952 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76756d46-e5fb-4d20-8d75-72d0f6a2650f None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:48.548252 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76756d46-e5fb-4d20-8d75-72d0f6a2650f None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:48.548552 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76756d46-e5fb-4d20-8d75-72d0f6a2650f None admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:48.549314 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76756d46-e5fb-4d20-8d75-72d0f6a2650f None admin] RBAC: Adding query filter params (name=service) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:48.549627 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76756d46-e5fb-4d20-8d75-72d0f6a2650f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:48.551040 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76756d46-e5fb-4d20-8d75-72d0f6a2650f None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:48.564107 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 401/800] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Jun 22 08:35:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:48.564107 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76756d46-e5fb-4d20-8d75-72d0f6a2650f None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:48.579319 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c29d70-56ed-464f-9f97-d79179ebe2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:48.580391 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c29d70-56ed-464f-9f97-d79179ebe2ea None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:48.581037 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c29d70-56ed-464f-9f97-d79179ebe2ea None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:48.581318 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c29d70-56ed-464f-9f97-d79179ebe2ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:48.591319 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c29d70-56ed-464f-9f97-d79179ebe2ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:48.593465 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c29d70-56ed-464f-9f97-d79179ebe2ea None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:48.612588 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-a6c29d70-56ed-464f-9f97-d79179ebe2ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:35:48.612588 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:48.612588 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:48.612588 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:48.612588 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:48.612588 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:48.612588 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:48.612588 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:48.612588 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:48.612588 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:48.612588 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:48.612588 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:48.612588 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:35:48.612588 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:35:48.612588 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:35:48.613691 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:35:48.613691 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:48.613691 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:48.613691 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:48.613691 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:48.613691 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:48.613691 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:48.613691 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:48.613691 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:48.613691 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:48.613691 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:48.613691 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:48.613691 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:48.613691 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:48.613691 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:48.613691 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:48.613691 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:48.614807 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:35:48.614807 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:35:48.614807 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:35:48.614807 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:35:48.614807 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:35:48.614807 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:35:48.614807 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:35:48.614807 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:48.621312 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 400/801] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Jun 22 08:35:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:48.622917 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dcade1-4aed-454f-becd-e6dc26473a4d None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:48.623288 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dcade1-4aed-454f-becd-e6dc26473a4d None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:48.623648 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dcade1-4aed-454f-becd-e6dc26473a4d None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:48.626057 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 401/802] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:35:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:35:48.627031 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dcade1-4aed-454f-becd-e6dc26473a4d None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:48.718917 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76756d46-e5fb-4d20-8d75-72d0f6a2650f None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:48.782054 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447aac69-e46f-407f-b029-b9b1081b7443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:48.784383 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447aac69-e46f-407f-b029-b9b1081b7443 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:48.785102 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dcade1-4aed-454f-becd-e6dc26473a4d None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:48.785701 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447aac69-e46f-407f-b029-b9b1081b7443 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:48.785996 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447aac69-e46f-407f-b029-b9b1081b7443 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:48.798010 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447aac69-e46f-407f-b029-b9b1081b7443 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:48.800005 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447aac69-e46f-407f-b029-b9b1081b7443 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:48.801270 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:48.817209 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-447aac69-e46f-407f-b029-b9b1081b7443 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 08:35:48.817209 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:48.817209 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:48.817209 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:48.817209 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:48.817209 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:48.817209 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:48.817209 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:48.817209 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:48.817209 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:48.817209 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:48.817209 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:48.817209 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:35:48.817209 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:35:48.817209 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:35:48.817209 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:35:48.818268 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:48.818268 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:48.818268 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:35:48.818268 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:35:48.818268 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:35:48.818268 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:35:48.818268 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:48.818268 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:48.818268 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:48.818268 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:48.818268 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:48.818268 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:48.818268 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:48.818268 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:48.818268 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:48.818268 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:48.818268 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:48.818268 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:48.819345 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:48.819345 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:48.819345 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:35:48.819345 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:35:48.819345 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:35:48.819345 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:35:48.819345 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:35:48.819345 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:35:48.819345 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 08:35:48.819345 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:48.824963 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 402/803] 10.222.0.42 () {56 vars in 1093 bytes} [Wed Jun 22 08:35:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:48.824963 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447aac69-e46f-407f-b029-b9b1081b7443 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:48.839650 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427f5dda-220b-41fc-9e21-6deb2b3fd503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:48.840562 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f5dda-220b-41fc-9e21-6deb2b3fd503 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:48.840751 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f5dda-220b-41fc-9e21-6deb2b3fd503 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:48.841031 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f5dda-220b-41fc-9e21-6deb2b3fd503 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:48.854838 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427f5dda-220b-41fc-9e21-6deb2b3fd503 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:48.856322 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427f5dda-220b-41fc-9e21-6deb2b3fd503 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:48.880228 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-427f5dda-220b-41fc-9e21-6deb2b3fd503 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:48.880228 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:48.880228 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:48.880228 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:48.880228 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:48.880228 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:48.880228 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:48.880228 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:48.880228 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:48.880228 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:48.880228 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:48.880228 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:48.880228 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:35:48.880228 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:35:48.880228 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:35:48.881223 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:35:48.881223 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:48.881223 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:48.881223 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:48.881223 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:48.881223 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:48.881223 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:48.881223 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:48.881223 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:48.881223 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:48.881223 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:48.881223 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:48.881223 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:48.881223 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:48.881223 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:48.881223 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:48.881223 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:48.882120 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:35:48.882120 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:35:48.882120 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:48.882120 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:48.882361 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:48.882438 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 402/804] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:35:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:48.883428 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e8a8d-1fff-4fe5-b2ac-88081c3284b8 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:48.883696 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e8a8d-1fff-4fe5-b2ac-88081c3284b8 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:48.883973 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e8a8d-1fff-4fe5-b2ac-88081c3284b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:48.906436 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-d19e8a8d-1fff-4fe5-b2ac-88081c3284b8 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:35:48.907690 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-d19e8a8d-1fff-4fe5-b2ac-88081c3284b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:35:48.959154 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447aac69-e46f-407f-b029-b9b1081b7443 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:49.003794 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 403/805] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:35:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:35:49.004387 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19e8a8d-1fff-4fe5-b2ac-88081c3284b8 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:49.011042 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd481f-ac22-4784-a117-c48f1cbeeb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:49.011727 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd481f-ac22-4784-a117-c48f1cbeeb9a None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:49.012011 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd481f-ac22-4784-a117-c48f1cbeeb9a None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:49.012281 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd481f-ac22-4784-a117-c48f1cbeeb9a None admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:49.013098 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd481f-ac22-4784-a117-c48f1cbeeb9a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:49.013393 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd481f-ac22-4784-a117-c48f1cbeeb9a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:49.022107 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd481f-ac22-4784-a117-c48f1cbeeb9a None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:49.028406 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 403/806] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Jun 22 08:35:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:49.029391 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd481f-ac22-4784-a117-c48f1cbeeb9a None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:49.110785 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:49.121084 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19e8a8d-1fff-4fe5-b2ac-88081c3284b8 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:49.134657 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd481f-ac22-4784-a117-c48f1cbeeb9a None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:49.142931 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:49.157529 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a16782-5e71-4e42-9c7f-07e43328d00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:49.158233 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a16782-5e71-4e42-9c7f-07e43328d00b None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:49.158514 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a16782-5e71-4e42-9c7f-07e43328d00b None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:49.158788 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a16782-5e71-4e42-9c7f-07e43328d00b None admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:49.159622 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a16782-5e71-4e42-9c7f-07e43328d00b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:49.159929 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a16782-5e71-4e42-9c7f-07e43328d00b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:49.161392 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a16782-5e71-4e42-9c7f-07e43328d00b None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:49.171503 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f722d1ca-b396-42c9-8d46-64884672d73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:49.172181 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722d1ca-b396-42c9-8d46-64884672d73a None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:49.173054 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722d1ca-b396-42c9-8d46-64884672d73a None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:49.173328 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722d1ca-b396-42c9-8d46-64884672d73a None admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:49.174039 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f722d1ca-b396-42c9-8d46-64884672d73a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:49.174372 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f722d1ca-b396-42c9-8d46-64884672d73a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:49.175705 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f722d1ca-b396-42c9-8d46-64884672d73a None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:49.178757 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 404/807] 10.222.0.42 () {56 vars in 1133 bytes} [Wed Jun 22 08:35:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:49.179532 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a16782-5e71-4e42-9c7f-07e43328d00b None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:49.187324 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 404/808] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:35:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:49.188033 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f722d1ca-b396-42c9-8d46-64884672d73a None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:49.287106 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a16782-5e71-4e42-9c7f-07e43328d00b None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:49.289325 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f722d1ca-b396-42c9-8d46-64884672d73a None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:49.325031 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda3319c-68bb-41af-a9c4-d8dfd51ca579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:49.325930 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3319c-68bb-41af-a9c4-d8dfd51ca579 None admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:49.326219 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27764ba6-d9b7-472d-b95c-521d07da8a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:49.326696 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3319c-68bb-41af-a9c4-d8dfd51ca579 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:49.326696 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3319c-68bb-41af-a9c4-d8dfd51ca579 None admin] PATH_INFO: `/v3/projects/e1f161193cb440fa8c4a9d23820a5c28/users/4403cea84ff646b88cdb785975b20346/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:49.327029 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27764ba6-d9b7-472d-b95c-521d07da8a65 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:49.327316 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27764ba6-d9b7-472d-b95c-521d07da8a65 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:49.327593 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27764ba6-d9b7-472d-b95c-521d07da8a65 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:49.328244 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27764ba6-d9b7-472d-b95c-521d07da8a65 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:49.329359 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda3319c-68bb-41af-a9c4-d8dfd51ca579 None admin] RBAC: Authorizing `identity:create_grant(project_id=e1f161193cb440fa8c4a9d23820a5c28, user_id=4403cea84ff646b88cdb785975b20346, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:49.330194 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27764ba6-d9b7-472d-b95c-521d07da8a65 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:49.330824 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda3319c-68bb-41af-a9c4-d8dfd51ca579 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:49.343676 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-27764ba6-d9b7-472d-b95c-521d07da8a65 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 08:35:49.343676 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:49.343676 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:35:49.343676 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:35:49.343676 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:35:49.343676 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:35:49.343676 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:35:49.343676 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:35:49.343676 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 08:35:49.343676 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:49.343676 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:35:49.343676 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:49.343676 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:49.343676 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:49.343676 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:49.343676 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:49.345288 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:49.345288 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:49.345288 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:49.345288 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:49.345288 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:49.345288 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:49.345288 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:49.345288 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:35:49.345288 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:35:49.345288 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:35:49.345288 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:35:49.345288 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:49.345288 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:49.345288 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:49.345288 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:49.345288 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:49.346229 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:49.346229 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:49.346229 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:49.346229 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:49.346229 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:49.346229 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:49.346229 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:49.346229 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:49.346229 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:49.346229 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:49.346229 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:49.346229 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:35:49.346229 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:35:49.346229 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 08:35:49.346229 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:49.346997 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 405/809] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Jun 22 08:35:49 2022] PUT /identity/v3/projects/e1f161193cb440fa8c4a9d23820a5c28/users/4403cea84ff646b88cdb785975b20346/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:35:49.347079 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 405/810] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Jun 22 08:35:49 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:49.347158 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f483cd9-aaf5-4ca6-8107-2562f59629b6 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:49.347158 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f483cd9-aaf5-4ca6-8107-2562f59629b6 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:49.347280 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27764ba6-d9b7-472d-b95c-521d07da8a65 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:49.347347 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f483cd9-aaf5-4ca6-8107-2562f59629b6 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:49.347876 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 406/811] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:35:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:35:49.348619 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f483cd9-aaf5-4ca6-8107-2562f59629b6 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:49.368272 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:49.393573 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:49.478606 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27764ba6-d9b7-472d-b95c-521d07da8a65 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:49.488045 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f483cd9-aaf5-4ca6-8107-2562f59629b6 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:49.533787 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c468118e-e66e-45fb-84cf-d752286a04d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:49.534504 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468118e-e66e-45fb-84cf-d752286a04d8 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:49.534785 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468118e-e66e-45fb-84cf-d752286a04d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:49.535058 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468118e-e66e-45fb-84cf-d752286a04d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:49.537363 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c39977-d4df-4c7c-93d5-adca0670543e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:49.538145 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c39977-d4df-4c7c-93d5-adca0670543e None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:49.538431 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c39977-d4df-4c7c-93d5-adca0670543e None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:49.538707 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c39977-d4df-4c7c-93d5-adca0670543e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:49.546222 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c39977-d4df-4c7c-93d5-adca0670543e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:49.548230 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c39977-d4df-4c7c-93d5-adca0670543e None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:49.565260 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-b7c39977-d4df-4c7c-93d5-adca0670543e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 08:35:49.565260 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:49.565260 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:49.565260 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:49.565260 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:49.565260 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:49.565260 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:49.565260 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:49.565260 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:49.565260 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:49.565260 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:49.565260 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:49.565260 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:35:49.565260 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:35:49.565260 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:35:49.565260 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:35:49.566650 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:49.566650 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:49.566650 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:35:49.566650 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:35:49.566650 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:35:49.566650 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:35:49.566650 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:49.566650 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:49.566650 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:49.566650 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:49.566650 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:49.566650 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:49.566650 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:49.566650 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:49.566650 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:49.566650 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:49.566650 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:49.566650 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:49.567868 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:49.567868 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:49.567868 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:35:49.567868 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:35:49.567868 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:35:49.567868 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:35:49.567868 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:35:49.567868 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:35:49.567868 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 08:35:49.567868 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:49.567868 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 407/812] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Jun 22 08:35:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:49.569265 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aca6b1-363f-4817-9a3a-cb9a2e0da4fa None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:49.569559 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aca6b1-363f-4817-9a3a-cb9a2e0da4fa None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:49.569836 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aca6b1-363f-4817-9a3a-cb9a2e0da4fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:49.586844 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-d8aca6b1-363f-4817-9a3a-cb9a2e0da4fa None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:35:49.588048 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-d8aca6b1-363f-4817-9a3a-cb9a2e0da4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:35:49.621604 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c468118e-e66e-45fb-84cf-d752286a04d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:49.623369 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c468118e-e66e-45fb-84cf-d752286a04d8 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:49.656314 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:49.657087 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:49.668938 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 408/813] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:35:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:35:49.669816 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aca6b1-363f-4817-9a3a-cb9a2e0da4fa None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:49.747641 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 406/814] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Jun 22 08:35:49 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 08:35:49.747641 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c468118e-e66e-45fb-84cf-d752286a04d8 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:49.800288 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aca6b1-363f-4817-9a3a-cb9a2e0da4fa None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:49.840875 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a6666-ddb5-4f75-a48e-100a26c613bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:49.841916 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a6666-ddb5-4f75-a48e-100a26c613bd None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:49.842277 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a6666-ddb5-4f75-a48e-100a26c613bd None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:49.842526 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a6666-ddb5-4f75-a48e-100a26c613bd None admin] PATH_INFO: `/v3/services` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:49.843340 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9a6666-ddb5-4f75-a48e-100a26c613bd None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:49.843545 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9a6666-ddb5-4f75-a48e-100a26c613bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:49.844920 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9a6666-ddb5-4f75-a48e-100a26c613bd None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:49.850071 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 409/815] 10.222.0.42 () {56 vars in 1124 bytes} [Wed Jun 22 08:35:49 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:49.850744 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c468118e-e66e-45fb-84cf-d752286a04d8 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:49.850893 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a6666-ddb5-4f75-a48e-100a26c613bd None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:49.890575 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:49.898398 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abedc99-5e38-4e49-8f02-394eea3dffaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:49.899079 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abedc99-5e38-4e49-8f02-394eea3dffaf None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:49.899356 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abedc99-5e38-4e49-8f02-394eea3dffaf None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:49.899637 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abedc99-5e38-4e49-8f02-394eea3dffaf None admin] PATH_INFO: `/v3/users` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:49.900473 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abedc99-5e38-4e49-8f02-394eea3dffaf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:49.900781 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abedc99-5e38-4e49-8f02-394eea3dffaf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:49.902257 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abedc99-5e38-4e49-8f02-394eea3dffaf None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:49.920933 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:49.921986 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 407/816] 10.222.0.42 () {56 vars in 1149 bytes} [Wed Jun 22 08:35:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:49.923186 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abedc99-5e38-4e49-8f02-394eea3dffaf None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:49.970959 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a6666-ddb5-4f75-a48e-100a26c613bd None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:50.009707 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0fe788-b4d4-48c3-936b-ef60a2de12a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:50.010609 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0fe788-b4d4-48c3-936b-ef60a2de12a3 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:50.011016 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0fe788-b4d4-48c3-936b-ef60a2de12a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:50.011296 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0fe788-b4d4-48c3-936b-ef60a2de12a3 None admin] PATH_INFO: `/v3/services/network` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:50.011957 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0fe788-b4d4-48c3-936b-ef60a2de12a3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:50.013337 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0fe788-b4d4-48c3-936b-ef60a2de12a3 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:50.027142 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abedc99-5e38-4e49-8f02-394eea3dffaf None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:50.028087 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-8e0fe788-b4d4-48c3-936b-ef60a2de12a3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 08:35:50.028087 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:50.028087 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:35:50.028087 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:35:50.028087 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:35:50.028087 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:35:50.028087 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:35:50.028087 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:35:50.028087 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 08:35:50.028087 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:50.028087 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:35:50.028087 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:50.028087 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:50.028087 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:50.028087 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:50.028087 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:50.028087 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:50.029062 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:50.029062 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:50.029062 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:50.029062 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:50.029062 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:50.029062 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:50.029062 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:35:50.029062 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:35:50.029062 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:35:50.029062 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:35:50.029062 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:50.029062 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:50.029062 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:50.029062 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:50.029062 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:50.029062 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:50.029875 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:50.029875 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:50.029875 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:50.029875 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:50.029875 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:50.029875 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:50.029875 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:50.029875 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:50.029875 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:50.029875 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:50.029875 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:35:50.029875 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:35:50.029875 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 08:35:50.029875 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:50.029875 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 410/817] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Jun 22 08:35:49 2022] GET /identity/v3/services/network => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:50.030676 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0fe788-b4d4-48c3-936b-ef60a2de12a3 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:50.071472 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a2f9a-988f-4156-9b36-f00495872003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:50.072207 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a2f9a-988f-4156-9b36-f00495872003 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:50.072488 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a2f9a-988f-4156-9b36-f00495872003 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:50.072760 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a2f9a-988f-4156-9b36-f00495872003 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:50.084122 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5a2f9a-988f-4156-9b36-f00495872003 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:50.085571 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5a2f9a-988f-4156-9b36-f00495872003 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:50.106540 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-ad5a2f9a-988f-4156-9b36-f00495872003 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:50.106540 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:50.106540 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:50.106540 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:50.106540 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:50.106540 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:50.106540 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:50.106540 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:50.106540 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:50.106540 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:50.106540 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:50.106540 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:50.106540 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:35:50.106540 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:35:50.106540 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:35:50.107474 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:35:50.107474 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:50.107474 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:50.107474 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:50.107474 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:50.107474 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:50.107474 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:50.107474 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:50.107474 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:50.107474 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:50.107474 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:50.107474 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:50.107474 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:50.107474 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:50.107474 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:50.107474 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:50.107474 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:50.108348 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:35:50.108348 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:35:50.108348 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:50.108348 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:50.110556 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 408/818] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:35:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:50.111554 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a2f9a-988f-4156-9b36-f00495872003 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:50.143382 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0fe788-b4d4-48c3-936b-ef60a2de12a3 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:50.160030 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:50.172063 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:50.182267 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a9ed0-afb2-45bd-8481-e7b6eafc726e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:50.183164 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a9ed0-afb2-45bd-8481-e7b6eafc726e None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:50.183612 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a9ed0-afb2-45bd-8481-e7b6eafc726e None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:50.183894 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a9ed0-afb2-45bd-8481-e7b6eafc726e None admin] PATH_INFO: `/v3/services` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:50.184611 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1a9ed0-afb2-45bd-8481-e7b6eafc726e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:50.184921 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1a9ed0-afb2-45bd-8481-e7b6eafc726e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:50.186337 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1a9ed0-afb2-45bd-8481-e7b6eafc726e None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:50.192220 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 411/819] 10.222.0.42 () {56 vars in 1124 bytes} [Wed Jun 22 08:35:50 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:50.192936 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a9ed0-afb2-45bd-8481-e7b6eafc726e None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:50.228130 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a2f9a-988f-4156-9b36-f00495872003 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:50.273831 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3de53-b483-4a91-b51a-072c665bbd5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:50.274652 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3de53-b483-4a91-b51a-072c665bbd5b None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:50.274936 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3de53-b483-4a91-b51a-072c665bbd5b None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:50.275213 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3de53-b483-4a91-b51a-072c665bbd5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:50.286410 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d3de53-b483-4a91-b51a-072c665bbd5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:50.287916 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d3de53-b483-4a91-b51a-072c665bbd5b None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:50.303934 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a9ed0-afb2-45bd-8481-e7b6eafc726e None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:50.306848 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-32d3de53-b483-4a91-b51a-072c665bbd5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:50.306848 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:50.306848 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:50.306848 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:50.306848 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:50.306848 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:50.306848 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:50.306848 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:50.306848 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:50.306848 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:50.306848 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:50.306848 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:50.306848 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:35:50.306848 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:35:50.306848 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:35:50.307839 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:35:50.307839 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:50.307839 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:50.307839 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:50.307839 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:50.307839 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:50.307839 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:50.307839 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:50.307839 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:50.307839 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:50.307839 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:50.307839 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:50.307839 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:50.307839 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:50.307839 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:50.307839 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:50.307839 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:50.309212 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:35:50.309212 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:35:50.309212 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:50.309212 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:50.309212 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 409/820] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:35:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:50.309212 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3de53-b483-4a91-b51a-072c665bbd5b None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:50.348989 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c8046-e602-4e8f-8732-81fed8267486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:50.349577 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c8046-e602-4e8f-8732-81fed8267486 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:50.349863 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c8046-e602-4e8f-8732-81fed8267486 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:50.350164 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c8046-e602-4e8f-8732-81fed8267486 None admin] PATH_INFO: `/v3/services` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:50.350885 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4c8046-e602-4e8f-8732-81fed8267486 None admin] RBAC: Adding query filter params (name=network) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:50.351195 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4c8046-e602-4e8f-8732-81fed8267486 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:50.352599 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4c8046-e602-4e8f-8732-81fed8267486 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:50.362541 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 412/821] 10.222.0.42 () {56 vars in 1112 bytes} [Wed Jun 22 08:35:50 2022] GET /identity/v3/services?name=network => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:50.362541 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c8046-e602-4e8f-8732-81fed8267486 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:50.417650 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:50.418827 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:50.429413 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3de53-b483-4a91-b51a-072c665bbd5b None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:50.474307 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c8046-e602-4e8f-8732-81fed8267486 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:50.475925 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc8c6d-cfc0-439f-8fdc-7e624f037008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:50.476950 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc8c6d-cfc0-439f-8fdc-7e624f037008 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:50.478298 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc8c6d-cfc0-439f-8fdc-7e624f037008 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:50.478590 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc8c6d-cfc0-439f-8fdc-7e624f037008 None admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:50.479371 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bc8c6d-cfc0-439f-8fdc-7e624f037008 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:50.479688 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bc8c6d-cfc0-439f-8fdc-7e624f037008 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:50.481133 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bc8c6d-cfc0-439f-8fdc-7e624f037008 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:50.497540 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 410/822] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:35:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:50.498503 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc8c6d-cfc0-439f-8fdc-7e624f037008 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:50.521317 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba61ca-22c6-4136-a3e9-dafaf277c4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:50.522062 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba61ca-22c6-4136-a3e9-dafaf277c4fc None admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:50.522439 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba61ca-22c6-4136-a3e9-dafaf277c4fc None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:50.522785 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba61ca-22c6-4136-a3e9-dafaf277c4fc None admin] PATH_INFO: `/v3/endpoints` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:50.523531 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fba61ca-22c6-4136-a3e9-dafaf277c4fc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:50.524914 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fba61ca-22c6-4136-a3e9-dafaf277c4fc None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:50.562125 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 413/823] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Jun 22 08:35:50 2022] POST /identity/v3/endpoints => generated 346 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:35:50.562125 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba61ca-22c6-4136-a3e9-dafaf277c4fc None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:50.650029 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc8c6d-cfc0-439f-8fdc-7e624f037008 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:50.682642 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba61ca-22c6-4136-a3e9-dafaf277c4fc None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:50.691368 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:50.695000 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04207b01-be8a-4ecf-832e-df43b2f6b764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:50.695989 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04207b01-be8a-4ecf-832e-df43b2f6b764 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:50.696459 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04207b01-be8a-4ecf-832e-df43b2f6b764 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:50.697026 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04207b01-be8a-4ecf-832e-df43b2f6b764 None admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:50.698146 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04207b01-be8a-4ecf-832e-df43b2f6b764 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:50.699223 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04207b01-be8a-4ecf-832e-df43b2f6b764 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:50.701709 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04207b01-be8a-4ecf-832e-df43b2f6b764 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:50.720153 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 411/824] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:35:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:50.721413 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04207b01-be8a-4ecf-832e-df43b2f6b764 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:50.724379 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7199b99-1a49-47d1-8a2f-c43bd0ea42c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:50.725056 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7199b99-1a49-47d1-8a2f-c43bd0ea42c9 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:50.725340 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7199b99-1a49-47d1-8a2f-c43bd0ea42c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:50.725615 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7199b99-1a49-47d1-8a2f-c43bd0ea42c9 None admin] PATH_INFO: `/v3/services` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:50.726372 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7199b99-1a49-47d1-8a2f-c43bd0ea42c9 None admin] RBAC: Adding query filter params (type=network) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:50.726681 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7199b99-1a49-47d1-8a2f-c43bd0ea42c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:50.728071 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7199b99-1a49-47d1-8a2f-c43bd0ea42c9 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:50.734479 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 414/825] 10.222.0.42 () {56 vars in 1112 bytes} [Wed Jun 22 08:35:50 2022] GET /identity/v3/services?type=network => generated 350 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:50.736125 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7199b99-1a49-47d1-8a2f-c43bd0ea42c9 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:50.743695 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:50.847682 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04207b01-be8a-4ecf-832e-df43b2f6b764 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:50.870808 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7199b99-1a49-47d1-8a2f-c43bd0ea42c9 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:50.888873 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca49f5-d6c6-4ed0-9cad-7310bad8191c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:50.890590 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca49f5-d6c6-4ed0-9cad-7310bad8191c None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:50.890912 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca49f5-d6c6-4ed0-9cad-7310bad8191c None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:50.891191 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca49f5-d6c6-4ed0-9cad-7310bad8191c None admin] PATH_INFO: `/v3/projects/service` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:50.901241 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ca49f5-d6c6-4ed0-9cad-7310bad8191c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:50.902744 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ca49f5-d6c6-4ed0-9cad-7310bad8191c None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:50.917915 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-c4ca49f5-d6c6-4ed0-9cad-7310bad8191c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:35:50.917915 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:50.917915 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:50.917915 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:50.917915 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:50.917915 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:50.917915 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:50.917915 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:50.917915 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:50.917915 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:50.917915 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:50.917915 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:50.917915 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:35:50.917915 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:35:50.917915 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:35:50.918852 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:35:50.918852 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:50.918852 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:50.918852 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:50.918852 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:50.918852 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:50.918852 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:50.918852 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:50.918852 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:50.918852 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:50.918852 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:50.918852 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:50.918852 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:50.918852 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:50.918852 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:50.918852 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:50.918852 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:50.919746 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:35:50.919746 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:35:50.919746 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:35:50.919746 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:35:50.919746 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:35:50.919746 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:35:50.919746 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:35:50.919746 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:50.920672 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae349b-d953-4aca-ae0d-89dab68bf5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:50.921748 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae349b-d953-4aca-ae0d-89dab68bf5bd None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:50.922730 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 412/826] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Jun 22 08:35:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:50.923086 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae349b-d953-4aca-ae0d-89dab68bf5bd None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:50.923583 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca49f5-d6c6-4ed0-9cad-7310bad8191c None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:50.923708 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae349b-d953-4aca-ae0d-89dab68bf5bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:50.933036 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deae349b-d953-4aca-ae0d-89dab68bf5bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:50.934846 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deae349b-d953-4aca-ae0d-89dab68bf5bd None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:50.956163 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-deae349b-d953-4aca-ae0d-89dab68bf5bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:35:50.956163 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:50.956163 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:50.956163 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:50.956163 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:50.956163 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:50.956163 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:50.956163 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:50.956163 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:50.956163 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:50.956163 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:50.956163 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:50.956163 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:35:50.956163 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:35:50.956163 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:35:50.957102 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:35:50.957102 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:50.957102 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:50.957102 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:50.957102 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:50.957102 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:50.957102 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:50.957102 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:50.957102 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:50.957102 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:50.957102 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:50.957102 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:50.957102 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:50.957102 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:50.957102 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:50.957102 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:50.957102 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:50.957966 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:35:50.957966 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:35:50.957966 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:35:50.957966 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:35:50.957966 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:35:50.957966 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:35:50.957966 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:35:50.957966 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:50.959589 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 415/827] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Jun 22 08:35:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:50.964840 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae349b-d953-4aca-ae0d-89dab68bf5bd None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:50.999691 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:51.032860 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:51.074548 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca49f5-d6c6-4ed0-9cad-7310bad8191c None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:51.079415 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae349b-d953-4aca-ae0d-89dab68bf5bd None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:51.116638 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2170504-a70b-4c4e-b890-b96764ce1a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:51.117307 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2170504-a70b-4c4e-b890-b96764ce1a24 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:51.117590 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2170504-a70b-4c4e-b890-b96764ce1a24 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:51.117953 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2170504-a70b-4c4e-b890-b96764ce1a24 None admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:51.118785 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2170504-a70b-4c4e-b890-b96764ce1a24 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:51.119138 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2170504-a70b-4c4e-b890-b96764ce1a24 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:51.120583 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2170504-a70b-4c4e-b890-b96764ce1a24 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:51.121281 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310cef0-6c1d-4c97-8991-4358849a5327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:51.122199 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310cef0-6c1d-4c97-8991-4358849a5327 None admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:51.122931 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310cef0-6c1d-4c97-8991-4358849a5327 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:51.123842 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310cef0-6c1d-4c97-8991-4358849a5327 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:51.124810 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0310cef0-6c1d-4c97-8991-4358849a5327 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:51.127063 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0310cef0-6c1d-4c97-8991-4358849a5327 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:51.138438 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 416/828] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Jun 22 08:35:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:51.139295 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2170504-a70b-4c4e-b890-b96764ce1a24 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:51.159907 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 413/829] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Jun 22 08:35:50 2022] POST /identity/v3/endpoints => generated 327 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:35:51.161285 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310cef0-6c1d-4c97-8991-4358849a5327 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:51.371817 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:51.390995 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2170504-a70b-4c4e-b890-b96764ce1a24 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:51.410888 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310cef0-6c1d-4c97-8991-4358849a5327 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:51.444285 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:51.451693 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e2e40-9c91-4fbd-9177-d30c8cce664c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:51.452516 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e2e40-9c91-4fbd-9177-d30c8cce664c None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:51.452891 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e2e40-9c91-4fbd-9177-d30c8cce664c None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:51.453291 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e2e40-9c91-4fbd-9177-d30c8cce664c None admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:51.455128 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7e2e40-9c91-4fbd-9177-d30c8cce664c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:51.455549 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7e2e40-9c91-4fbd-9177-d30c8cce664c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:51.457165 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7e2e40-9c91-4fbd-9177-d30c8cce664c None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:51.462104 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf9cb1-6a76-47dd-9f64-1a8c4929e9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:51.463003 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf9cb1-6a76-47dd-9f64-1a8c4929e9da None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:51.463541 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf9cb1-6a76-47dd-9f64-1a8c4929e9da None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:51.463992 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf9cb1-6a76-47dd-9f64-1a8c4929e9da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:51.466961 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaf9cb1-6a76-47dd-9f64-1a8c4929e9da None admin] RBAC: Adding query filter params (role.id=c7518e0f532945af80c33860f2ac506d, scope.project.id=e1f161193cb440fa8c4a9d23820a5c28, user.id=4f1809a35b244c1db7a185d82859369e) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:51.467289 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaf9cb1-6a76-47dd-9f64-1a8c4929e9da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:51.469826 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaf9cb1-6a76-47dd-9f64-1a8c4929e9da None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:51.475036 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 417/830] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Jun 22 08:35:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:51.475036 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e75ba-77ec-4619-a2fc-8254c43f9601 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:51.475036 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e75ba-77ec-4619-a2fc-8254c43f9601 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:51.475036 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e75ba-77ec-4619-a2fc-8254c43f9601 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:51.476298 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 418/831] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:35:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:35:51.481733 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3bbde3-68a6-47c7-bd55-48e6d4b3b1ab None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:51.482121 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3bbde3-68a6-47c7-bd55-48e6d4b3b1ab None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:51.482483 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3bbde3-68a6-47c7-bd55-48e6d4b3b1ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:51.483123 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 414/832] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Jun 22 08:35:51 2022] GET /identity/v3/role_assignments?user.id=4f1809a35b244c1db7a185d82859369e&scope.project.id=e1f161193cb440fa8c4a9d23820a5c28&role.id=c7518e0f532945af80c33860f2ac506d => generated 608 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:51.493058 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf9cb1-6a76-47dd-9f64-1a8c4929e9da None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:51.502719 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-2a3bbde3-68a6-47c7-bd55-48e6d4b3b1ab None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:35:51.505301 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-2a3bbde3-68a6-47c7-bd55-48e6d4b3b1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:35:51.584279 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 419/833] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:35:51 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 08:35:51.609377 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3bbde3-68a6-47c7-bd55-48e6d4b3b1ab None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:51.620954 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf9cb1-6a76-47dd-9f64-1a8c4929e9da None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:51.661777 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59312780-ee3c-41b0-b87b-2145135e55af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:51.663081 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59312780-ee3c-41b0-b87b-2145135e55af None admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:51.663594 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59312780-ee3c-41b0-b87b-2145135e55af None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:51.664057 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59312780-ee3c-41b0-b87b-2145135e55af None admin] PATH_INFO: `/v3/projects/e1f161193cb440fa8c4a9d23820a5c28/users/2bf91272d78b4e8f854c760622465af9/roles/e67c237283fd404d9a2bdf1333109696` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:51.683283 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59312780-ee3c-41b0-b87b-2145135e55af None admin] RBAC: Authorizing `identity:create_grant(project_id=e1f161193cb440fa8c4a9d23820a5c28, user_id=2bf91272d78b4e8f854c760622465af9, role_id=e67c237283fd404d9a2bdf1333109696)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:51.685334 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59312780-ee3c-41b0-b87b-2145135e55af None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:51.710210 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 415/834] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Jun 22 08:35:51 2022] PUT /identity/v3/projects/e1f161193cb440fa8c4a9d23820a5c28/users/2bf91272d78b4e8f854c760622465af9/roles/e67c237283fd404d9a2bdf1333109696 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 08:35:51.850486 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:51.873703 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3bbde3-68a6-47c7-bd55-48e6d4b3b1ab None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:51.916272 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5321891-bd23-4f5c-b3a8-a349f258b9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:51.917038 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5321891-bd23-4f5c-b3a8-a349f258b9b1 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:51.917327 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5321891-bd23-4f5c-b3a8-a349f258b9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:51.917607 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5321891-bd23-4f5c-b3a8-a349f258b9b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:51.931265 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5321891-bd23-4f5c-b3a8-a349f258b9b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:35:51.939851 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-a5321891-bd23-4f5c-b3a8-a349f258b9b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:35:51.939851 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:51.939851 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:51.939851 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:51.939851 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:51.939851 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:51.939851 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:51.939851 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:51.939851 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:51.939851 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:51.939851 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:51.939851 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:51.939851 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:35:51.939851 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:35:51.939851 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:35:51.939851 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:35:51.941072 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:35:51.941072 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:35:51.941072 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:35:51.941072 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:35:51.941072 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:51.941072 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:51.941072 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:51.941072 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:51.941072 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:51.941072 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:51.941072 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:51.941072 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:51.941072 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:51.941072 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:51.941072 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:51.941072 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:51.942953 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:51.942953 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:51.942953 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:51.942953 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:51.942953 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:35:51.942953 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:35:51.942953 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:35:51.942953 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:35:51.942953 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:35:51.942953 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:35:51.942953 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:35:51.942953 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:51.942953 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 420/835] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Jun 22 08:35:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:35:51.948645 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59312780-ee3c-41b0-b87b-2145135e55af None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:52.002391 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:52.079041 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59312780-ee3c-41b0-b87b-2145135e55af None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:52.123331 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b61d429-2a38-455d-9c38-d9f986dc03ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:52.124171 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61d429-2a38-455d-9c38-d9f986dc03ea None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:52.124571 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61d429-2a38-455d-9c38-d9f986dc03ea None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:52.124944 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61d429-2a38-455d-9c38-d9f986dc03ea None admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:52.127006 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b61d429-2a38-455d-9c38-d9f986dc03ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:52.127542 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b61d429-2a38-455d-9c38-d9f986dc03ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:52.129486 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b61d429-2a38-455d-9c38-d9f986dc03ea None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:52.142717 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 416/836] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Jun 22 08:35:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:52.148784 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5321891-bd23-4f5c-b3a8-a349f258b9b1 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:52.266924 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5321891-bd23-4f5c-b3a8-a349f258b9b1 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:52.308147 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c18b78-63c8-4e63-8fdb-70ec61897d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:52.309053 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c18b78-63c8-4e63-8fdb-70ec61897d1b None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:52.309407 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c18b78-63c8-4e63-8fdb-70ec61897d1b None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:52.309696 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c18b78-63c8-4e63-8fdb-70ec61897d1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:52.325159 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:52.327551 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c18b78-63c8-4e63-8fdb-70ec61897d1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:52.330204 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c18b78-63c8-4e63-8fdb-70ec61897d1b None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:52.352887 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-79c18b78-63c8-4e63-8fdb-70ec61897d1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:52.352887 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:52.352887 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:52.352887 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:52.352887 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:52.352887 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:52.352887 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:52.352887 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:52.352887 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:52.352887 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:52.352887 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:52.352887 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:52.352887 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:35:52.352887 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:35:52.352887 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:35:52.354907 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:35:52.354907 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:52.354907 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:52.354907 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:52.354907 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:52.354907 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:52.354907 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:52.354907 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:52.354907 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:52.354907 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:52.354907 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:52.354907 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:52.354907 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:52.354907 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:52.354907 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:52.354907 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:52.354907 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:52.356584 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:35:52.356584 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:35:52.356584 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:52.356584 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:52.356584 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 421/837] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:35:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:35:52.360770 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b61d429-2a38-455d-9c38-d9f986dc03ea None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:52.484890 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:52.488454 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b61d429-2a38-455d-9c38-d9f986dc03ea None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:52.536724 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a9e49d-b621-4b82-bd9d-4996943383d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:52.537315 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9e49d-b621-4b82-bd9d-4996943383d9 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:52.537597 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9e49d-b621-4b82-bd9d-4996943383d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:52.537874 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9e49d-b621-4b82-bd9d-4996943383d9 None admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:52.538638 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a9e49d-b621-4b82-bd9d-4996943383d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:52.538948 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a9e49d-b621-4b82-bd9d-4996943383d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:52.540322 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a9e49d-b621-4b82-bd9d-4996943383d9 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:52.555756 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 417/838] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:35:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:52.561768 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c18b78-63c8-4e63-8fdb-70ec61897d1b None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:52.679055 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c18b78-63c8-4e63-8fdb-70ec61897d1b None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:52.719609 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b453deb-5923-4e00-8acc-ceef15d6477c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:52.720984 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b453deb-5923-4e00-8acc-ceef15d6477c None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:52.721551 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b453deb-5923-4e00-8acc-ceef15d6477c None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:52.722067 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b453deb-5923-4e00-8acc-ceef15d6477c None admin] PATH_INFO: `/v3/users/swift` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:52.732019 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b453deb-5923-4e00-8acc-ceef15d6477c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:52.734069 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b453deb-5923-4e00-8acc-ceef15d6477c None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:52.752060 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-4b453deb-5923-4e00-8acc-ceef15d6477c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 22 08:35:52.752060 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:52.752060 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:52.752060 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:52.752060 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:52.752060 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:52.752060 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:52.752060 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:52.752060 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:52.752060 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:52.752060 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:52.752060 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:52.752060 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:35:52.752060 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:35:52.752060 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:35:52.752060 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:35:52.753184 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:52.753184 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:52.753184 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:35:52.753184 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:35:52.753184 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:35:52.753184 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:35:52.753184 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:52.753184 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:52.753184 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:52.753184 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:52.753184 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:52.753184 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:52.753184 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:52.753184 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:52.753184 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:52.753184 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:52.753184 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:52.753184 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:52.754683 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:52.754683 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:52.754683 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:35:52.754683 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:35:52.754683 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:35:52.754683 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:35:52.754683 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:35:52.754683 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:35:52.754683 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 22 08:35:52.754683 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:52.757421 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 422/839] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Jun 22 08:35:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:52.764128 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a9e49d-b621-4b82-bd9d-4996943383d9 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:52.834202 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6079aef-caed-4cd9-b0c4-1225dce779a7 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:52.834615 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6079aef-caed-4cd9-b0c4-1225dce779a7 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:52.835113 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6079aef-caed-4cd9-b0c4-1225dce779a7 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:52.837496 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 423/840] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:35:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:35:52.843021 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8eeb2-615c-45c7-8f88-56815a08ff33 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:52.843317 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8eeb2-615c-45c7-8f88-56815a08ff33 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:52.843606 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8eeb2-615c-45c7-8f88-56815a08ff33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:52.862223 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-7aa8eeb2-615c-45c7-8f88-56815a08ff33 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:35:52.863712 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-7aa8eeb2-615c-45c7-8f88-56815a08ff33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:35:52.901859 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a9e49d-b621-4b82-bd9d-4996943383d9 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:52.918805 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:52.943076 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5155b1-d159-4463-80e7-2579054eeebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:52.944032 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5155b1-d159-4463-80e7-2579054eeebe None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:52.944461 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5155b1-d159-4463-80e7-2579054eeebe None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:52.944888 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5155b1-d159-4463-80e7-2579054eeebe None admin] PATH_INFO: `/v3/users` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:52.945919 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5155b1-d159-4463-80e7-2579054eeebe None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:52.946392 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5155b1-d159-4463-80e7-2579054eeebe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:52.947952 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5155b1-d159-4463-80e7-2579054eeebe None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:52.950998 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 424/841] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:35:52 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:35:52.968023 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 418/842] 10.222.0.42 () {56 vars in 1135 bytes} [Wed Jun 22 08:35:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:52.981152 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa8eeb2-615c-45c7-8f88-56815a08ff33 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:52.983186 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5155b1-d159-4463-80e7-2579054eeebe None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:53.031979 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:53.098201 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa8eeb2-615c-45c7-8f88-56815a08ff33 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:53.135250 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5155b1-d159-4463-80e7-2579054eeebe None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:53.143752 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d682ab-a78b-4e60-8315-a9507a611697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:53.144895 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d682ab-a78b-4e60-8315-a9507a611697 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:53.145852 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d682ab-a78b-4e60-8315-a9507a611697 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:53.145852 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d682ab-a78b-4e60-8315-a9507a611697 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:53.178308 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b607f4b4-4b84-4b92-92b2-e7494592e6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:53.179434 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607f4b4-4b84-4b92-92b2-e7494592e6e4 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:53.179867 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607f4b4-4b84-4b92-92b2-e7494592e6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:53.180290 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607f4b4-4b84-4b92-92b2-e7494592e6e4 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:53.181229 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b607f4b4-4b84-4b92-92b2-e7494592e6e4 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:53.182894 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b607f4b4-4b84-4b92-92b2-e7494592e6e4 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:53.196637 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-b607f4b4-4b84-4b92-92b2-e7494592e6e4 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 08:35:53.196637 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:53.196637 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:35:53.196637 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:35:53.196637 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:35:53.196637 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:35:53.196637 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:35:53.196637 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:35:53.196637 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 08:35:53.196637 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:53.196637 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:35:53.196637 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:53.196637 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:53.196637 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:53.196637 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:53.196637 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:53.196637 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:53.197687 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:53.197687 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:53.197687 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:53.197687 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:53.197687 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:53.197687 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:53.197687 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:35:53.197687 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:35:53.197687 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:35:53.197687 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:35:53.197687 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:53.197687 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:53.197687 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:53.197687 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:53.197687 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:53.197687 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:53.198535 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:53.198535 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:53.198535 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:53.198535 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:53.198535 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:53.198535 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:53.198535 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:53.198535 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:53.198535 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:53.198535 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:53.198535 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:35:53.198535 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:35:53.198535 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 08:35:53.198535 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:53.206619 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 419/843] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Jun 22 08:35:52 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:53.208190 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b607f4b4-4b84-4b92-92b2-e7494592e6e4 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:53.210599 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:53.235937 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d682ab-a78b-4e60-8315-a9507a611697 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:53.238184 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d682ab-a78b-4e60-8315-a9507a611697 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:53.319885 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:53.340734 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b607f4b4-4b84-4b92-92b2-e7494592e6e4 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:53.367911 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 425/844] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Jun 22 08:35:52 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 08:35:53.369208 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d682ab-a78b-4e60-8315-a9507a611697 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:53.380293 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fcbd45-b97c-470b-8e7a-4926d2811d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:53.380975 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcbd45-b97c-470b-8e7a-4926d2811d7e None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:53.381251 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcbd45-b97c-470b-8e7a-4926d2811d7e None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:53.381528 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcbd45-b97c-470b-8e7a-4926d2811d7e None admin] PATH_INFO: `/v3/services` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:53.382328 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fcbd45-b97c-470b-8e7a-4926d2811d7e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:53.382603 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fcbd45-b97c-470b-8e7a-4926d2811d7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:53.384123 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fcbd45-b97c-470b-8e7a-4926d2811d7e None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:53.395172 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 420/845] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Jun 22 08:35:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:35:53.396497 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fcbd45-b97c-470b-8e7a-4926d2811d7e None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:53.471950 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:53.502367 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d682ab-a78b-4e60-8315-a9507a611697 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:53.545860 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7813b18-b8b2-461e-8007-9bc1f4784ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:53.547663 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7813b18-b8b2-461e-8007-9bc1f4784ca3 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:53.548122 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7813b18-b8b2-461e-8007-9bc1f4784ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:53.548550 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7813b18-b8b2-461e-8007-9bc1f4784ca3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:53.555476 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fcbd45-b97c-470b-8e7a-4926d2811d7e None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:53.562131 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7813b18-b8b2-461e-8007-9bc1f4784ca3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:53.564012 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7813b18-b8b2-461e-8007-9bc1f4784ca3 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:53.584827 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-d7813b18-b8b2-461e-8007-9bc1f4784ca3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:53.584827 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:53.584827 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:53.584827 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:53.584827 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:53.584827 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:53.584827 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:53.584827 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:53.584827 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:53.584827 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:53.584827 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:53.584827 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:53.584827 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:35:53.584827 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:35:53.584827 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:35:53.585956 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:35:53.585956 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:53.585956 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:53.585956 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:53.585956 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:53.585956 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:53.585956 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:53.585956 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:53.585956 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:53.585956 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:53.585956 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:53.585956 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:53.585956 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:53.585956 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:53.585956 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:53.585956 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:53.585956 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:53.587212 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:35:53.587212 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:35:53.587212 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:53.587212 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:53.594700 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 426/846] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:35:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:53.596057 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7813b18-b8b2-461e-8007-9bc1f4784ca3 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:53.604963 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80891775-4450-48ad-bce0-4e3b4c4ec107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:53.606009 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80891775-4450-48ad-bce0-4e3b4c4ec107 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:53.606471 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80891775-4450-48ad-bce0-4e3b4c4ec107 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:53.606758 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80891775-4450-48ad-bce0-4e3b4c4ec107 None admin] PATH_INFO: `/v3/services` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:53.607771 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80891775-4450-48ad-bce0-4e3b4c4ec107 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:53.608143 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80891775-4450-48ad-bce0-4e3b4c4ec107 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:53.611912 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80891775-4450-48ad-bce0-4e3b4c4ec107 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:53.630242 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 421/847] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Jun 22 08:35:53 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:53.728027 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7813b18-b8b2-461e-8007-9bc1f4784ca3 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:53.772528 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a1cb2-782e-4529-a16c-e83375bdc2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:53.773527 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a1cb2-782e-4529-a16c-e83375bdc2b7 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:53.774021 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a1cb2-782e-4529-a16c-e83375bdc2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:53.774524 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a1cb2-782e-4529-a16c-e83375bdc2b7 None admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:53.775567 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a1cb2-782e-4529-a16c-e83375bdc2b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:53.776124 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a1cb2-782e-4529-a16c-e83375bdc2b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:53.777787 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a1cb2-782e-4529-a16c-e83375bdc2b7 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:53.779997 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:53.798506 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 427/848] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:35:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:53.800597 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80891775-4450-48ad-bce0-4e3b4c4ec107 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:53.816367 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:53.864660 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302d954-0a4b-467a-9cec-bfed9db4896c None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:53.865329 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302d954-0a4b-467a-9cec-bfed9db4896c None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:53.865879 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302d954-0a4b-467a-9cec-bfed9db4896c None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:53.869130 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 428/849] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:35:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:35:53.874298 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71981b15-54af-4c80-92e5-2b7af56a01fe None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:53.874926 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71981b15-54af-4c80-92e5-2b7af56a01fe None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:53.875974 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71981b15-54af-4c80-92e5-2b7af56a01fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:53.894488 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-71981b15-54af-4c80-92e5-2b7af56a01fe None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:35:53.896266 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-71981b15-54af-4c80-92e5-2b7af56a01fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:35:53.948429 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80891775-4450-48ad-bce0-4e3b4c4ec107 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:53.998162 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 429/850] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:35:53 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 08:35:54.006663 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaac774-f143-4045-8021-165233752df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:54.007857 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaac774-f143-4045-8021-165233752df8 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:54.008317 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaac774-f143-4045-8021-165233752df8 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:54.008783 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaac774-f143-4045-8021-165233752df8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:54.018233 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71981b15-54af-4c80-92e5-2b7af56a01fe None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:54.021020 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaac774-f143-4045-8021-165233752df8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:54.022878 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaac774-f143-4045-8021-165233752df8 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:54.046395 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-3aaac774-f143-4045-8021-165233752df8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:35:54.046395 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:54.046395 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:54.046395 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:54.046395 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:54.046395 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:54.046395 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:54.046395 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:54.046395 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:54.046395 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:54.046395 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:54.046395 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:54.046395 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:35:54.046395 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:35:54.046395 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:35:54.048406 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:35:54.048406 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:54.048406 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:54.048406 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:54.048406 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:54.048406 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:54.048406 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:54.048406 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:54.048406 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:54.048406 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:54.048406 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:54.048406 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:54.048406 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:54.048406 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:54.048406 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:54.048406 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:54.048406 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:54.050043 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:35:54.050043 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:35:54.050043 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:35:54.050043 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:35:54.050043 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:35:54.050043 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:35:54.050043 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:35:54.050043 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:54.053795 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 422/851] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Jun 22 08:35:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:54.064119 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaac774-f143-4045-8021-165233752df8 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:54.138887 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71981b15-54af-4c80-92e5-2b7af56a01fe None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:54.154248 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:54.167273 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:54.182598 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b6a38e-f287-4b16-89ee-1db5f56e3079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:54.183792 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b6a38e-f287-4b16-89ee-1db5f56e3079 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:54.184236 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b6a38e-f287-4b16-89ee-1db5f56e3079 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:54.184605 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b6a38e-f287-4b16-89ee-1db5f56e3079 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:54.185444 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b6a38e-f287-4b16-89ee-1db5f56e3079 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:54.187236 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b6a38e-f287-4b16-89ee-1db5f56e3079 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:54.194246 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaac774-f143-4045-8021-165233752df8 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:54.202156 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-e4b6a38e-f287-4b16-89ee-1db5f56e3079 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 08:35:54.202156 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:54.202156 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:35:54.202156 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:35:54.202156 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:35:54.202156 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:35:54.202156 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:35:54.202156 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:35:54.202156 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 08:35:54.202156 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:54.202156 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:35:54.202156 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:54.202156 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:54.202156 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:54.202156 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:54.202156 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:54.203847 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:54.203847 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:54.203847 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:54.203847 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:54.203847 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:54.203847 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:54.203847 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:54.203847 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:35:54.203847 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:35:54.203847 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:35:54.203847 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:35:54.203847 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:54.203847 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:54.203847 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:54.203847 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:54.203847 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:54.204747 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:54.204747 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:54.204747 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:54.204747 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:54.204747 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:54.204747 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:54.204747 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:54.204747 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:54.204747 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:54.204747 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:54.204747 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:54.204747 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:35:54.204747 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:35:54.204747 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 08:35:54.204747 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:54.209628 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 430/852] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Jun 22 08:35:54 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:35:54.211094 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b6a38e-f287-4b16-89ee-1db5f56e3079 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:54.256619 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddf3592-a3ec-4ff8-ad95-f4bb35a926c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:54.257292 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf3592-a3ec-4ff8-ad95-f4bb35a926c0 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:54.258453 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf3592-a3ec-4ff8-ad95-f4bb35a926c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:54.258953 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf3592-a3ec-4ff8-ad95-f4bb35a926c0 None admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:54.259793 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddf3592-a3ec-4ff8-ad95-f4bb35a926c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:54.260115 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddf3592-a3ec-4ff8-ad95-f4bb35a926c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:54.261703 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddf3592-a3ec-4ff8-ad95-f4bb35a926c0 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:54.275545 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 423/853] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Jun 22 08:35:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:54.277060 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad430307-889f-4fe8-b81f-117aa67a5a86 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:54.277309 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad430307-889f-4fe8-b81f-117aa67a5a86 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:54.277633 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad430307-889f-4fe8-b81f-117aa67a5a86 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:54.279295 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 424/854] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:35:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:35:54.284981 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad430307-889f-4fe8-b81f-117aa67a5a86 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:54.355394 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b6a38e-f287-4b16-89ee-1db5f56e3079 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:54.404704 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be2a7c-3c19-4842-91e9-90af073101aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:54.405283 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be2a7c-3c19-4842-91e9-90af073101aa None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:54.405558 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be2a7c-3c19-4842-91e9-90af073101aa None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:54.405826 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be2a7c-3c19-4842-91e9-90af073101aa None admin] PATH_INFO: `/v3/services` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:54.407108 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9be2a7c-3c19-4842-91e9-90af073101aa None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:54.407414 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9be2a7c-3c19-4842-91e9-90af073101aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:54.408799 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9be2a7c-3c19-4842-91e9-90af073101aa None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:54.421115 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 431/855] 10.222.0.42 () {56 vars in 1126 bytes} [Wed Jun 22 08:35:54 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:54.423552 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79713056-40f0-47b7-ab06-626568e9804b None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:54.423930 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79713056-40f0-47b7-ab06-626568e9804b None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:54.424108 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79713056-40f0-47b7-ab06-626568e9804b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:54.425550 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad430307-889f-4fe8-b81f-117aa67a5a86 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:54.447815 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-79713056-40f0-47b7-ab06-626568e9804b None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:35:54.449847 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-79713056-40f0-47b7-ab06-626568e9804b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:35:54.462809 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:54.470811 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ee7e27-4586-4f50-bb77-a5d7818ea736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:54.471485 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee7e27-4586-4f50-bb77-a5d7818ea736 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:54.471769 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee7e27-4586-4f50-bb77-a5d7818ea736 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:54.472045 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee7e27-4586-4f50-bb77-a5d7818ea736 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:54.472887 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ee7e27-4586-4f50-bb77-a5d7818ea736 None admin] RBAC: Adding query filter params (role.id=c7518e0f532945af80c33860f2ac506d, scope.project.id=e1f161193cb440fa8c4a9d23820a5c28, user.id=4403cea84ff646b88cdb785975b20346) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:54.473197 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ee7e27-4586-4f50-bb77-a5d7818ea736 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:54.474665 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ee7e27-4586-4f50-bb77-a5d7818ea736 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:54.490121 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 425/856] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Jun 22 08:35:54 2022] GET /identity/v3/role_assignments?user.id=4403cea84ff646b88cdb785975b20346&scope.project.id=e1f161193cb440fa8c4a9d23820a5c28&role.id=c7518e0f532945af80c33860f2ac506d => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:35:54.490121 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ee7e27-4586-4f50-bb77-a5d7818ea736 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:54.529918 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:54.564735 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 432/857] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:35:54 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:35:54.589043 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79713056-40f0-47b7-ab06-626568e9804b None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:54.629254 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ee7e27-4586-4f50-bb77-a5d7818ea736 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:54.686838 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb73a96f-510b-402f-9ffc-017dc0dd5fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:54.687828 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb73a96f-510b-402f-9ffc-017dc0dd5fee None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:54.688294 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb73a96f-510b-402f-9ffc-017dc0dd5fee None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:54.688783 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb73a96f-510b-402f-9ffc-017dc0dd5fee None admin] PATH_INFO: `/v3/services` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:54.690056 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb73a96f-510b-402f-9ffc-017dc0dd5fee None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:54.690618 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb73a96f-510b-402f-9ffc-017dc0dd5fee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:54.693103 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb73a96f-510b-402f-9ffc-017dc0dd5fee None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:54.704955 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79713056-40f0-47b7-ab06-626568e9804b None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:54.706110 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 426/858] 10.222.0.42 () {56 vars in 1126 bytes} [Wed Jun 22 08:35:54 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:54.755929 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda6bf7-b924-4416-9873-2fed846ce468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:54.756781 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda6bf7-b924-4416-9873-2fed846ce468 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:54.757066 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda6bf7-b924-4416-9873-2fed846ce468 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:54.757344 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda6bf7-b924-4416-9873-2fed846ce468 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:54.771037 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda6bf7-b924-4416-9873-2fed846ce468 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:35:54.778942 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-acda6bf7-b924-4416-9873-2fed846ce468 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:35:54.778942 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:54.778942 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:54.778942 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:54.778942 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:54.778942 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:54.778942 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:54.778942 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:54.778942 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:54.778942 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:54.778942 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:54.778942 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:54.778942 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:35:54.778942 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:35:54.778942 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:35:54.778942 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:35:54.779941 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:35:54.779941 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:35:54.779941 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:35:54.779941 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:35:54.779941 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:54.779941 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:54.779941 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:54.779941 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:54.779941 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:54.779941 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:54.779941 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:54.779941 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:54.779941 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:54.779941 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:54.779941 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:54.779941 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:54.780996 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:54.780996 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:54.780996 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:54.780996 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:54.780996 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:35:54.780996 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:35:54.780996 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:35:54.780996 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:35:54.780996 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:35:54.780996 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:35:54.780996 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:35:54.780996 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:54.780996 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 433/859] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Jun 22 08:35:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:35:54.788975 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb73a96f-510b-402f-9ffc-017dc0dd5fee None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:54.883268 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:54.931905 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb73a96f-510b-402f-9ffc-017dc0dd5fee None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:54.969931 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf894e2-f89f-4ce2-952f-8af9a541cc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:54.970292 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf894e2-f89f-4ce2-952f-8af9a541cc38 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:54.970537 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf894e2-f89f-4ce2-952f-8af9a541cc38 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:54.970818 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf894e2-f89f-4ce2-952f-8af9a541cc38 None admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:54.971581 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf894e2-f89f-4ce2-952f-8af9a541cc38 None admin] RBAC: Adding query filter params (name=service) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:54.971894 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf894e2-f89f-4ce2-952f-8af9a541cc38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:54.973276 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf894e2-f89f-4ce2-952f-8af9a541cc38 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:54.985348 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 427/860] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Jun 22 08:35:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:54.990636 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda6bf7-b924-4416-9873-2fed846ce468 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:55.038793 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:55.109532 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda6bf7-b924-4416-9873-2fed846ce468 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:55.162945 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e509eb9c-3f56-4a4a-8fc2-0d4b42028a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:55.163943 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e509eb9c-3f56-4a4a-8fc2-0d4b42028a83 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:55.164409 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e509eb9c-3f56-4a4a-8fc2-0d4b42028a83 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:55.164907 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e509eb9c-3f56-4a4a-8fc2-0d4b42028a83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:55.184121 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e509eb9c-3f56-4a4a-8fc2-0d4b42028a83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:55.186838 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e509eb9c-3f56-4a4a-8fc2-0d4b42028a83 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:55.217023 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-e509eb9c-3f56-4a4a-8fc2-0d4b42028a83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:55.217023 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:55.217023 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:55.217023 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:55.217023 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:55.217023 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:55.217023 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:55.217023 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:55.217023 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:55.217023 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:55.217023 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:55.217023 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:55.217023 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:35:55.217023 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:35:55.217023 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:35:55.218065 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:35:55.218065 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:55.218065 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:55.218065 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:55.218065 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:55.218065 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:55.218065 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:55.218065 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:55.218065 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:55.218065 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:55.218065 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:55.218065 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:55.218065 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:55.218065 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:55.218065 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:55.218065 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:55.218065 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:55.219076 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:35:55.219076 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:35:55.219076 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:55.219076 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:55.222162 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 434/861] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:35:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:35:55.225895 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf894e2-f89f-4ce2-952f-8af9a541cc38 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:55.348802 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf894e2-f89f-4ce2-952f-8af9a541cc38 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:55.370220 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:55.385695 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897ce11-d4b4-4369-a7b1-6423e6972f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:55.386451 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897ce11-d4b4-4369-a7b1-6423e6972f6e None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:55.386738 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897ce11-d4b4-4369-a7b1-6423e6972f6e None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:55.387019 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897ce11-d4b4-4369-a7b1-6423e6972f6e None admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:55.387755 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7897ce11-d4b4-4369-a7b1-6423e6972f6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:55.388066 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7897ce11-d4b4-4369-a7b1-6423e6972f6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:55.389442 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7897ce11-d4b4-4369-a7b1-6423e6972f6e None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:55.403239 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 428/862] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:35:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:55.412650 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e509eb9c-3f56-4a4a-8fc2-0d4b42028a83 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:55.527135 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:55.536429 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e509eb9c-3f56-4a4a-8fc2-0d4b42028a83 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:55.576744 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a100f43-bda4-4349-b90c-74e7788c7e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:55.577576 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a100f43-bda4-4349-b90c-74e7788c7e11 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:55.577859 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a100f43-bda4-4349-b90c-74e7788c7e11 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:55.578773 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a100f43-bda4-4349-b90c-74e7788c7e11 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:55.587136 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a100f43-bda4-4349-b90c-74e7788c7e11 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:55.588594 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a100f43-bda4-4349-b90c-74e7788c7e11 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:55.604280 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-0a100f43-bda4-4349-b90c-74e7788c7e11 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 08:35:55.604280 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:55.604280 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:55.604280 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:55.604280 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:55.604280 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:55.604280 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:55.604280 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:55.604280 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:55.604280 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:55.604280 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:55.604280 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:55.604280 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:35:55.604280 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:35:55.604280 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:35:55.604280 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:35:55.605280 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:55.605280 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:55.605280 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:35:55.605280 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:35:55.605280 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:35:55.605280 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:35:55.605280 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:55.605280 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:55.605280 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:55.605280 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:55.605280 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:55.605280 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:55.605280 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:55.605280 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:55.605280 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:55.605280 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:55.605280 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:55.605280 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:55.606256 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:55.606256 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:55.606256 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:35:55.606256 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:35:55.606256 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:35:55.606256 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:35:55.606256 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:35:55.606256 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:35:55.606256 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 08:35:55.606256 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:55.606256 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 435/863] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Jun 22 08:35:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:55.613389 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897ce11-d4b4-4369-a7b1-6423e6972f6e None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:55.742514 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897ce11-d4b4-4369-a7b1-6423e6972f6e None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:55.778346 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc296aa-0146-46b4-90d1-c27a112058f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:55.778943 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc296aa-0146-46b4-90d1-c27a112058f8 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:55.779233 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc296aa-0146-46b4-90d1-c27a112058f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:55.779513 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc296aa-0146-46b4-90d1-c27a112058f8 None admin] PATH_INFO: `/v3/users` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:55.780378 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc296aa-0146-46b4-90d1-c27a112058f8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:55.780687 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc296aa-0146-46b4-90d1-c27a112058f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:55.782707 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc296aa-0146-46b4-90d1-c27a112058f8 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:55.802704 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 429/864] 10.222.0.42 () {56 vars in 1149 bytes} [Wed Jun 22 08:35:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:55.808357 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a100f43-bda4-4349-b90c-74e7788c7e11 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:55.831798 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04745bb5-203a-49f5-b88e-189481163794 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:55.832128 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04745bb5-203a-49f5-b88e-189481163794 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:55.832381 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04745bb5-203a-49f5-b88e-189481163794 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:55.834031 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 430/865] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:35:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:35:55.839289 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da42b6-59a2-4cef-a3bc-52d3dee75176 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:55.839576 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da42b6-59a2-4cef-a3bc-52d3dee75176 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:55.839854 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da42b6-59a2-4cef-a3bc-52d3dee75176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:55.860809 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-81da42b6-59a2-4cef-a3bc-52d3dee75176 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:35:55.862050 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-81da42b6-59a2-4cef-a3bc-52d3dee75176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:35:55.911312 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:55.936068 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a100f43-bda4-4349-b90c-74e7788c7e11 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:55.965734 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 431/866] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:35:55 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 08:35:55.987503 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b81bb-df51-4858-929e-7e47eaeffdb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:55.988607 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b81bb-df51-4858-929e-7e47eaeffdb0 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:55.990008 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da42b6-59a2-4cef-a3bc-52d3dee75176 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:55.992533 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b81bb-df51-4858-929e-7e47eaeffdb0 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:55.992879 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b81bb-df51-4858-929e-7e47eaeffdb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:56.021639 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:56.086960 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b81bb-df51-4858-929e-7e47eaeffdb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:56.089754 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b81bb-df51-4858-929e-7e47eaeffdb0 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:56.135838 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da42b6-59a2-4cef-a3bc-52d3dee75176 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:56.182533 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17044946-d716-4eb4-b756-9988f82b8b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:56.183619 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17044946-d716-4eb4-b756-9988f82b8b45 None admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:56.184125 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17044946-d716-4eb4-b756-9988f82b8b45 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:56.184619 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17044946-d716-4eb4-b756-9988f82b8b45 None admin] PATH_INFO: `/v3/services` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:56.185597 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17044946-d716-4eb4-b756-9988f82b8b45 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:56.187255 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17044946-d716-4eb4-b756-9988f82b8b45 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:56.214668 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 432/868] 10.222.0.42 () {60 vars in 1141 bytes} [Wed Jun 22 08:35:55 2022] POST /identity/v3/services => generated 251 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 08:35:56.217148 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 436/868] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Jun 22 08:35:55 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 08:35:56.223460 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17044946-d716-4eb4-b756-9988f82b8b45 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:56.261219 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:56.365025 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17044946-d716-4eb4-b756-9988f82b8b45 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:56.409153 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ca258-b79f-4e1e-808a-baa59fcf986c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:56.409986 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ca258-b79f-4e1e-808a-baa59fcf986c None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:56.410342 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ca258-b79f-4e1e-808a-baa59fcf986c None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:56.410623 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ca258-b79f-4e1e-808a-baa59fcf986c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:56.427427 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ca258-b79f-4e1e-808a-baa59fcf986c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:56.429000 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ca258-b79f-4e1e-808a-baa59fcf986c None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:56.450600 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-c08ca258-b79f-4e1e-808a-baa59fcf986c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:56.450600 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:56.450600 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:56.450600 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:56.450600 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:56.450600 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:56.450600 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:56.450600 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:56.450600 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:56.450600 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:56.450600 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:56.450600 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:56.450600 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:35:56.450600 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:35:56.450600 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:35:56.451573 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:35:56.451573 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:56.451573 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:56.451573 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:56.451573 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:56.451573 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:56.451573 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:56.451573 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:56.451573 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:56.451573 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:56.451573 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:56.451573 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:56.451573 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:56.451573 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:56.451573 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:56.451573 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:56.451573 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:56.452442 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:35:56.452442 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:35:56.452442 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:35:56.452442 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:56.452442 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 433/869] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:35:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:56.458378 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b81bb-df51-4858-929e-7e47eaeffdb0 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:56.527197 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:56.580618 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b81bb-df51-4858-929e-7e47eaeffdb0 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:56.617606 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5845808b-a4d4-476a-9c94-b700024def68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:56.618221 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845808b-a4d4-476a-9c94-b700024def68 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:56.618506 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845808b-a4d4-476a-9c94-b700024def68 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:56.618779 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845808b-a4d4-476a-9c94-b700024def68 None admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:56.619508 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5845808b-a4d4-476a-9c94-b700024def68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:56.619815 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5845808b-a4d4-476a-9c94-b700024def68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:56.621185 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5845808b-a4d4-476a-9c94-b700024def68 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:56.633696 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 437/870] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:35:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:56.639138 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ca258-b79f-4e1e-808a-baa59fcf986c None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:56.728361 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:56.750716 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ca258-b79f-4e1e-808a-baa59fcf986c None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:56.792918 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b6131-b4a5-4fbf-8cfb-78f23d4da9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:56.793724 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b6131-b4a5-4fbf-8cfb-78f23d4da9e7 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:56.794007 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b6131-b4a5-4fbf-8cfb-78f23d4da9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:56.794311 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b6131-b4a5-4fbf-8cfb-78f23d4da9e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:56.801893 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6b6131-b4a5-4fbf-8cfb-78f23d4da9e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:56.803389 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6b6131-b4a5-4fbf-8cfb-78f23d4da9e7 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:56.818404 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-4e6b6131-b4a5-4fbf-8cfb-78f23d4da9e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:35:56.818404 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:56.818404 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:56.818404 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:56.818404 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:56.818404 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:56.818404 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:56.818404 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:56.818404 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:56.818404 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:56.818404 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:56.818404 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:56.818404 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:35:56.818404 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:35:56.818404 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:35:56.819381 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:35:56.819381 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:56.819381 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:56.819381 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:56.819381 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:56.819381 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:56.819381 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:56.819381 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:56.819381 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:56.819381 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:56.819381 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:56.819381 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:56.819381 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:56.819381 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:56.819381 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:56.819381 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:56.819381 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:56.820864 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:35:56.820864 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:35:56.820864 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:35:56.820864 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:35:56.820864 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:35:56.820864 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:35:56.820864 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:35:56.820864 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:56.820864 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 434/871] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Jun 22 08:35:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:35:56.825359 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5845808b-a4d4-476a-9c94-b700024def68 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:56.934532 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5845808b-a4d4-476a-9c94-b700024def68 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:56.949409 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:56.967258 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51480334-03d5-4c36-bef7-70bc021e4764 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:56.967595 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51480334-03d5-4c36-bef7-70bc021e4764 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:56.967825 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51480334-03d5-4c36-bef7-70bc021e4764 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:56.970697 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 435/872] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:35:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:35:56.975550 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3b8ba-0f5f-4feb-87a7-f3eeb989810d None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:56.975840 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3b8ba-0f5f-4feb-87a7-f3eeb989810d None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:56.976120 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3b8ba-0f5f-4feb-87a7-f3eeb989810d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:56.978912 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f53bad-c204-44e4-a702-0611389d703d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:56.979837 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f53bad-c204-44e4-a702-0611389d703d None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:56.980404 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f53bad-c204-44e4-a702-0611389d703d None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:56.980865 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f53bad-c204-44e4-a702-0611389d703d None admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:56.981988 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f53bad-c204-44e4-a702-0611389d703d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:56.982511 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f53bad-c204-44e4-a702-0611389d703d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:56.984206 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f53bad-c204-44e4-a702-0611389d703d None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:56.995582 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-36e3b8ba-0f5f-4feb-87a7-f3eeb989810d None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:35:56.997100 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-36e3b8ba-0f5f-4feb-87a7-f3eeb989810d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:35:57.000529 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 438/873] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Jun 22 08:35:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:57.001784 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd39c07-ca5f-462e-877b-06fd5df5d59d None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:57.002049 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd39c07-ca5f-462e-877b-06fd5df5d59d None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:57.002350 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd39c07-ca5f-462e-877b-06fd5df5d59d None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:57.003893 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 439/874] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:35:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:35:57.008487 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd39c07-ca5f-462e-877b-06fd5df5d59d None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:57.090100 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 436/875] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:35:56 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:35:57.090100 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6ae80-eb46-4b98-a7c6-e48c59c7695f None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:57.090100 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6ae80-eb46-4b98-a7c6-e48c59c7695f None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:57.090100 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6ae80-eb46-4b98-a7c6-e48c59c7695f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:57.110925 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-3ac6ae80-eb46-4b98-a7c6-e48c59c7695f None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:35:57.112137 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-3ac6ae80-eb46-4b98-a7c6-e48c59c7695f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:35:57.115792 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd39c07-ca5f-462e-877b-06fd5df5d59d None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:57.154365 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22965b8a-de90-4188-8aac-47373bf7fb0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:57.155020 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22965b8a-de90-4188-8aac-47373bf7fb0c None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:57.155538 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22965b8a-de90-4188-8aac-47373bf7fb0c None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:57.155659 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22965b8a-de90-4188-8aac-47373bf7fb0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:57.156942 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22965b8a-de90-4188-8aac-47373bf7fb0c None admin] RBAC: Adding query filter params (role.id=e67c237283fd404d9a2bdf1333109696, scope.project.id=e1f161193cb440fa8c4a9d23820a5c28, user.id=2bf91272d78b4e8f854c760622465af9) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:57.157258 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22965b8a-de90-4188-8aac-47373bf7fb0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:57.158719 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22965b8a-de90-4188-8aac-47373bf7fb0c None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:57.174123 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 440/876] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Jun 22 08:35:57 2022] GET /identity/v3/role_assignments?user.id=2bf91272d78b4e8f854c760622465af9&scope.project.id=e1f161193cb440fa8c4a9d23820a5c28&role.id=e67c237283fd404d9a2bdf1333109696 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:57.174123 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22965b8a-de90-4188-8aac-47373bf7fb0c None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:57.195266 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:57.206139 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 437/877] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:35:57 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:35:57.230343 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac6ae80-eb46-4b98-a7c6-e48c59c7695f None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:57.235145 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:57.319634 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22965b8a-de90-4188-8aac-47373bf7fb0c None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:57.359277 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a1dcd-f472-4e64-ba05-02891dd15879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:57.360420 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a1dcd-f472-4e64-ba05-02891dd15879 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:57.360420 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a1dcd-f472-4e64-ba05-02891dd15879 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:57.360608 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a1dcd-f472-4e64-ba05-02891dd15879 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:57.362367 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4a1dcd-f472-4e64-ba05-02891dd15879 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:57.362673 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4a1dcd-f472-4e64-ba05-02891dd15879 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:57.373245 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac6ae80-eb46-4b98-a7c6-e48c59c7695f None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:57.379275 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-9a4a1dcd-f472-4e64-ba05-02891dd15879 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 08:35:57.379275 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:57.379275 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:35:57.379275 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:35:57.379275 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:35:57.379275 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:35:57.379275 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:35:57.379275 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:35:57.379275 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 08:35:57.379275 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:57.379275 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:35:57.379275 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:57.379275 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:57.379275 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:57.379275 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:57.379275 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:57.379275 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:57.380303 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:57.380303 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:57.380303 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:57.380303 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:57.380303 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:57.380303 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:57.380303 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:35:57.380303 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:35:57.380303 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:35:57.380303 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:35:57.380303 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:57.380303 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:57.380303 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:57.380303 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:57.380303 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:57.380303 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:57.381159 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:57.381159 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:57.381159 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:57.381159 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:57.381159 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:57.381159 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:57.381159 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:57.381159 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:57.381159 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:57.381159 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:57.381159 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:35:57.381159 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:35:57.381159 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 08:35:57.381159 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:57.385823 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 441/878] 10.222.0.42 () {56 vars in 1126 bytes} [Wed Jun 22 08:35:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:57.386779 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a1dcd-f472-4e64-ba05-02891dd15879 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:57.418350 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af0ca20-d276-43cb-aeb2-7715678675b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:57.419302 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af0ca20-d276-43cb-aeb2-7715678675b5 None admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:57.419742 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af0ca20-d276-43cb-aeb2-7715678675b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:57.420172 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af0ca20-d276-43cb-aeb2-7715678675b5 None admin] PATH_INFO: `/v3/services` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:57.421083 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af0ca20-d276-43cb-aeb2-7715678675b5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:57.423103 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af0ca20-d276-43cb-aeb2-7715678675b5 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:57.440435 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 438/879] 10.222.0.42 () {60 vars in 1141 bytes} [Wed Jun 22 08:35:57 2022] POST /identity/v3/services => generated 269 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 08:35:57.519928 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a1dcd-f472-4e64-ba05-02891dd15879 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:57.521755 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:57.575368 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80c723-5112-4c6a-9463-b690cb942080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:57.580948 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80c723-5112-4c6a-9463-b690cb942080 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:57.580948 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80c723-5112-4c6a-9463-b690cb942080 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:57.580948 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80c723-5112-4c6a-9463-b690cb942080 None admin] PATH_INFO: `/v3/services` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:57.580948 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f80c723-5112-4c6a-9463-b690cb942080 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:57.580948 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f80c723-5112-4c6a-9463-b690cb942080 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:57.580948 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f80c723-5112-4c6a-9463-b690cb942080 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:57.590107 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 442/880] 10.222.0.42 () {56 vars in 1122 bytes} [Wed Jun 22 08:35:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:57.593153 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af0ca20-d276-43cb-aeb2-7715678675b5 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:57.664116 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:57.713020 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af0ca20-d276-43cb-aeb2-7715678675b5 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:57.748939 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38839b-c468-40fc-aa0a-12c453944bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:57.749617 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38839b-c468-40fc-aa0a-12c453944bb8 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:57.749950 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38839b-c468-40fc-aa0a-12c453944bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:57.750252 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38839b-c468-40fc-aa0a-12c453944bb8 None admin] PATH_INFO: `/v3/services` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:57.750968 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b38839b-c468-40fc-aa0a-12c453944bb8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:57.751508 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b38839b-c468-40fc-aa0a-12c453944bb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:57.752632 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b38839b-c468-40fc-aa0a-12c453944bb8 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:57.757899 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 439/881] 10.222.0.42 () {56 vars in 1122 bytes} [Wed Jun 22 08:35:57 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:58.407816 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081cd8f-6527-4215-8190-736daf48e67f None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:58.408428 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081cd8f-6527-4215-8190-736daf48e67f None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:58.408428 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081cd8f-6527-4215-8190-736daf48e67f None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:58.410119 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 443/882] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:35:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:35:58.415653 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286c488-7d65-422c-b23d-e27bf6ec2c8d None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:58.415947 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286c488-7d65-422c-b23d-e27bf6ec2c8d None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:58.416221 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286c488-7d65-422c-b23d-e27bf6ec2c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:58.433441 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-0286c488-7d65-422c-b23d-e27bf6ec2c8d None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:35:58.434648 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-0286c488-7d65-422c-b23d-e27bf6ec2c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:35:58.509379 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 440/883] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:35:58 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 08:35:58.532956 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a081cd8f-6527-4215-8190-736daf48e67f None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:58.640291 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a081cd8f-6527-4215-8190-736daf48e67f None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:58.678262 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3dc0f7-3879-4f39-83ec-5d12325a3717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:58.679063 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3dc0f7-3879-4f39-83ec-5d12325a3717 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:58.679346 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3dc0f7-3879-4f39-83ec-5d12325a3717 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:58.679618 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3dc0f7-3879-4f39-83ec-5d12325a3717 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:58.680269 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3dc0f7-3879-4f39-83ec-5d12325a3717 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:58.681634 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3dc0f7-3879-4f39-83ec-5d12325a3717 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:58.694203 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-0c3dc0f7-3879-4f39-83ec-5d12325a3717 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 08:35:58.694203 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:58.694203 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:35:58.694203 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:35:58.694203 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:35:58.694203 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:35:58.694203 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:35:58.694203 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:35:58.694203 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 08:35:58.694203 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:58.694203 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:35:58.694203 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:58.694203 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:58.694203 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:58.694203 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:58.694203 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:58.694203 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:58.695189 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:58.695189 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:58.695189 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:58.695189 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:58.695189 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:58.695189 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:58.695189 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:35:58.695189 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:35:58.695189 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:35:58.695189 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:35:58.695189 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:58.695189 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:58.695189 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:58.695189 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:58.695189 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:58.695189 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:58.696442 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:58.696442 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:58.696442 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:58.696442 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:58.696442 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:58.696442 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:58.696442 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:58.696442 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:58.696442 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:58.696442 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:58.696442 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:35:58.696442 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:35:58.696442 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 08:35:58.696442 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:58.696442 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 444/884] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Jun 22 08:35:58 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:35:58.701566 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0286c488-7d65-422c-b23d-e27bf6ec2c8d None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:58.757112 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:58.826857 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0286c488-7d65-422c-b23d-e27bf6ec2c8d None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:58.863172 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaa7dbc-fd64-43ea-9e37-e6a88919e8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:58.864200 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa7dbc-fd64-43ea-9e37-e6a88919e8e0 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:58.864707 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa7dbc-fd64-43ea-9e37-e6a88919e8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:58.865190 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa7dbc-fd64-43ea-9e37-e6a88919e8e0 None admin] PATH_INFO: `/v3/services` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:58.866131 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaa7dbc-fd64-43ea-9e37-e6a88919e8e0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:58.866661 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaa7dbc-fd64-43ea-9e37-e6a88919e8e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:58.868226 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaa7dbc-fd64-43ea-9e37-e6a88919e8e0 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:58.877826 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 441/885] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Jun 22 08:35:58 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:58.879467 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3dc0f7-3879-4f39-83ec-5d12325a3717 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:58.909246 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:58.990722 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3dc0f7-3879-4f39-83ec-5d12325a3717 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:59.025678 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18761392-30b0-404e-b19d-b2f8b8cdd89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:59.026373 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18761392-30b0-404e-b19d-b2f8b8cdd89b None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:59.026658 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18761392-30b0-404e-b19d-b2f8b8cdd89b None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:59.026936 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18761392-30b0-404e-b19d-b2f8b8cdd89b None admin] PATH_INFO: `/v3/services` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:59.027645 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18761392-30b0-404e-b19d-b2f8b8cdd89b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:59.027952 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18761392-30b0-404e-b19d-b2f8b8cdd89b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:59.029311 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18761392-30b0-404e-b19d-b2f8b8cdd89b None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:59.035411 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 445/886] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Jun 22 08:35:58 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:59.041288 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaa7dbc-fd64-43ea-9e37-e6a88919e8e0 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:59.146521 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaa7dbc-fd64-43ea-9e37-e6a88919e8e0 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:59.162449 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:59.183579 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274f2ff7-3c27-4358-a00b-e3b01fbf36ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:59.184620 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f2ff7-3c27-4358-a00b-e3b01fbf36ce None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:59.185135 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f2ff7-3c27-4358-a00b-e3b01fbf36ce None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:59.185629 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f2ff7-3c27-4358-a00b-e3b01fbf36ce None admin] PATH_INFO: `/v3/endpoints` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:59.186683 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274f2ff7-3c27-4358-a00b-e3b01fbf36ce None admin] RBAC: Adding query filter params (interface=public, service_id=2d62170d6f0741d897fd0759adb29a83, region_id=RegionOne) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:35:59.187209 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274f2ff7-3c27-4358-a00b-e3b01fbf36ce None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:59.188836 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274f2ff7-3c27-4358-a00b-e3b01fbf36ce None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:59.201440 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 442/887] 10.222.0.42 () {56 vars in 1251 bytes} [Wed Jun 22 08:35:59 2022] GET /identity/v3/endpoints?service_id=2d62170d6f0741d897fd0759adb29a83&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:35:59.203650 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18761392-30b0-404e-b19d-b2f8b8cdd89b None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:59.307719 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18761392-30b0-404e-b19d-b2f8b8cdd89b None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:59.310588 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:59.343565 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d297c208-2ce6-4463-9fca-dd020620e335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:59.344972 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d297c208-2ce6-4463-9fca-dd020620e335 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:59.345438 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d297c208-2ce6-4463-9fca-dd020620e335 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:59.345879 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d297c208-2ce6-4463-9fca-dd020620e335 None admin] PATH_INFO: `/v3/services` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:59.346812 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d297c208-2ce6-4463-9fca-dd020620e335 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:59.348408 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d297c208-2ce6-4463-9fca-dd020620e335 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:59.358229 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 446/888] 10.222.0.42 () {56 vars in 1087 bytes} [Wed Jun 22 08:35:59 2022] GET /identity/v3/services => generated 1268 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:35:59.541080 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea4017-b5b3-4f9e-9021-30161314482e None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:59.541424 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea4017-b5b3-4f9e-9021-30161314482e None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:59.541607 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea4017-b5b3-4f9e-9021-30161314482e None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:59.543120 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 443/889] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:35:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:35:59.550117 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c46b3-63e2-493d-a413-f09a1b3b1fb8 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:59.550117 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c46b3-63e2-493d-a413-f09a1b3b1fb8 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:59.550117 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c46b3-63e2-493d-a413-f09a1b3b1fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:59.568304 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-6b1c46b3-63e2-493d-a413-f09a1b3b1fb8 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:35:59.569853 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-6b1c46b3-63e2-493d-a413-f09a1b3b1fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:35:59.629083 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e03be-0ddd-4a14-8140-529499f4925b None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:59.629743 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e03be-0ddd-4a14-8140-529499f4925b None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:59.630284 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e03be-0ddd-4a14-8140-529499f4925b None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:59.632106 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 444/890] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:35:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:35:59.637258 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7f982-55d3-4085-bfee-9196e1ded17f None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:59.637778 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7f982-55d3-4085-bfee-9196e1ded17f None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:59.638319 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7f982-55d3-4085-bfee-9196e1ded17f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:59.642955 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 447/891] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:35:59 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:35:59.656952 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-faf7f982-55d3-4085-bfee-9196e1ded17f None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:35:59.658515 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-faf7f982-55d3-4085-bfee-9196e1ded17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:35:59.667002 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c46b3-63e2-493d-a413-f09a1b3b1fb8 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:59.750127 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 445/892] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:35:59 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 08:35:59.768790 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:59.782531 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf7f982-55d3-4085-bfee-9196e1ded17f None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:59.791774 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c46b3-63e2-493d-a413-f09a1b3b1fb8 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:59.840552 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d0e8e-381b-47e3-bd12-f2f5294552eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:59.841696 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d0e8e-381b-47e3-bd12-f2f5294552eb None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:59.842168 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d0e8e-381b-47e3-bd12-f2f5294552eb None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:59.842568 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d0e8e-381b-47e3-bd12-f2f5294552eb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:59.861797 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004d0e8e-381b-47e3-bd12-f2f5294552eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:35:59.870068 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-004d0e8e-381b-47e3-bd12-f2f5294552eb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 08:35:59.870068 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:59.870068 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:59.870068 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:59.870068 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:59.870068 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:59.870068 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:59.870068 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:59.870068 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:59.870068 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:59.870068 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:59.870068 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:59.870068 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:35:59.870068 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:35:59.870068 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:35:59.870068 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:35:59.871039 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:35:59.871039 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:35:59.871039 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:35:59.871039 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:35:59.871039 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:59.871039 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:59.871039 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:59.871039 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:59.871039 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:59.871039 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:59.871039 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:59.871039 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:59.871039 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:59.871039 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:59.871039 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:59.871039 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:59.871866 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:59.871866 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:59.871866 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:59.871866 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:59.871866 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:35:59.871866 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:35:59.871866 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:35:59.871866 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:35:59.871866 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:35:59.871866 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:35:59.871866 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 08:35:59.871866 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:35:59.876254 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 448/893] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Jun 22 08:35:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:35:59.877179 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d0e8e-381b-47e3-bd12-f2f5294552eb None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:35:59.921213 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf7f982-55d3-4085-bfee-9196e1ded17f None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:59.932004 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:35:59.962566 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a916217-6141-4754-8862-488828ccbaf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:35:59.963383 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a916217-6141-4754-8862-488828ccbaf7 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:59.963670 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a916217-6141-4754-8862-488828ccbaf7 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:59.963952 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a916217-6141-4754-8862-488828ccbaf7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:59.964614 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a916217-6141-4754-8862-488828ccbaf7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:35:59.965980 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a916217-6141-4754-8862-488828ccbaf7 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:35:59.978713 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-6a916217-6141-4754-8862-488828ccbaf7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 08:35:59.978713 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:59.978713 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:35:59.978713 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:35:59.978713 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:35:59.978713 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:35:59.978713 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:35:59.978713 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:35:59.978713 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 08:35:59.978713 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:59.978713 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:35:59.978713 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:59.978713 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:35:59.978713 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:35:59.978713 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:35:59.978713 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:35:59.979646 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:35:59.979646 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:35:59.979646 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:35:59.979646 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:35:59.979646 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:35:59.979646 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:35:59.979646 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:35:59.979646 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:35:59.979646 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:35:59.979646 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:35:59.979646 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:35:59.979646 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:35:59.979646 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:35:59.979646 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:35:59.979646 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:35:59.979646 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:35:59.986391 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:35:59.986391 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:35:59.986391 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:35:59.986391 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:35:59.986391 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:35:59.986391 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:35:59.986391 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:35:59.986391 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:35:59.986391 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:35:59.986391 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:35:59.986391 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:35:59.986391 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:35:59.986391 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:35:59.986391 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 08:35:59.986391 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:35:59.986391 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 446/894] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Jun 22 08:35:59 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:35:59.987218 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289fb46-d22a-4a53-aea1-10121a91fd6d None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:35:59.987218 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289fb46-d22a-4a53-aea1-10121a91fd6d None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:35:59.987218 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289fb46-d22a-4a53-aea1-10121a91fd6d None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:35:59.987894 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 447/895] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:35:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:35:59.988009 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d0e8e-381b-47e3-bd12-f2f5294552eb None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:35:59.988260 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b289fb46-d22a-4a53-aea1-10121a91fd6d None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:00.025019 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb2f3a-14e5-4733-a5fe-165e472008a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:00.025710 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb2f3a-14e5-4733-a5fe-165e472008a1 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:00.026065 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb2f3a-14e5-4733-a5fe-165e472008a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:00.026288 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb2f3a-14e5-4733-a5fe-165e472008a1 None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:00.027034 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefb2f3a-14e5-4733-a5fe-165e472008a1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:00.027942 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefb2f3a-14e5-4733-a5fe-165e472008a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:00.028745 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefb2f3a-14e5-4733-a5fe-165e472008a1 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:00.041856 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 449/896] 10.222.0.42 () {56 vars in 1115 bytes} [Wed Jun 22 08:35:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:36:00.041856 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a462d-5f3a-4bbb-8e73-62f1dd348da0 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:00.041856 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a462d-5f3a-4bbb-8e73-62f1dd348da0 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:00.041856 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a462d-5f3a-4bbb-8e73-62f1dd348da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:00.050975 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:00.057797 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-dd4a462d-5f3a-4bbb-8e73-62f1dd348da0 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:36:00.059090 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-dd4a462d-5f3a-4bbb-8e73-62f1dd348da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:36:00.104493 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b289fb46-d22a-4a53-aea1-10121a91fd6d None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:00.134117 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 450/897] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:36:00 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:36:00.134117 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4a462d-5f3a-4bbb-8e73-62f1dd348da0 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:00.154715 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2bb7a8-ebde-4b4e-948d-670c80028303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:00.155401 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2bb7a8-ebde-4b4e-948d-670c80028303 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:00.155693 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2bb7a8-ebde-4b4e-948d-670c80028303 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:00.156693 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2bb7a8-ebde-4b4e-948d-670c80028303 None admin] PATH_INFO: `/v3/services` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:00.157403 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2bb7a8-ebde-4b4e-948d-670c80028303 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:00.157722 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2bb7a8-ebde-4b4e-948d-670c80028303 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:00.159138 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2bb7a8-ebde-4b4e-948d-670c80028303 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:00.164171 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 448/898] 10.222.0.42 () {56 vars in 1126 bytes} [Wed Jun 22 08:35:59 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:36:00.164933 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2bb7a8-ebde-4b4e-948d-670c80028303 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:00.208030 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:00.240802 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4a462d-5f3a-4bbb-8e73-62f1dd348da0 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:00.284747 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df62c23d-3025-482a-91a0-840aaa804b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:00.285535 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62c23d-3025-482a-91a0-840aaa804b89 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:00.285819 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62c23d-3025-482a-91a0-840aaa804b89 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:00.286120 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62c23d-3025-482a-91a0-840aaa804b89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:00.288212 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2bb7a8-ebde-4b4e-948d-670c80028303 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:00.289160 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:00.299292 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df62c23d-3025-482a-91a0-840aaa804b89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:00.300791 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df62c23d-3025-482a-91a0-840aaa804b89 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:00.320555 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-df62c23d-3025-482a-91a0-840aaa804b89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:36:00.320555 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:36:00.320555 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:36:00.320555 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:36:00.320555 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:36:00.320555 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:36:00.320555 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:36:00.320555 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:36:00.320555 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:36:00.320555 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:36:00.320555 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:36:00.320555 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:36:00.320555 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:36:00.320555 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:36:00.320555 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:36:00.321653 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:36:00.321653 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:36:00.321653 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:36:00.321653 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:36:00.321653 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:36:00.321653 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:36:00.321653 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:36:00.321653 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:36:00.321653 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:36:00.321653 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:36:00.321653 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:36:00.321653 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:36:00.321653 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:36:00.321653 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:36:00.321653 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:36:00.321653 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:36:00.321653 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:36:00.322875 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:36:00.322875 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:36:00.322875 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:36:00.322875 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:36:00.322875 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 451/899] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:36:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:36:00.322875 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df62c23d-3025-482a-91a0-840aaa804b89 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:00.329920 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd084c9b-dc1f-4e2f-9b00-921ec1a6024d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:00.330622 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd084c9b-dc1f-4e2f-9b00-921ec1a6024d None admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:00.330909 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd084c9b-dc1f-4e2f-9b00-921ec1a6024d None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:00.331189 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd084c9b-dc1f-4e2f-9b00-921ec1a6024d None admin] PATH_INFO: `/v3/services` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:00.331915 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd084c9b-dc1f-4e2f-9b00-921ec1a6024d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:00.333279 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd084c9b-dc1f-4e2f-9b00-921ec1a6024d None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:00.347360 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 449/900] 10.222.0.42 () {60 vars in 1141 bytes} [Wed Jun 22 08:36:00 2022] POST /identity/v3/services => generated 241 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:36:00.359192 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd084c9b-dc1f-4e2f-9b00-921ec1a6024d None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:00.441919 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df62c23d-3025-482a-91a0-840aaa804b89 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:00.512202 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b737c5c0-5814-4c3d-a8ae-814978a2c7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:00.513830 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737c5c0-5814-4c3d-a8ae-814978a2c7fd None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:00.514655 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737c5c0-5814-4c3d-a8ae-814978a2c7fd None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:00.515548 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737c5c0-5814-4c3d-a8ae-814978a2c7fd None admin] PATH_INFO: `/v3/services` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:00.517193 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b737c5c0-5814-4c3d-a8ae-814978a2c7fd None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:00.517672 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b737c5c0-5814-4c3d-a8ae-814978a2c7fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:00.521471 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd084c9b-dc1f-4e2f-9b00-921ec1a6024d None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:00.522566 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b737c5c0-5814-4c3d-a8ae-814978a2c7fd None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:00.525388 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:00.533773 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 452/901] 10.222.0.42 () {56 vars in 1126 bytes} [Wed Jun 22 08:36:00 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:36:00.544802 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b737c5c0-5814-4c3d-a8ae-814978a2c7fd None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:00.587402 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d43b3-d197-4eff-ad8b-164d0767a64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:00.588847 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d43b3-d197-4eff-ad8b-164d0767a64b None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:00.589613 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d43b3-d197-4eff-ad8b-164d0767a64b None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:00.590100 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d43b3-d197-4eff-ad8b-164d0767a64b None admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:00.591826 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29d43b3-d197-4eff-ad8b-164d0767a64b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:00.592764 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29d43b3-d197-4eff-ad8b-164d0767a64b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:00.596090 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29d43b3-d197-4eff-ad8b-164d0767a64b None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:00.620231 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 450/902] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:36:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:36:00.626139 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:00.627273 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d43b3-d197-4eff-ad8b-164d0767a64b None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:00.716111 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b737c5c0-5814-4c3d-a8ae-814978a2c7fd None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:00.779341 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61058c06-021d-4e9f-bd38-ff2401a7868f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:00.780451 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61058c06-021d-4e9f-bd38-ff2401a7868f None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:00.780980 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61058c06-021d-4e9f-bd38-ff2401a7868f None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:00.781432 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61058c06-021d-4e9f-bd38-ff2401a7868f None admin] PATH_INFO: `/v3/endpoints` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:00.782909 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61058c06-021d-4e9f-bd38-ff2401a7868f None admin] RBAC: Adding query filter params (interface=public, service_id=5589a52cd862422eac2af81ef65b37fc, region_id=RegionOne) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:00.783391 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61058c06-021d-4e9f-bd38-ff2401a7868f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:00.785353 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61058c06-021d-4e9f-bd38-ff2401a7868f None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:00.802203 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 453/903] 10.222.0.42 () {56 vars in 1251 bytes} [Wed Jun 22 08:36:00 2022] GET /identity/v3/endpoints?service_id=5589a52cd862422eac2af81ef65b37fc&interface=public®ion_id=RegionOne => generated 194 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:36:00.803748 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61058c06-021d-4e9f-bd38-ff2401a7868f None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:00.831584 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d43b3-d197-4eff-ad8b-164d0767a64b None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:00.875528 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6fcda4-2413-4e87-ab88-c4660d55fe56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:00.876305 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6fcda4-2413-4e87-ab88-c4660d55fe56 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:00.876586 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6fcda4-2413-4e87-ab88-c4660d55fe56 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:00.876865 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6fcda4-2413-4e87-ab88-c4660d55fe56 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:00.885658 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6fcda4-2413-4e87-ab88-c4660d55fe56 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:00.887198 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6fcda4-2413-4e87-ab88-c4660d55fe56 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:00.903850 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-9b6fcda4-2413-4e87-ab88-c4660d55fe56 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 08:36:00.903850 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:36:00.903850 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:36:00.903850 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:36:00.903850 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:36:00.903850 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:36:00.903850 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:36:00.903850 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:36:00.903850 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:36:00.903850 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:36:00.903850 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:36:00.903850 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:36:00.903850 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:36:00.903850 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:36:00.903850 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:36:00.903850 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:36:00.904853 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:36:00.904853 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:36:00.904853 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:36:00.904853 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:36:00.904853 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:36:00.904853 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:36:00.904853 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:36:00.904853 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:36:00.904853 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:36:00.904853 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:36:00.904853 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:36:00.904853 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:36:00.904853 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:36:00.904853 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:36:00.904853 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:36:00.904853 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:36:00.904853 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:36:00.904853 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:36:00.905767 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:36:00.905767 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:36:00.905767 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:36:00.905767 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:36:00.905767 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:36:00.905767 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:36:00.905767 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:36:00.905767 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:36:00.905767 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 08:36:00.905767 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:36:00.905767 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 451/904] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Jun 22 08:36:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:36:00.913084 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6fcda4-2413-4e87-ab88-c4660d55fe56 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:00.925436 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61058c06-021d-4e9f-bd38-ff2401a7868f None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:00.930682 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:00.943184 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:00.972369 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da45bae1-f7e9-4dbc-9b01-d054c43287b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:00.973046 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da45bae1-f7e9-4dbc-9b01-d054c43287b3 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:00.973327 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da45bae1-f7e9-4dbc-9b01-d054c43287b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:00.973604 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da45bae1-f7e9-4dbc-9b01-d054c43287b3 None admin] PATH_INFO: `/v3/services` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:00.974443 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da45bae1-f7e9-4dbc-9b01-d054c43287b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:00.975957 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da45bae1-f7e9-4dbc-9b01-d054c43287b3 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:00.990714 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 454/905] 10.222.0.42 () {56 vars in 1087 bytes} [Wed Jun 22 08:36:00 2022] GET /identity/v3/services => generated 1497 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:36:01.042587 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6fcda4-2413-4e87-ab88-c4660d55fe56 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:01.083344 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce41b52-a15e-4feb-93a7-e42c5794ef0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:01.084440 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce41b52-a15e-4feb-93a7-e42c5794ef0e None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:01.084955 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce41b52-a15e-4feb-93a7-e42c5794ef0e None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:01.085434 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce41b52-a15e-4feb-93a7-e42c5794ef0e None admin] PATH_INFO: `/v3/users` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:01.086530 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce41b52-a15e-4feb-93a7-e42c5794ef0e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:01.087054 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce41b52-a15e-4feb-93a7-e42c5794ef0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:01.088728 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce41b52-a15e-4feb-93a7-e42c5794ef0e None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:01.110699 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 452/906] 10.222.0.42 () {56 vars in 1149 bytes} [Wed Jun 22 08:36:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:36:01.116752 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da45bae1-f7e9-4dbc-9b01-d054c43287b3 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:01.228865 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da45bae1-f7e9-4dbc-9b01-d054c43287b3 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:01.270455 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1558db5-b96d-4929-af75-328a9309f0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:01.271127 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1558db5-b96d-4929-af75-328a9309f0a3 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:01.271412 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1558db5-b96d-4929-af75-328a9309f0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:01.271692 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1558db5-b96d-4929-af75-328a9309f0a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:01.321372 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:01.346895 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1558db5-b96d-4929-af75-328a9309f0a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:01.348368 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1558db5-b96d-4929-af75-328a9309f0a3 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:01.454568 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 455/907] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Jun 22 08:36:01 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 08:36:01.460193 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce41b52-a15e-4feb-93a7-e42c5794ef0e None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:01.507976 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b74883-8bf7-4396-9379-b514bb2d4961 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:01.508262 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b74883-8bf7-4396-9379-b514bb2d4961 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:01.508467 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b74883-8bf7-4396-9379-b514bb2d4961 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:01.510160 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 456/908] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:36:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:36:01.515956 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b42321-9610-4ee2-93c4-29471a608be1 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:01.516254 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b42321-9610-4ee2-93c4-29471a608be1 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:01.516535 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b42321-9610-4ee2-93c4-29471a608be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:01.534803 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-14b42321-9610-4ee2-93c4-29471a608be1 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:36:01.536017 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-14b42321-9610-4ee2-93c4-29471a608be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:36:01.544924 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:01.579248 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce41b52-a15e-4feb-93a7-e42c5794ef0e None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:01.618201 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 457/909] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:36:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 08:36:01.621814 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d1b8dd-f3e0-44a6-accd-4d15a347bd13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:01.622719 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d1b8dd-f3e0-44a6-accd-4d15a347bd13 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:01.623080 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d1b8dd-f3e0-44a6-accd-4d15a347bd13 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:01.623432 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d1b8dd-f3e0-44a6-accd-4d15a347bd13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:01.634519 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b42321-9610-4ee2-93c4-29471a608be1 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:01.635113 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d1b8dd-f3e0-44a6-accd-4d15a347bd13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:01.636822 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d1b8dd-f3e0-44a6-accd-4d15a347bd13 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:01.645868 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:01.667854 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-d8d1b8dd-f3e0-44a6-accd-4d15a347bd13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:36:01.667854 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:36:01.667854 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:36:01.667854 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:36:01.667854 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:36:01.667854 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:36:01.667854 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:36:01.667854 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:36:01.667854 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:36:01.667854 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:36:01.667854 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:36:01.667854 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:36:01.667854 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:36:01.667854 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:36:01.667854 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:36:01.669924 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:36:01.669924 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:36:01.669924 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:36:01.669924 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:36:01.669924 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:36:01.669924 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:36:01.669924 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:36:01.669924 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:36:01.669924 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:36:01.669924 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:36:01.669924 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:36:01.669924 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:36:01.669924 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:36:01.669924 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:36:01.669924 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:36:01.669924 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:36:01.669924 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:36:01.672119 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:36:01.672119 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:36:01.672119 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:36:01.672119 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:36:01.672119 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 453/910] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:36:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:36:01.676359 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d1b8dd-f3e0-44a6-accd-4d15a347bd13 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:01.760097 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b42321-9610-4ee2-93c4-29471a608be1 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:01.792455 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d1b8dd-f3e0-44a6-accd-4d15a347bd13 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:01.800405 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c082b2-407d-420d-8ba1-f20f96cdb524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:01.801213 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c082b2-407d-420d-8ba1-f20f96cdb524 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:01.801503 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c082b2-407d-420d-8ba1-f20f96cdb524 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:01.801781 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c082b2-407d-420d-8ba1-f20f96cdb524 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:01.802492 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c082b2-407d-420d-8ba1-f20f96cdb524 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:01.803881 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c082b2-407d-420d-8ba1-f20f96cdb524 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:01.817643 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-a7c082b2-407d-420d-8ba1-f20f96cdb524 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 08:36:01.817643 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:36:01.817643 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:36:01.817643 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:36:01.817643 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:36:01.817643 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:36:01.817643 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:36:01.817643 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:36:01.817643 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 08:36:01.817643 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:36:01.817643 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:36:01.817643 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:36:01.817643 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:36:01.817643 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:36:01.817643 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:36:01.817643 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:36:01.817643 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:36:01.819965 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:36:01.819965 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:36:01.819965 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:36:01.819965 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:36:01.819965 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:36:01.819965 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:36:01.819965 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:36:01.819965 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:36:01.819965 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:36:01.819965 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:36:01.819965 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:36:01.819965 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:36:01.819965 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:36:01.819965 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:36:01.819965 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:36:01.819965 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:36:01.822708 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:36:01.822708 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:36:01.822708 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:36:01.822708 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:36:01.822708 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:36:01.822708 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:36:01.822708 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:36:01.822708 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:36:01.822708 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:36:01.822708 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:36:01.822708 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:36:01.822708 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:36:01.822708 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 08:36:01.822708 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:36:01.824759 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:01.824905 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 458/911] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Jun 22 08:36:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:36:01.834099 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c082b2-407d-420d-8ba1-f20f96cdb524 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:01.834400 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b8dc98-3281-43fe-a5a6-ea6c95317f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:01.834400 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8dc98-3281-43fe-a5a6-ea6c95317f99 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:01.834400 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8dc98-3281-43fe-a5a6-ea6c95317f99 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:01.834400 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8dc98-3281-43fe-a5a6-ea6c95317f99 None admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:01.835324 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b8dc98-3281-43fe-a5a6-ea6c95317f99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:01.835324 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b8dc98-3281-43fe-a5a6-ea6c95317f99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:01.836505 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b8dc98-3281-43fe-a5a6-ea6c95317f99 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:01.853969 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 454/912] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:36:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:36:01.855110 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b8dc98-3281-43fe-a5a6-ea6c95317f99 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:01.902115 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:01.936522 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c082b2-407d-420d-8ba1-f20f96cdb524 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:01.961818 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b8dc98-3281-43fe-a5a6-ea6c95317f99 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:01.980296 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe5d172-7fb2-48ee-9327-9337593a1898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:01.981906 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe5d172-7fb2-48ee-9327-9337593a1898 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:01.982613 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe5d172-7fb2-48ee-9327-9337593a1898 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:01.983285 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe5d172-7fb2-48ee-9327-9337593a1898 None admin] PATH_INFO: `/v3/services` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:01.984265 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe5d172-7fb2-48ee-9327-9337593a1898 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:01.984802 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe5d172-7fb2-48ee-9327-9337593a1898 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:01.986486 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe5d172-7fb2-48ee-9327-9337593a1898 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:01.997251 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 459/913] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Jun 22 08:36:01 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:36:01.998794 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe5d172-7fb2-48ee-9327-9337593a1898 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:02.007089 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa71126-dad5-43ae-8553-7d9940c5c68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:02.007891 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa71126-dad5-43ae-8553-7d9940c5c68b None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:02.008177 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa71126-dad5-43ae-8553-7d9940c5c68b None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:02.008478 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa71126-dad5-43ae-8553-7d9940c5c68b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:02.015898 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa71126-dad5-43ae-8553-7d9940c5c68b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:02.017435 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa71126-dad5-43ae-8553-7d9940c5c68b None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:02.032332 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-dfa71126-dad5-43ae-8553-7d9940c5c68b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:36:02.032332 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:36:02.032332 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:36:02.032332 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:36:02.032332 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:36:02.032332 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:36:02.032332 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:36:02.032332 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:36:02.032332 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:36:02.032332 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:36:02.032332 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:36:02.032332 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:36:02.032332 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:36:02.032332 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:36:02.032332 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:36:02.033309 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:36:02.033309 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:36:02.033309 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:36:02.033309 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:36:02.033309 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:36:02.033309 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:36:02.033309 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:36:02.033309 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:36:02.033309 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:36:02.033309 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:36:02.033309 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:36:02.033309 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:36:02.033309 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:36:02.033309 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:36:02.033309 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:36:02.033309 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:36:02.033309 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:36:02.034655 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:36:02.034655 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:36:02.034655 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:36:02.034655 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:36:02.034655 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:36:02.034655 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:36:02.034655 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:36:02.034655 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:36:02.038578 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 455/914] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Jun 22 08:36:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:36:02.039439 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa71126-dad5-43ae-8553-7d9940c5c68b None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:02.089525 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:02.113145 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe5d172-7fb2-48ee-9327-9337593a1898 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:02.152507 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40442721-d2e8-4c0d-9d1c-2f0a6892360d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:02.153619 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40442721-d2e8-4c0d-9d1c-2f0a6892360d None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:02.153746 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40442721-d2e8-4c0d-9d1c-2f0a6892360d None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:02.154164 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40442721-d2e8-4c0d-9d1c-2f0a6892360d None admin] PATH_INFO: `/v3/services` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:02.154915 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40442721-d2e8-4c0d-9d1c-2f0a6892360d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:02.155234 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40442721-d2e8-4c0d-9d1c-2f0a6892360d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:02.156746 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40442721-d2e8-4c0d-9d1c-2f0a6892360d None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:02.158349 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:02.165615 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa71126-dad5-43ae-8553-7d9940c5c68b None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:02.167516 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 460/915] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Jun 22 08:36:01 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:36:02.168854 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40442721-d2e8-4c0d-9d1c-2f0a6892360d None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:02.206913 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae4f1b5-0334-46cc-acbc-830518c8bcf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:02.207954 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4f1b5-0334-46cc-acbc-830518c8bcf1 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:02.208451 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4f1b5-0334-46cc-acbc-830518c8bcf1 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:02.208953 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4f1b5-0334-46cc-acbc-830518c8bcf1 None admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:02.209965 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae4f1b5-0334-46cc-acbc-830518c8bcf1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:02.210509 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae4f1b5-0334-46cc-acbc-830518c8bcf1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:02.212378 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae4f1b5-0334-46cc-acbc-830518c8bcf1 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:02.227120 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 456/916] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Jun 22 08:36:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:36:02.234701 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae4f1b5-0334-46cc-acbc-830518c8bcf1 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:02.290575 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40442721-d2e8-4c0d-9d1c-2f0a6892360d None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:02.327670 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddcbecb-aba5-4541-899e-0ed05b30db9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:02.328965 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddcbecb-aba5-4541-899e-0ed05b30db9f None admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:02.329174 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddcbecb-aba5-4541-899e-0ed05b30db9f None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:02.329454 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddcbecb-aba5-4541-899e-0ed05b30db9f None admin] PATH_INFO: `/v3/endpoints` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:02.330292 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddcbecb-aba5-4541-899e-0ed05b30db9f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:02.331640 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddcbecb-aba5-4541-899e-0ed05b30db9f None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:02.362290 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 461/917] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Jun 22 08:36:02 2022] POST /identity/v3/endpoints => generated 346 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:36:02.381262 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae4f1b5-0334-46cc-acbc-830518c8bcf1 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:02.383533 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:02.431796 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d642e1c8-88b2-43ab-af1a-6c0261667fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:02.432942 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d642e1c8-88b2-43ab-af1a-6c0261667fdd None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:02.433444 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d642e1c8-88b2-43ab-af1a-6c0261667fdd None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:02.433928 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d642e1c8-88b2-43ab-af1a-6c0261667fdd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:02.435060 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d642e1c8-88b2-43ab-af1a-6c0261667fdd None admin] RBAC: Adding query filter params (role.id=334470a0bef9496daf19b5fe65d90c64, scope.project.id=e1f161193cb440fa8c4a9d23820a5c28, user.id=2bf91272d78b4e8f854c760622465af9) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:02.435625 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d642e1c8-88b2-43ab-af1a-6c0261667fdd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:02.437974 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d642e1c8-88b2-43ab-af1a-6c0261667fdd None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:02.445677 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 457/918] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Jun 22 08:36:02 2022] GET /identity/v3/role_assignments?user.id=2bf91272d78b4e8f854c760622465af9&scope.project.id=e1f161193cb440fa8c4a9d23820a5c28&role.id=334470a0bef9496daf19b5fe65d90c64 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:36:02.782763 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ecb94-0a5d-41be-8b9e-7026a3508afc None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:02.783312 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ecb94-0a5d-41be-8b9e-7026a3508afc None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:02.783736 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ecb94-0a5d-41be-8b9e-7026a3508afc None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:02.786410 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 462/919] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:36:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:36:02.794679 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cba5dc-8b1d-48ce-b013-0951fc03e3a4 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:02.795193 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cba5dc-8b1d-48ce-b013-0951fc03e3a4 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:02.795694 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cba5dc-8b1d-48ce-b013-0951fc03e3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:02.823535 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-07cba5dc-8b1d-48ce-b013-0951fc03e3a4 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:36:02.825572 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-07cba5dc-8b1d-48ce-b013-0951fc03e3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:36:02.919644 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 458/920] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:36:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:36:02.959038 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ecb94-0a5d-41be-8b9e-7026a3508afc None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:03.052234 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:03.111043 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ecb94-0a5d-41be-8b9e-7026a3508afc None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:03.147240 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d61be-3b57-4cbb-ba79-4743770b1962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:03.148064 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d61be-3b57-4cbb-ba79-4743770b1962 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:03.148351 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d61be-3b57-4cbb-ba79-4743770b1962 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:03.148636 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d61be-3b57-4cbb-ba79-4743770b1962 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:03.149302 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4d61be-3b57-4cbb-ba79-4743770b1962 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:03.150720 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4d61be-3b57-4cbb-ba79-4743770b1962 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:03.163223 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-ea4d61be-3b57-4cbb-ba79-4743770b1962 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 08:36:03.163223 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:36:03.163223 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:36:03.163223 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:36:03.163223 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:36:03.163223 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:36:03.163223 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:36:03.163223 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:36:03.163223 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 08:36:03.163223 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:36:03.163223 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:36:03.163223 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:36:03.163223 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:36:03.163223 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:36:03.163223 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:36:03.163223 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:36:03.163223 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:36:03.164255 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:36:03.164255 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:36:03.164255 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:36:03.164255 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:36:03.164255 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:36:03.164255 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:36:03.164255 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:36:03.164255 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:36:03.164255 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:36:03.164255 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:36:03.164255 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:36:03.164255 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:36:03.164255 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:36:03.164255 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:36:03.164255 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:36:03.164255 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:36:03.165111 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:36:03.165111 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:36:03.165111 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:36:03.165111 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:36:03.165111 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:36:03.165111 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:36:03.165111 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:36:03.165111 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:36:03.165111 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:36:03.165111 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:36:03.165111 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:36:03.165111 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:36:03.165111 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 08:36:03.165111 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:36:03.165111 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 463/921] 10.222.0.42 () {56 vars in 1126 bytes} [Wed Jun 22 08:36:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:36:03.174353 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cba5dc-8b1d-48ce-b013-0951fc03e3a4 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:03.318582 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:03.321265 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cba5dc-8b1d-48ce-b013-0951fc03e3a4 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:03.357729 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa6666-18c4-4b14-9b29-fd7fbee9954e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:03.358788 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa6666-18c4-4b14-9b29-fd7fbee9954e None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:03.359313 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa6666-18c4-4b14-9b29-fd7fbee9954e None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:03.359818 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa6666-18c4-4b14-9b29-fd7fbee9954e None admin] PATH_INFO: `/v3/services` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:03.360749 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aa6666-18c4-4b14-9b29-fd7fbee9954e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:03.361276 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aa6666-18c4-4b14-9b29-fd7fbee9954e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:03.362872 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aa6666-18c4-4b14-9b29-fd7fbee9954e None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:03.368754 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 459/922] 10.222.0.42 () {56 vars in 1122 bytes} [Wed Jun 22 08:36:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:36:03.374562 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d61be-3b57-4cbb-ba79-4743770b1962 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:03.412706 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18b5b4-1efe-46f1-9e2a-7e81143d8fbf None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:03.413007 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18b5b4-1efe-46f1-9e2a-7e81143d8fbf None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:03.413278 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18b5b4-1efe-46f1-9e2a-7e81143d8fbf None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:03.414987 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 460/923] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:36:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:36:03.420155 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfab0ed-6bcd-4f51-878c-7ccc68e44856 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:03.420449 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfab0ed-6bcd-4f51-878c-7ccc68e44856 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:03.420735 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfab0ed-6bcd-4f51-878c-7ccc68e44856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:03.444006 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-2cfab0ed-6bcd-4f51-878c-7ccc68e44856 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:36:03.445873 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-2cfab0ed-6bcd-4f51-878c-7ccc68e44856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:36:03.482925 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d61be-3b57-4cbb-ba79-4743770b1962 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:03.522125 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:03.530071 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483a6440-b98c-4cb1-b8d9-e7aba32b1a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:03.531381 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a6440-b98c-4cb1-b8d9-e7aba32b1a14 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:03.531671 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a6440-b98c-4cb1-b8d9-e7aba32b1a14 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:03.531955 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a6440-b98c-4cb1-b8d9-e7aba32b1a14 None admin] PATH_INFO: `/v3/services` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:03.532773 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483a6440-b98c-4cb1-b8d9-e7aba32b1a14 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:03.533093 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483a6440-b98c-4cb1-b8d9-e7aba32b1a14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:03.534764 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483a6440-b98c-4cb1-b8d9-e7aba32b1a14 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:03.537179 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 461/924] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:36:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 08:36:03.549328 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 464/925] 10.222.0.42 () {56 vars in 1122 bytes} [Wed Jun 22 08:36:03 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:36:03.559257 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfab0ed-6bcd-4f51-878c-7ccc68e44856 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:03.561574 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483a6440-b98c-4cb1-b8d9-e7aba32b1a14 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:03.674991 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:03.687226 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483a6440-b98c-4cb1-b8d9-e7aba32b1a14 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:03.692751 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfab0ed-6bcd-4f51-878c-7ccc68e44856 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:03.730557 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc99c2bf-a3c4-4734-b97f-16db5e58fc8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:03.731520 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99c2bf-a3c4-4734-b97f-16db5e58fc8b None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:03.731948 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99c2bf-a3c4-4734-b97f-16db5e58fc8b None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:03.732411 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99c2bf-a3c4-4734-b97f-16db5e58fc8b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:03.733137 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc99c2bf-a3c4-4734-b97f-16db5e58fc8b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:03.735286 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc99c2bf-a3c4-4734-b97f-16db5e58fc8b None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:03.737802 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a4f203-480e-4584-adad-c2d2d97f2252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:03.739013 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4f203-480e-4584-adad-c2d2d97f2252 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:03.739687 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4f203-480e-4584-adad-c2d2d97f2252 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:03.740126 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4f203-480e-4584-adad-c2d2d97f2252 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:03.741059 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a4f203-480e-4584-adad-c2d2d97f2252 None admin] RBAC: Adding query filter params (interface=public, service_id=7568dcfa3c48492295687d7121598259, region_id=RegionOne) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:03.741527 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a4f203-480e-4584-adad-c2d2d97f2252 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:03.743033 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a4f203-480e-4584-adad-c2d2d97f2252 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:03.748769 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-bc99c2bf-a3c4-4734-b97f-16db5e58fc8b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 08:36:03.748769 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:36:03.748769 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:36:03.748769 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:36:03.748769 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:36:03.748769 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:36:03.748769 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:36:03.748769 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:36:03.748769 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 08:36:03.748769 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:36:03.748769 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:36:03.748769 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:36:03.748769 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:36:03.748769 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:36:03.748769 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:36:03.748769 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:36:03.749881 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:36:03.749881 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:36:03.749881 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:36:03.749881 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:36:03.749881 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:36:03.749881 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:36:03.749881 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:36:03.749881 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:36:03.749881 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:36:03.749881 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:36:03.749881 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:36:03.749881 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:36:03.749881 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:36:03.749881 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:36:03.749881 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:36:03.749881 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:36:03.750814 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:36:03.750814 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:36:03.750814 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:36:03.750814 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:36:03.750814 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:36:03.750814 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:36:03.750814 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:36:03.750814 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:36:03.750814 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:36:03.750814 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:36:03.750814 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:36:03.750814 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:36:03.750814 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:36:03.750814 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 08:36:03.750814 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:36:03.751567 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 462/926] 10.222.0.42 () {56 vars in 1251 bytes} [Wed Jun 22 08:36:03 2022] GET /identity/v3/endpoints?service_id=7568dcfa3c48492295687d7121598259&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:36:03.753826 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a4f203-480e-4584-adad-c2d2d97f2252 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:03.756371 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 465/927] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Jun 22 08:36:03 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:36:03.757579 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc99c2bf-a3c4-4734-b97f-16db5e58fc8b None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:03.817666 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:03.875669 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc99c2bf-a3c4-4734-b97f-16db5e58fc8b None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:03.888100 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a4f203-480e-4584-adad-c2d2d97f2252 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:03.911577 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570bcb8-47ed-4b08-b0a3-bdfbddbf4c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:03.912236 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570bcb8-47ed-4b08-b0a3-bdfbddbf4c2b None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:03.912524 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570bcb8-47ed-4b08-b0a3-bdfbddbf4c2b None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:03.912801 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570bcb8-47ed-4b08-b0a3-bdfbddbf4c2b None admin] PATH_INFO: `/v3/services` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:03.913511 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3570bcb8-47ed-4b08-b0a3-bdfbddbf4c2b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:03.913823 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3570bcb8-47ed-4b08-b0a3-bdfbddbf4c2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:03.915247 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3570bcb8-47ed-4b08-b0a3-bdfbddbf4c2b None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:03.925513 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 466/928] 10.222.0.42 () {56 vars in 1126 bytes} [Wed Jun 22 08:36:03 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:36:03.926686 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570bcb8-47ed-4b08-b0a3-bdfbddbf4c2b None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:03.934240 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d10e8f3-a842-47ac-8539-5da80c43e656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:03.936120 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10e8f3-a842-47ac-8539-5da80c43e656 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:03.936607 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10e8f3-a842-47ac-8539-5da80c43e656 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:03.937655 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10e8f3-a842-47ac-8539-5da80c43e656 None admin] PATH_INFO: `/v3/services` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:03.939031 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d10e8f3-a842-47ac-8539-5da80c43e656 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:03.941327 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d10e8f3-a842-47ac-8539-5da80c43e656 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:03.950164 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 463/929] 10.222.0.42 () {56 vars in 1087 bytes} [Wed Jun 22 08:36:03 2022] GET /identity/v3/services => generated 1497 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:36:04.048524 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570bcb8-47ed-4b08-b0a3-bdfbddbf4c2b None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:04.061030 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:04.105607 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1338bc6-c556-4356-ac57-ab95cda024f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:04.110121 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1338bc6-c556-4356-ac57-ab95cda024f1 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:04.110121 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1338bc6-c556-4356-ac57-ab95cda024f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:04.110121 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1338bc6-c556-4356-ac57-ab95cda024f1 None admin] PATH_INFO: `/v3/services` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:04.110121 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1338bc6-c556-4356-ac57-ab95cda024f1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:04.110121 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1338bc6-c556-4356-ac57-ab95cda024f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:04.110121 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1338bc6-c556-4356-ac57-ab95cda024f1 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:04.116071 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 467/930] 10.222.0.42 () {56 vars in 1126 bytes} [Wed Jun 22 08:36:03 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:36:04.121564 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d10e8f3-a842-47ac-8539-5da80c43e656 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:04.140818 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:04.242788 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d10e8f3-a842-47ac-8539-5da80c43e656 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:04.281627 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6c9f7-b9db-403b-816f-88fe1445a35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:04.282327 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6c9f7-b9db-403b-816f-88fe1445a35f None admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:04.282615 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6c9f7-b9db-403b-816f-88fe1445a35f None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:04.282893 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6c9f7-b9db-403b-816f-88fe1445a35f None admin] PATH_INFO: `/v3/endpoints` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:04.283655 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a6c9f7-b9db-403b-816f-88fe1445a35f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:04.285033 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a6c9f7-b9db-403b-816f-88fe1445a35f None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:04.308893 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 464/931] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Jun 22 08:36:04 2022] POST /identity/v3/endpoints => generated 347 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:36:04.598343 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825bc12f-d5d3-4956-acce-fcbe7d855cf1 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:04.598690 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825bc12f-d5d3-4956-acce-fcbe7d855cf1 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:04.598868 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825bc12f-d5d3-4956-acce-fcbe7d855cf1 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:04.600486 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 468/932] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:36:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:36:04.605713 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b1ab3f-22f5-43e1-8524-4b8b7d2ceeb1 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:04.606010 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b1ab3f-22f5-43e1-8524-4b8b7d2ceeb1 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:04.606322 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b1ab3f-22f5-43e1-8524-4b8b7d2ceeb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:04.613480 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8643dced-d9b8-4e86-8dd8-480ac40456f1 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:04.613846 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8643dced-d9b8-4e86-8dd8-480ac40456f1 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:04.614231 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8643dced-d9b8-4e86-8dd8-480ac40456f1 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:04.615879 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 469/933] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:36:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:36:04.620930 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7326ec-39a6-4037-a3f8-7bc48e321956 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:04.621193 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7326ec-39a6-4037-a3f8-7bc48e321956 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:04.621467 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7326ec-39a6-4037-a3f8-7bc48e321956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:04.625754 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-54b1ab3f-22f5-43e1-8524-4b8b7d2ceeb1 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:36:04.627236 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-54b1ab3f-22f5-43e1-8524-4b8b7d2ceeb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:36:04.638524 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-0d7326ec-39a6-4037-a3f8-7bc48e321956 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:36:04.639789 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-0d7326ec-39a6-4037-a3f8-7bc48e321956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:36:04.702199 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:04.724086 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 465/934] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:36:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:36:04.734886 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 470/935] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:36:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 08:36:04.744099 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b1ab3f-22f5-43e1-8524-4b8b7d2ceeb1 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:04.758818 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7326ec-39a6-4037-a3f8-7bc48e321956 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:04.863326 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b1ab3f-22f5-43e1-8524-4b8b7d2ceeb1 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:04.885954 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7326ec-39a6-4037-a3f8-7bc48e321956 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:04.890360 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:04.903429 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458aa86b-17cd-4a26-881f-b64bdc2cea1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:04.904069 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458aa86b-17cd-4a26-881f-b64bdc2cea1e None admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:04.904421 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458aa86b-17cd-4a26-881f-b64bdc2cea1e None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:04.904833 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458aa86b-17cd-4a26-881f-b64bdc2cea1e None admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:04.905536 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458aa86b-17cd-4a26-881f-b64bdc2cea1e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:04.907214 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458aa86b-17cd-4a26-881f-b64bdc2cea1e None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:04.908805 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: WARNING keystone.server.flask.common [None req-458aa86b-17cd-4a26-881f-b64bdc2cea1e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 22 08:36:04.927812 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.sql.core [None req-458aa86b-17cd-4a26-881f-b64bdc2cea1e None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 22 08:36:04.927812 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 22 08:36:04.927812 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [parameters: {'id': 'f2e788a449124bd1805495209fa69f26', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 22 08:36:04.927812 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86701) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 22 08:36:04.932338 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cfe3e9-137e-4d01-b0d3-a25f1fc3337c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:04.933345 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cfe3e9-137e-4d01-b0d3-a25f1fc3337c None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:04.933801 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cfe3e9-137e-4d01-b0d3-a25f1fc3337c None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:04.934308 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cfe3e9-137e-4d01-b0d3-a25f1fc3337c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:04.937911 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-458aa86b-17cd-4a26-881f-b64bdc2cea1e None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f2e788a449124bd1805495209fa69f26.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f2e788a449124bd1805495209fa69f26. Jun 22 08:36:04.937911 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:36:04.937911 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 22 08:36:04.937911 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 22 08:36:04.937911 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 22 08:36:04.937911 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 22 08:36:04.937911 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 22 08:36:04.937911 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application result = self._query(query) Jun 22 08:36:04.937911 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 22 08:36:04.937911 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application conn.query(q) Jun 22 08:36:04.937911 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 22 08:36:04.937911 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 22 08:36:04.937911 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 22 08:36:04.939027 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application result.read() Jun 22 08:36:04.939027 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 22 08:36:04.939027 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 22 08:36:04.939027 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 22 08:36:04.939027 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 22 08:36:04.939027 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 22 08:36:04.939027 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 22 08:36:04.939027 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 22 08:36:04.939027 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 22 08:36:04.939027 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 22 08:36:04.939027 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:36:04.939027 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 22 08:36:04.939027 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:36:04.939027 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:36:04.939027 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 22 08:36:04.939027 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 22 08:36:04.939027 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 22 08:36:04.939027 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 22 08:36:04.939942 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 22 08:36:04.939942 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application next(self.gen) Jun 22 08:36:04.939942 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 22 08:36:04.939942 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application yield resource Jun 22 08:36:04.939942 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 22 08:36:04.939942 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application next(self.gen) Jun 22 08:36:04.939942 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 22 08:36:04.939942 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application self.session.rollback() Jun 22 08:36:04.939942 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 22 08:36:04.939942 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application self.force_reraise() Jun 22 08:36:04.939942 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 22 08:36:04.939942 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise self.value Jun 22 08:36:04.939942 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 22 08:36:04.939942 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 22 08:36:04.939942 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 22 08:36:04.939942 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application session.commit() Jun 22 08:36:04.939942 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 22 08:36:04.940880 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 22 08:36:04.940880 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 22 08:36:04.940880 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application self._prepare_impl() Jun 22 08:36:04.940880 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 22 08:36:04.940880 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application self.session.flush() Jun 22 08:36:04.940880 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 22 08:36:04.940880 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application self._flush(objects) Jun 22 08:36:04.940880 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 22 08:36:04.940880 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 22 08:36:04.940880 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 22 08:36:04.940880 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application compat.raise_( Jun 22 08:36:04.940880 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 22 08:36:04.940880 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception Jun 22 08:36:04.940880 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 22 08:36:04.940880 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application flush_context.execute() Jun 22 08:36:04.940880 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 22 08:36:04.940880 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rec.execute(self) Jun 22 08:36:04.941764 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 22 08:36:04.941764 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 22 08:36:04.941764 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 22 08:36:04.941764 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 22 08:36:04.941764 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 22 08:36:04.941764 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 22 08:36:04.941764 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 22 08:36:04.941764 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 22 08:36:04.941764 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 22 08:36:04.941764 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 22 08:36:04.941764 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 22 08:36:04.941764 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 22 08:36:04.941764 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 22 08:36:04.941764 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 22 08:36:04.941764 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 22 08:36:04.944102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 22 08:36:04.944102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 22 08:36:04.944102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception Jun 22 08:36:04.944102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 22 08:36:04.944102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 22 08:36:04.944102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 22 08:36:04.944102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 22 08:36:04.944102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 22 08:36:04.944102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application result = self._query(query) Jun 22 08:36:04.944102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 22 08:36:04.944102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application conn.query(q) Jun 22 08:36:04.944102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 22 08:36:04.944102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 22 08:36:04.944102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 22 08:36:04.944102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application result.read() Jun 22 08:36:04.944102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 22 08:36:04.944102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 22 08:36:04.946003 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 22 08:36:04.946003 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 22 08:36:04.946003 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 22 08:36:04.946003 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 22 08:36:04.946003 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 22 08:36:04.946003 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 22 08:36:04.946003 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 22 08:36:04.946003 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 22 08:36:04.946003 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [parameters: {'id': 'f2e788a449124bd1805495209fa69f26', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 22 08:36:04.946003 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 22 08:36:04.946003 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:36:04.946003 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:36:04.946003 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:36:04.946003 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:36:04.946003 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 22 08:36:04.947580 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 22 08:36:04.947580 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 22 08:36:04.947580 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 22 08:36:04.947580 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 22 08:36:04.947580 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:36:04.947580 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:36:04.947580 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:36:04.947580 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:36:04.947580 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:36:04.947580 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:36:04.947580 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:36:04.947580 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:36:04.947580 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:36:04.947580 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:36:04.947580 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:36:04.947580 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:36:04.947580 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:36:04.949510 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:36:04.949510 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 22 08:36:04.949510 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 22 08:36:04.949510 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:36:04.949510 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:36:04.949510 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 22 08:36:04.949510 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 22 08:36:04.949510 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f2e788a449124bd1805495209fa69f26. Jun 22 08:36:04.949510 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:36:04.949510 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 466/936] 10.222.0.42 () {60 vars in 1140 bytes} [Wed Jun 22 08:36:04 2022] POST /identity/v3/projects => generated 262 bytes in 201 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:36:04.949510 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458aa86b-17cd-4a26-881f-b64bdc2cea1e None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:04.960417 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cfe3e9-137e-4d01-b0d3-a25f1fc3337c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:36:04.970709 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-36cfe3e9-137e-4d01-b0d3-a25f1fc3337c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 08:36:04.970709 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:36:04.970709 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:36:04.970709 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:36:04.970709 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:36:04.970709 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:36:04.970709 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:36:04.970709 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:36:04.970709 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:36:04.970709 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:36:04.970709 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:36:04.970709 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:36:04.970709 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:36:04.970709 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:36:04.970709 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:36:04.970709 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:36:04.971729 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:36:04.971729 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:36:04.971729 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:36:04.971729 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:36:04.971729 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:36:04.971729 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:36:04.971729 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:36:04.971729 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:36:04.971729 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:36:04.971729 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:36:04.971729 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:36:04.971729 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:36:04.971729 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:36:04.971729 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:36:04.971729 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:36:04.971729 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:36:04.972557 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:36:04.972557 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:36:04.972557 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:36:04.972557 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:36:04.972557 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:36:04.972557 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:36:04.972557 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:36:04.972557 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:36:04.972557 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:36:04.972557 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:36:04.972557 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 08:36:04.972557 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:36:04.980081 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 471/937] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Jun 22 08:36:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:36:04.981341 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cfe3e9-137e-4d01-b0d3-a25f1fc3337c None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:05.006832 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:05.061513 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458aa86b-17cd-4a26-881f-b64bdc2cea1e None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:05.093939 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cfe3e9-137e-4d01-b0d3-a25f1fc3337c None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:05.098813 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dbc1c0-da38-4f8e-ba8b-3cab425a24e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:05.099618 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dbc1c0-da38-4f8e-ba8b-3cab425a24e3 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:05.099904 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dbc1c0-da38-4f8e-ba8b-3cab425a24e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:05.100188 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dbc1c0-da38-4f8e-ba8b-3cab425a24e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:05.107571 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dbc1c0-da38-4f8e-ba8b-3cab425a24e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:05.109344 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dbc1c0-da38-4f8e-ba8b-3cab425a24e3 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:05.123809 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-19dbc1c0-da38-4f8e-ba8b-3cab425a24e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:36:05.123809 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:36:05.123809 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:36:05.123809 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:36:05.123809 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:36:05.123809 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:36:05.123809 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:36:05.123809 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:36:05.123809 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:36:05.123809 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:36:05.123809 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:36:05.123809 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:36:05.123809 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:36:05.123809 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:36:05.123809 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:36:05.126288 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:36:05.126288 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:36:05.126288 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:36:05.126288 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:36:05.126288 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:36:05.126288 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:36:05.126288 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:36:05.126288 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:36:05.126288 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:36:05.126288 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:36:05.126288 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:36:05.126288 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:36:05.126288 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:36:05.126288 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:36:05.126288 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:36:05.126288 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:36:05.126288 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:36:05.127208 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:36:05.127208 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:36:05.127208 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:36:05.127208 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:36:05.127208 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:36:05.127208 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:36:05.127208 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:36:05.127208 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:36:05.131093 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 467/938] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Jun 22 08:36:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:36:05.132087 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dbc1c0-da38-4f8e-ba8b-3cab425a24e3 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:05.137440 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c8f8d-f9e9-4ba5-b4b2-307621d1b683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:05.138535 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c8f8d-f9e9-4ba5-b4b2-307621d1b683 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:05.139026 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c8f8d-f9e9-4ba5-b4b2-307621d1b683 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:05.139549 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c8f8d-f9e9-4ba5-b4b2-307621d1b683 None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:05.141067 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c8f8d-f9e9-4ba5-b4b2-307621d1b683 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:05.141561 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c8f8d-f9e9-4ba5-b4b2-307621d1b683 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:05.143238 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c8f8d-f9e9-4ba5-b4b2-307621d1b683 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:05.157572 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 472/939] 10.222.0.42 () {56 vars in 1115 bytes} [Wed Jun 22 08:36:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:36:05.158804 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c8f8d-f9e9-4ba5-b4b2-307621d1b683 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:05.196373 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:05.252090 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dbc1c0-da38-4f8e-ba8b-3cab425a24e3 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:05.269609 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:05.281976 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c8f8d-f9e9-4ba5-b4b2-307621d1b683 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:05.298240 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddabbef-95b7-471f-afa7-91dd3d194a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:05.299397 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddabbef-95b7-471f-afa7-91dd3d194a95 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:05.300233 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddabbef-95b7-471f-afa7-91dd3d194a95 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:05.300736 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddabbef-95b7-471f-afa7-91dd3d194a95 None admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:05.302008 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddabbef-95b7-471f-afa7-91dd3d194a95 None admin] RBAC: Adding query filter params (name=service) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:05.302537 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddabbef-95b7-471f-afa7-91dd3d194a95 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:05.304675 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddabbef-95b7-471f-afa7-91dd3d194a95 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:05.319045 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2691917b-6801-48ad-8119-921d900791f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:05.320337 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691917b-6801-48ad-8119-921d900791f4 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:05.320337 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691917b-6801-48ad-8119-921d900791f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:05.320537 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691917b-6801-48ad-8119-921d900791f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:05.332539 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2691917b-6801-48ad-8119-921d900791f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:05.333531 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 468/940] 10.222.0.42 () {56 vars in 1112 bytes} [Wed Jun 22 08:36:05 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:36:05.334055 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2691917b-6801-48ad-8119-921d900791f4 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:05.364111 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-2691917b-6801-48ad-8119-921d900791f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:36:05.364111 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:36:05.364111 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:36:05.364111 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:36:05.364111 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:36:05.364111 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:36:05.364111 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:36:05.364111 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:36:05.364111 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:36:05.364111 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:36:05.364111 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:36:05.364111 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:36:05.364111 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:36:05.364111 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:36:05.364111 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:36:05.365107 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:36:05.365107 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:36:05.365107 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:36:05.365107 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:36:05.365107 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:36:05.365107 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:36:05.365107 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:36:05.365107 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:36:05.365107 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:36:05.365107 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:36:05.365107 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:36:05.365107 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:36:05.365107 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:36:05.365107 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:36:05.365107 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:36:05.365107 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:36:05.365107 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:36:05.366014 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:36:05.366014 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:36:05.366014 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:36:05.366014 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:36:05.368075 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 473/941] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:36:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:36:05.374271 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddabbef-95b7-471f-afa7-91dd3d194a95 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:05.499148 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddabbef-95b7-471f-afa7-91dd3d194a95 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:05.541834 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ec3e8-1be3-4de7-b97f-88fd3a7661b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:05.542796 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ec3e8-1be3-4de7-b97f-88fd3a7661b2 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:05.543290 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ec3e8-1be3-4de7-b97f-88fd3a7661b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:05.543716 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ec3e8-1be3-4de7-b97f-88fd3a7661b2 None admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:05.544608 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ec3e8-1be3-4de7-b97f-88fd3a7661b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:05.545099 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ec3e8-1be3-4de7-b97f-88fd3a7661b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:05.546715 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ec3e8-1be3-4de7-b97f-88fd3a7661b2 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:05.561359 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 469/942] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:36:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:36:05.567477 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2691917b-6801-48ad-8119-921d900791f4 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:05.660995 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:05.685362 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2691917b-6801-48ad-8119-921d900791f4 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:05.723800 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea0596-12ae-49a9-ac53-51263d89c75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:05.724625 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea0596-12ae-49a9-ac53-51263d89c75f None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:05.724905 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea0596-12ae-49a9-ac53-51263d89c75f None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:05.725176 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea0596-12ae-49a9-ac53-51263d89c75f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:05.735546 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cea0596-12ae-49a9-ac53-51263d89c75f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:05.737037 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cea0596-12ae-49a9-ac53-51263d89c75f None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:05.753875 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-4cea0596-12ae-49a9-ac53-51263d89c75f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 08:36:05.753875 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:36:05.753875 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:36:05.753875 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:36:05.753875 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:36:05.753875 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:36:05.753875 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:36:05.753875 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:36:05.753875 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:36:05.753875 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:36:05.753875 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:36:05.753875 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:36:05.753875 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:36:05.753875 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:36:05.753875 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:36:05.753875 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:36:05.754910 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:36:05.754910 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:36:05.754910 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:36:05.754910 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:36:05.754910 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:36:05.754910 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:36:05.754910 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:36:05.754910 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:36:05.754910 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:36:05.754910 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:36:05.754910 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:36:05.754910 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:36:05.754910 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:36:05.754910 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:36:05.754910 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:36:05.754910 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:36:05.754910 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:36:05.754910 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:36:05.756273 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:36:05.756273 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:36:05.756273 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:36:05.756273 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:36:05.756273 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:36:05.756273 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:36:05.756273 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:36:05.756273 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:36:05.756273 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 08:36:05.756273 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:36:05.756273 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 474/943] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Jun 22 08:36:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:36:05.761302 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ec3e8-1be3-4de7-b97f-88fd3a7661b2 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:05.797992 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:05.876818 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ec3e8-1be3-4de7-b97f-88fd3a7661b2 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:05.914745 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1c121e-593e-41b3-b704-d81381cefff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:05.915714 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c121e-593e-41b3-b704-d81381cefff8 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:05.916003 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c121e-593e-41b3-b704-d81381cefff8 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:05.916285 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c121e-593e-41b3-b704-d81381cefff8 None admin] PATH_INFO: `/v3/users` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:05.917147 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1c121e-593e-41b3-b704-d81381cefff8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:05.917459 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1c121e-593e-41b3-b704-d81381cefff8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:05.918926 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1c121e-593e-41b3-b704-d81381cefff8 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:05.939280 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 470/944] 10.222.0.42 () {56 vars in 1149 bytes} [Wed Jun 22 08:36:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:36:05.946177 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea0596-12ae-49a9-ac53-51263d89c75f None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:06.060956 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea0596-12ae-49a9-ac53-51263d89c75f None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:06.095839 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d78ad-11fc-4fc2-941c-4dcb063437ac None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:06.096233 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d78ad-11fc-4fc2-941c-4dcb063437ac None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:06.096455 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d78ad-11fc-4fc2-941c-4dcb063437ac None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:06.098066 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 471/945] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:36:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:36:06.102737 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea503e-6c51-4b5d-8798-f540e0c2501d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:06.103696 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3855c-9853-4fc7-99ea-5cd03753c3a6 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:06.103992 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3855c-9853-4fc7-99ea-5cd03753c3a6 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:06.104280 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3855c-9853-4fc7-99ea-5cd03753c3a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:06.104403 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea503e-6c51-4b5d-8798-f540e0c2501d None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:06.104890 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea503e-6c51-4b5d-8798-f540e0c2501d None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:06.105362 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea503e-6c51-4b5d-8798-f540e0c2501d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:06.121944 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:06.122590 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-12d3855c-9853-4fc7-99ea-5cd03753c3a6 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:36:06.124000 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ea503e-6c51-4b5d-8798-f540e0c2501d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:06.124114 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-12d3855c-9853-4fc7-99ea-5cd03753c3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:36:06.126783 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ea503e-6c51-4b5d-8798-f540e0c2501d None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:06.149084 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-57ea503e-6c51-4b5d-8798-f540e0c2501d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:36:06.149084 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:36:06.149084 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:36:06.149084 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:36:06.149084 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:36:06.149084 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:36:06.149084 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:36:06.149084 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:36:06.149084 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:36:06.149084 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:36:06.149084 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:36:06.149084 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:36:06.149084 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:36:06.149084 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:36:06.149084 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:36:06.150030 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:36:06.150030 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:36:06.150030 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:36:06.150030 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:36:06.150030 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:36:06.150030 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:36:06.150030 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:36:06.150030 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:36:06.150030 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:36:06.150030 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:36:06.150030 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:36:06.150030 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:36:06.150030 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:36:06.150030 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:36:06.150030 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:36:06.150030 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:36:06.150030 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:36:06.150914 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:36:06.150914 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:36:06.150914 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:36:06.150914 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:36:06.153307 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 475/946] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:36:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:36:06.159840 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea503e-6c51-4b5d-8798-f540e0c2501d None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:06.208423 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 472/947] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:36:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:36:06.226050 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3855c-9853-4fc7-99ea-5cd03753c3a6 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:06.250520 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:06.320042 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea503e-6c51-4b5d-8798-f540e0c2501d None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:06.363009 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3855c-9853-4fc7-99ea-5cd03753c3a6 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:06.363213 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1fe05c-29e6-40f9-bb62-9048211f4968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:06.363816 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1fe05c-29e6-40f9-bb62-9048211f4968 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:06.364170 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1fe05c-29e6-40f9-bb62-9048211f4968 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:06.364579 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1fe05c-29e6-40f9-bb62-9048211f4968 None admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:06.365417 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1fe05c-29e6-40f9-bb62-9048211f4968 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:06.365844 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1fe05c-29e6-40f9-bb62-9048211f4968 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:06.367371 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1fe05c-29e6-40f9-bb62-9048211f4968 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:06.381051 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 476/948] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:36:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:36:06.386188 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1fe05c-29e6-40f9-bb62-9048211f4968 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:06.409372 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c95a0c-3de4-4fb5-bb8c-eb8444971a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:06.410220 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c95a0c-3de4-4fb5-bb8c-eb8444971a62 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:06.410508 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c95a0c-3de4-4fb5-bb8c-eb8444971a62 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:06.410789 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c95a0c-3de4-4fb5-bb8c-eb8444971a62 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:06.412074 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c95a0c-3de4-4fb5-bb8c-eb8444971a62 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:06.414036 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c95a0c-3de4-4fb5-bb8c-eb8444971a62 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:06.430259 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-52c95a0c-3de4-4fb5-bb8c-eb8444971a62 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 08:36:06.430259 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:36:06.430259 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:36:06.430259 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:36:06.430259 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:36:06.430259 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:36:06.430259 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:36:06.430259 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:36:06.430259 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 08:36:06.430259 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:36:06.430259 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:36:06.430259 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:36:06.430259 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:36:06.430259 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:36:06.430259 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:36:06.430259 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:36:06.430259 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:36:06.431330 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:36:06.431330 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:36:06.431330 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:36:06.431330 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:36:06.431330 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:36:06.431330 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:36:06.431330 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:36:06.431330 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:36:06.431330 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:36:06.431330 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:36:06.431330 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:36:06.431330 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:36:06.431330 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:36:06.431330 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:36:06.431330 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:36:06.431330 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:36:06.432148 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:36:06.432148 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:36:06.432148 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:36:06.432148 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:36:06.432148 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:36:06.432148 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:36:06.432148 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:36:06.432148 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:36:06.432148 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:36:06.432148 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:36:06.432148 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:36:06.432148 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:36:06.432148 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 08:36:06.432148 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:36:06.437127 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 473/949] 10.222.0.42 () {56 vars in 1126 bytes} [Wed Jun 22 08:36:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:36:06.438473 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c95a0c-3de4-4fb5-bb8c-eb8444971a62 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:06.450161 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:06.518347 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1fe05c-29e6-40f9-bb62-9048211f4968 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:06.556035 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:06.557307 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9659637-c42a-40e9-9845-f7b43751160e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:06.558197 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9659637-c42a-40e9-9845-f7b43751160e None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:06.558532 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9659637-c42a-40e9-9845-f7b43751160e None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:06.558861 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9659637-c42a-40e9-9845-f7b43751160e None admin] PATH_INFO: `/v3/projects/service` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:06.567266 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9659637-c42a-40e9-9845-f7b43751160e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:06.568733 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9659637-c42a-40e9-9845-f7b43751160e None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:06.576230 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c95a0c-3de4-4fb5-bb8c-eb8444971a62 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:06.584019 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-b9659637-c42a-40e9-9845-f7b43751160e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:36:06.584019 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:36:06.584019 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:36:06.584019 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:36:06.584019 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:36:06.584019 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:36:06.584019 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:36:06.584019 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:36:06.584019 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:36:06.584019 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:36:06.584019 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:36:06.584019 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:36:06.584019 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:36:06.584019 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:36:06.584019 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:36:06.585002 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:36:06.585002 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:36:06.585002 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:36:06.585002 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:36:06.585002 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:36:06.585002 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:36:06.585002 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:36:06.585002 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:36:06.585002 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:36:06.585002 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:36:06.585002 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:36:06.585002 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:36:06.585002 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:36:06.585002 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:36:06.585002 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:36:06.585002 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:36:06.585002 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:36:06.585870 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:36:06.585870 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:36:06.585870 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:36:06.585870 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:36:06.585870 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:36:06.585870 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:36:06.585870 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:36:06.585870 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:36:06.585870 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 477/950] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Jun 22 08:36:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:36:06.587308 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51029c22-a8af-4234-b515-521547b63930 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:06.587308 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51029c22-a8af-4234-b515-521547b63930 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:06.587308 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51029c22-a8af-4234-b515-521547b63930 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:06.588542 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 478/951] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:36:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:36:06.590951 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51029c22-a8af-4234-b515-521547b63930 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:06.622056 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb3b8f-9543-4aa8-b81b-0aa96052c861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:06.622765 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb3b8f-9543-4aa8-b81b-0aa96052c861 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:06.623051 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb3b8f-9543-4aa8-b81b-0aa96052c861 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:06.623528 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb3b8f-9543-4aa8-b81b-0aa96052c861 None admin] PATH_INFO: `/v3/services` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:06.624036 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdb3b8f-9543-4aa8-b81b-0aa96052c861 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:06.624342 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdb3b8f-9543-4aa8-b81b-0aa96052c861 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:06.626320 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdb3b8f-9543-4aa8-b81b-0aa96052c861 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:06.632387 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 474/952] 10.222.0.42 () {56 vars in 1122 bytes} [Wed Jun 22 08:36:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:36:06.633483 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab25262-76b5-40b3-8378-556b9ff2182c None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:06.633773 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab25262-76b5-40b3-8378-556b9ff2182c None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:06.634052 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab25262-76b5-40b3-8378-556b9ff2182c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:06.651933 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-6ab25262-76b5-40b3-8378-556b9ff2182c None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:36:06.653047 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-6ab25262-76b5-40b3-8378-556b9ff2182c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:36:06.740351 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51029c22-a8af-4234-b515-521547b63930 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:06.754107 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 475/953] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:36:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:36:06.754107 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab25262-76b5-40b3-8378-556b9ff2182c None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:06.758780 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:06.786122 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f936e-6b35-4527-8aa5-24767acf6921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:06.786713 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f936e-6b35-4527-8aa5-24767acf6921 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:06.787113 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f936e-6b35-4527-8aa5-24767acf6921 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:06.787395 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f936e-6b35-4527-8aa5-24767acf6921 None admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:06.788189 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1f936e-6b35-4527-8aa5-24767acf6921 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:06.788516 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1f936e-6b35-4527-8aa5-24767acf6921 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:06.790065 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1f936e-6b35-4527-8aa5-24767acf6921 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:06.808089 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 479/954] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Jun 22 08:36:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:36:06.808089 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f936e-6b35-4527-8aa5-24767acf6921 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:06.838347 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:06.861309 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab25262-76b5-40b3-8378-556b9ff2182c None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:06.898250 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366a6478-a8b4-4d29-ac21-3fbd4555be8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:06.898912 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a6478-a8b4-4d29-ac21-3fbd4555be8a None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:06.899193 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a6478-a8b4-4d29-ac21-3fbd4555be8a None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:06.899470 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a6478-a8b4-4d29-ac21-3fbd4555be8a None admin] PATH_INFO: `/v3/services` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:06.900595 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366a6478-a8b4-4d29-ac21-3fbd4555be8a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:06.900909 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366a6478-a8b4-4d29-ac21-3fbd4555be8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:06.902289 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366a6478-a8b4-4d29-ac21-3fbd4555be8a None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:06.908406 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 476/955] 10.222.0.42 () {56 vars in 1122 bytes} [Wed Jun 22 08:36:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:36:06.909049 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366a6478-a8b4-4d29-ac21-3fbd4555be8a None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:06.918275 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f936e-6b35-4527-8aa5-24767acf6921 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:06.961720 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c8fc25-75c2-45a0-8e87-899e9a9ca1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:06.962563 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8fc25-75c2-45a0-8e87-899e9a9ca1e2 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:06.962886 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8fc25-75c2-45a0-8e87-899e9a9ca1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:06.963146 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8fc25-75c2-45a0-8e87-899e9a9ca1e2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:06.963810 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c8fc25-75c2-45a0-8e87-899e9a9ca1e2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:06.965208 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c8fc25-75c2-45a0-8e87-899e9a9ca1e2 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:06.977872 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-b6c8fc25-75c2-45a0-8e87-899e9a9ca1e2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 08:36:06.977872 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:36:06.977872 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:36:06.977872 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:36:06.977872 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:36:06.977872 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:36:06.977872 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:36:06.977872 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:36:06.977872 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 08:36:06.977872 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:36:06.977872 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:36:06.977872 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:36:06.977872 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:36:06.977872 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:36:06.977872 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:36:06.977872 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:36:06.977872 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:36:06.979111 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:36:06.979111 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:36:06.979111 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:36:06.979111 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:36:06.979111 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:36:06.979111 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:36:06.979111 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:36:06.979111 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:36:06.979111 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:36:06.979111 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:36:06.979111 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:36:06.979111 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:36:06.979111 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:36:06.979111 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:36:06.979111 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:36:06.979111 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:36:06.979985 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:36:06.979985 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:36:06.979985 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:36:06.979985 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:36:06.979985 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:36:06.979985 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:36:06.979985 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:36:06.979985 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:36:06.979985 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:36:06.979985 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:36:06.979985 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:36:06.979985 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:36:06.979985 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 08:36:06.979985 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:36:06.979985 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 480/956] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Jun 22 08:36:06 2022] GET /identity/v3/services/compute => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:36:06.981042 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c8fc25-75c2-45a0-8e87-899e9a9ca1e2 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:07.026487 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:07.040804 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366a6478-a8b4-4d29-ac21-3fbd4555be8a None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:07.079022 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac1232-1ca1-4e2e-9469-3ac270c521f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:07.079928 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac1232-1ca1-4e2e-9469-3ac270c521f3 None admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:07.080206 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac1232-1ca1-4e2e-9469-3ac270c521f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:07.080487 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac1232-1ca1-4e2e-9469-3ac270c521f3 None admin] PATH_INFO: `/v3/projects/e1f161193cb440fa8c4a9d23820a5c28/users/2bf91272d78b4e8f854c760622465af9/roles/334470a0bef9496daf19b5fe65d90c64` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:07.090841 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac1232-1ca1-4e2e-9469-3ac270c521f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=e1f161193cb440fa8c4a9d23820a5c28, user_id=2bf91272d78b4e8f854c760622465af9, role_id=334470a0bef9496daf19b5fe65d90c64)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:07.092284 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac1232-1ca1-4e2e-9469-3ac270c521f3 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:07.118178 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 477/957] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Jun 22 08:36:06 2022] PUT /identity/v3/projects/e1f161193cb440fa8c4a9d23820a5c28/users/2bf91272d78b4e8f854c760622465af9/roles/334470a0bef9496daf19b5fe65d90c64 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:36:07.118178 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac1232-1ca1-4e2e-9469-3ac270c521f3 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:07.118178 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:07.140260 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c8fc25-75c2-45a0-8e87-899e9a9ca1e2 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:07.183592 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d5b717-4001-4326-a8f2-c1d1dcdbe62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:07.184422 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5b717-4001-4326-a8f2-c1d1dcdbe62f None admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:07.184799 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5b717-4001-4326-a8f2-c1d1dcdbe62f None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:07.185151 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5b717-4001-4326-a8f2-c1d1dcdbe62f None admin] PATH_INFO: `/v3/endpoints` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:07.185988 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d5b717-4001-4326-a8f2-c1d1dcdbe62f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:07.188142 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d5b717-4001-4326-a8f2-c1d1dcdbe62f None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:07.222812 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 481/958] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Jun 22 08:36:06 2022] POST /identity/v3/endpoints => generated 349 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:36:07.297365 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac1232-1ca1-4e2e-9469-3ac270c521f3 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:07.352997 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380bad39-e622-46ba-ba44-b4c3f101618e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:07.353675 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380bad39-e622-46ba-ba44-b4c3f101618e None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:07.353956 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380bad39-e622-46ba-ba44-b4c3f101618e None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:07.354275 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380bad39-e622-46ba-ba44-b4c3f101618e None admin] PATH_INFO: `/v3/services` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:07.354993 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380bad39-e622-46ba-ba44-b4c3f101618e None admin] RBAC: Adding query filter params (name=compute) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:07.355305 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380bad39-e622-46ba-ba44-b4c3f101618e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:07.356676 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380bad39-e622-46ba-ba44-b4c3f101618e None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:07.363513 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 478/959] 10.222.0.42 () {56 vars in 1112 bytes} [Wed Jun 22 08:36:07 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:36:07.370797 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d5b717-4001-4326-a8f2-c1d1dcdbe62f None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:07.488498 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:07.500556 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d5b717-4001-4326-a8f2-c1d1dcdbe62f None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:07.538736 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d04de6c-d68b-4e4c-a869-e7640f852435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:07.539409 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04de6c-d68b-4e4c-a869-e7640f852435 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:07.539691 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04de6c-d68b-4e4c-a869-e7640f852435 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:07.539966 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04de6c-d68b-4e4c-a869-e7640f852435 None admin] PATH_INFO: `/v3/services` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:07.540693 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d04de6c-d68b-4e4c-a869-e7640f852435 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:07.541001 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d04de6c-d68b-4e4c-a869-e7640f852435 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:07.542417 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d04de6c-d68b-4e4c-a869-e7640f852435 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:07.548626 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 482/960] 10.222.0.42 () {56 vars in 1112 bytes} [Wed Jun 22 08:36:07 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:36:07.608325 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dccef9-2fec-4e25-b869-c6a1e06f6c28 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:07.609403 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dccef9-2fec-4e25-b869-c6a1e06f6c28 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:07.609897 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dccef9-2fec-4e25-b869-c6a1e06f6c28 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:07.613085 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 479/961] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:36:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:36:07.621359 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e2f9ab-98d2-4905-b22d-ab8d33ef6ee5 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:07.621679 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e2f9ab-98d2-4905-b22d-ab8d33ef6ee5 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:07.621917 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e2f9ab-98d2-4905-b22d-ab8d33ef6ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:07.641724 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-77e2f9ab-98d2-4905-b22d-ab8d33ef6ee5 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:36:07.643522 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-77e2f9ab-98d2-4905-b22d-ab8d33ef6ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:36:07.729413 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 483/962] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:36:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 08:36:07.754973 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dccef9-2fec-4e25-b869-c6a1e06f6c28 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:07.825869 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:07.868613 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dccef9-2fec-4e25-b869-c6a1e06f6c28 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:07.911415 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb144527-b656-44f6-aa25-d9f58f7e5435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:07.912091 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb144527-b656-44f6-aa25-d9f58f7e5435 None admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:07.912375 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb144527-b656-44f6-aa25-d9f58f7e5435 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:07.912653 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb144527-b656-44f6-aa25-d9f58f7e5435 None admin] PATH_INFO: `/v3/users` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:07.913526 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb144527-b656-44f6-aa25-d9f58f7e5435 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:07.915005 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb144527-b656-44f6-aa25-d9f58f7e5435 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:07.930785 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.sql.core [None req-bb144527-b656-44f6-aa25-d9f58f7e5435 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 22 08:36:07.930785 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 22 08:36:07.930785 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [parameters: {'user_id': '5caf0960174c46d3a7e7bb9619199df7', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 22 08:36:07.930785 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86701) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 22 08:36:07.939171 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-bb144527-b656-44f6-aa25-d9f58f7e5435 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 22 08:36:07.939171 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:36:07.939171 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 22 08:36:07.939171 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 22 08:36:07.939171 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 22 08:36:07.939171 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 22 08:36:07.939171 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 22 08:36:07.939171 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application result = self._query(query) Jun 22 08:36:07.939171 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 22 08:36:07.939171 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application conn.query(q) Jun 22 08:36:07.939171 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 22 08:36:07.939171 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 22 08:36:07.939171 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 22 08:36:07.939171 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application result.read() Jun 22 08:36:07.939171 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 22 08:36:07.940057 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 22 08:36:07.940057 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 22 08:36:07.940057 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 22 08:36:07.940057 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 22 08:36:07.940057 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 22 08:36:07.940057 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 22 08:36:07.940057 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 22 08:36:07.940057 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 22 08:36:07.940057 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:36:07.940057 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 22 08:36:07.940057 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:36:07.940057 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:36:07.940057 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 22 08:36:07.940057 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 22 08:36:07.940057 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 22 08:36:07.940057 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 22 08:36:07.940057 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 22 08:36:07.940057 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application next(self.gen) Jun 22 08:36:07.941011 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 22 08:36:07.941011 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application yield resource Jun 22 08:36:07.941011 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 22 08:36:07.941011 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application next(self.gen) Jun 22 08:36:07.941011 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 22 08:36:07.941011 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application self.session.rollback() Jun 22 08:36:07.941011 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 22 08:36:07.941011 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application self.force_reraise() Jun 22 08:36:07.941011 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 22 08:36:07.941011 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise self.value Jun 22 08:36:07.941011 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 22 08:36:07.941011 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 22 08:36:07.941011 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 22 08:36:07.941011 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application session.commit() Jun 22 08:36:07.941011 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 22 08:36:07.941011 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 22 08:36:07.941011 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 22 08:36:07.941893 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application self._prepare_impl() Jun 22 08:36:07.941893 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 22 08:36:07.941893 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application self.session.flush() Jun 22 08:36:07.941893 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 22 08:36:07.941893 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application self._flush(objects) Jun 22 08:36:07.941893 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 22 08:36:07.941893 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 22 08:36:07.941893 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 22 08:36:07.941893 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application compat.raise_( Jun 22 08:36:07.941893 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 22 08:36:07.941893 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception Jun 22 08:36:07.941893 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 22 08:36:07.941893 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application flush_context.execute() Jun 22 08:36:07.941893 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 22 08:36:07.941893 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rec.execute(self) Jun 22 08:36:07.941893 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 22 08:36:07.941893 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 22 08:36:07.942827 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 22 08:36:07.942827 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 22 08:36:07.942827 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 22 08:36:07.942827 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 22 08:36:07.942827 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 22 08:36:07.942827 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 22 08:36:07.942827 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 22 08:36:07.942827 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 22 08:36:07.942827 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 22 08:36:07.942827 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 22 08:36:07.942827 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 22 08:36:07.942827 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 22 08:36:07.942827 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 22 08:36:07.942827 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 22 08:36:07.942827 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 22 08:36:07.942827 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception Jun 22 08:36:07.943658 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 22 08:36:07.943658 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 22 08:36:07.943658 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 22 08:36:07.943658 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 22 08:36:07.943658 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 22 08:36:07.943658 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application result = self._query(query) Jun 22 08:36:07.943658 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 22 08:36:07.943658 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application conn.query(q) Jun 22 08:36:07.943658 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 22 08:36:07.943658 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 22 08:36:07.943658 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 22 08:36:07.943658 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application result.read() Jun 22 08:36:07.943658 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 22 08:36:07.943658 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 22 08:36:07.943658 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 22 08:36:07.943658 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 22 08:36:07.944510 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 22 08:36:07.944510 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 22 08:36:07.944510 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 22 08:36:07.944510 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 22 08:36:07.944510 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 22 08:36:07.944510 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 22 08:36:07.944510 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [parameters: {'user_id': '5caf0960174c46d3a7e7bb9619199df7', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 22 08:36:07.944510 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 22 08:36:07.944510 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:36:07.944510 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:36:07.944510 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:36:07.944510 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:36:07.944510 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:36:07.944510 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:36:07.944510 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:36:07.945300 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:36:07.945300 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:36:07.945300 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:36:07.945300 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:36:07.945300 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:36:07.945300 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:36:07.945300 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:36:07.945300 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 22 08:36:07.945300 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 22 08:36:07.945300 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:36:07.945300 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:36:07.945300 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:36:07.945300 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:36:07.945300 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:36:07.945300 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:36:07.945300 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 22 08:36:07.945300 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 22 08:36:07.956289 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 22 08:36:07.956289 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 22 08:36:07.956289 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 22 08:36:07.956289 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 22 08:36:07.956289 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 22 08:36:07.956289 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:36:07.956289 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 480/963] 10.222.0.42 () {60 vars in 1131 bytes} [Wed Jun 22 08:36:07 2022] POST /identity/v3/users => generated 160 bytes in 186 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:36:07.962605 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e2f9ab-98d2-4905-b22d-ab8d33ef6ee5 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:08.067139 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:08.078319 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e2f9ab-98d2-4905-b22d-ab8d33ef6ee5 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:08.115119 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f503617-2264-48a2-90be-da409efce361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:08.115933 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f503617-2264-48a2-90be-da409efce361 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:08.116216 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f503617-2264-48a2-90be-da409efce361 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:08.116493 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f503617-2264-48a2-90be-da409efce361 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:08.124418 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f503617-2264-48a2-90be-da409efce361 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:08.125895 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f503617-2264-48a2-90be-da409efce361 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:08.141334 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-2f503617-2264-48a2-90be-da409efce361 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 08:36:08.141334 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:36:08.141334 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:36:08.141334 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:36:08.141334 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:36:08.141334 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:36:08.141334 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:36:08.141334 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:36:08.141334 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:36:08.141334 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:36:08.141334 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:36:08.141334 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:36:08.141334 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:36:08.141334 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:36:08.141334 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:36:08.141334 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:36:08.143681 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:36:08.143681 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:36:08.143681 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:36:08.143681 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:36:08.143681 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:36:08.143681 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:36:08.143681 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:36:08.143681 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:36:08.143681 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:36:08.143681 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:36:08.143681 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:36:08.143681 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:36:08.143681 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:36:08.143681 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:36:08.143681 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:36:08.143681 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:36:08.143681 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:36:08.143681 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:36:08.146141 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:36:08.146141 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:36:08.146141 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:36:08.146141 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:36:08.146141 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:36:08.146141 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:36:08.146141 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:36:08.146141 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:36:08.146141 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 08:36:08.146141 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:36:08.146141 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 484/964] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Jun 22 08:36:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:36:08.153501 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb144527-b656-44f6-aa25-d9f58f7e5435 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:08.275707 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb144527-b656-44f6-aa25-d9f58f7e5435 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:08.302748 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:08.315232 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b72fea7-3241-48b1-a45b-c96a03f52b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:08.316450 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72fea7-3241-48b1-a45b-c96a03f52b58 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:08.317395 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72fea7-3241-48b1-a45b-c96a03f52b58 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:08.317644 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72fea7-3241-48b1-a45b-c96a03f52b58 None admin] PATH_INFO: `/v3/users` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:08.318677 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b72fea7-3241-48b1-a45b-c96a03f52b58 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:08.319403 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b72fea7-3241-48b1-a45b-c96a03f52b58 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:08.321453 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b72fea7-3241-48b1-a45b-c96a03f52b58 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:08.373466 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 481/965] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Jun 22 08:36:08 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:36:09.398909 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59232bc6-8681-43ac-b839-f7c5b149079b None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:09.399426 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59232bc6-8681-43ac-b839-f7c5b149079b None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:09.399925 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59232bc6-8681-43ac-b839-f7c5b149079b None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:09.401790 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 485/966] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:36:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:36:09.408214 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dcb4bc-aab5-4241-be64-bb4d07174260 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:09.408686 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dcb4bc-aab5-4241-be64-bb4d07174260 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:09.408803 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dcb4bc-aab5-4241-be64-bb4d07174260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:09.427056 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-62dcb4bc-aab5-4241-be64-bb4d07174260 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:36:09.429090 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-62dcb4bc-aab5-4241-be64-bb4d07174260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:36:09.492467 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4efae-5e23-46eb-9bf9-09e70e0809cc None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:09.492861 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4efae-5e23-46eb-9bf9-09e70e0809cc None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:09.493002 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4efae-5e23-46eb-9bf9-09e70e0809cc None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:09.494429 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 486/967] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:36:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:36:09.500391 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0085d-d5a5-4af0-8987-c047da46d606 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:09.500671 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0085d-d5a5-4af0-8987-c047da46d606 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:09.500948 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0085d-d5a5-4af0-8987-c047da46d606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:09.506654 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 482/968] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:36:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:36:09.522207 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-63d0085d-d5a5-4af0-8987-c047da46d606 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:36:09.523408 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-63d0085d-d5a5-4af0-8987-c047da46d606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:36:09.531031 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dcb4bc-aab5-4241-be64-bb4d07174260 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:09.618547 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 487/969] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:36:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:36:09.647007 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d0085d-d5a5-4af0-8987-c047da46d606 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:09.656949 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dcb4bc-aab5-4241-be64-bb4d07174260 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:09.672771 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:09.698958 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b31a62c-d16c-4be7-be30-288c6e15e2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:09.699778 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b31a62c-d16c-4be7-be30-288c6e15e2d7 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:09.700065 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b31a62c-d16c-4be7-be30-288c6e15e2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:09.700345 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b31a62c-d16c-4be7-be30-288c6e15e2d7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:09.712858 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b31a62c-d16c-4be7-be30-288c6e15e2d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:36:09.722289 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-0b31a62c-d16c-4be7-be30-288c6e15e2d7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 08:36:09.722289 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:36:09.722289 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:36:09.722289 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:36:09.722289 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:36:09.722289 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:36:09.722289 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:36:09.722289 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:36:09.722289 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:36:09.722289 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:36:09.722289 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:36:09.722289 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:36:09.722289 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:36:09.722289 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:36:09.722289 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:36:09.722289 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:36:09.723905 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:36:09.723905 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:36:09.723905 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:36:09.723905 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:36:09.723905 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:36:09.723905 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:36:09.723905 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:36:09.723905 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:36:09.723905 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:36:09.723905 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:36:09.723905 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:36:09.723905 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:36:09.723905 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:36:09.723905 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:36:09.723905 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:36:09.723905 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:36:09.724727 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:36:09.724727 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:36:09.724727 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:36:09.724727 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:36:09.724727 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:36:09.724727 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:36:09.724727 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:36:09.724727 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:36:09.724727 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:36:09.724727 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:36:09.724727 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 08:36:09.724727 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:36:09.724727 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 483/970] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Jun 22 08:36:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:36:09.735380 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b31a62c-d16c-4be7-be30-288c6e15e2d7 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:09.750067 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:09.793808 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d0085d-d5a5-4af0-8987-c047da46d606 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:09.849291 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e6775-6423-4368-ad39-3139db562e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:09.850147 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e6775-6423-4368-ad39-3139db562e88 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:09.850744 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e6775-6423-4368-ad39-3139db562e88 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:09.850744 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e6775-6423-4368-ad39-3139db562e88 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:09.851367 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02e6775-6423-4368-ad39-3139db562e88 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:09.852759 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02e6775-6423-4368-ad39-3139db562e88 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:09.866142 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-d02e6775-6423-4368-ad39-3139db562e88 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 08:36:09.866142 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:36:09.866142 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:36:09.866142 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:36:09.866142 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:36:09.866142 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:36:09.866142 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:36:09.866142 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:36:09.866142 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 08:36:09.866142 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:36:09.866142 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:36:09.866142 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:36:09.866142 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:36:09.866142 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:36:09.866142 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:36:09.866142 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:36:09.866142 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:36:09.867393 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:36:09.867393 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:36:09.867393 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:36:09.867393 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:36:09.867393 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:36:09.867393 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:36:09.867393 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:36:09.867393 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:36:09.867393 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:36:09.867393 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:36:09.867393 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:36:09.867393 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:36:09.867393 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:36:09.867393 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:36:09.867393 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:36:09.867393 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:36:09.868211 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:36:09.868211 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:36:09.868211 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:36:09.868211 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:36:09.868211 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:36:09.868211 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:36:09.868211 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:36:09.868211 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:36:09.868211 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:36:09.868211 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:36:09.868211 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:36:09.868211 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:36:09.868211 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 08:36:09.868211 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:36:09.868211 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 488/971] 10.222.0.42 () {56 vars in 1126 bytes} [Wed Jun 22 08:36:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:36:09.873085 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e6775-6423-4368-ad39-3139db562e88 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:09.882997 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b31a62c-d16c-4be7-be30-288c6e15e2d7 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:09.921421 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64987d48-dcd7-411c-a1b0-f9536204c10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:09.922111 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64987d48-dcd7-411c-a1b0-f9536204c10c None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:09.922400 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64987d48-dcd7-411c-a1b0-f9536204c10c None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:09.922722 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64987d48-dcd7-411c-a1b0-f9536204c10c None admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:09.923475 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64987d48-dcd7-411c-a1b0-f9536204c10c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:09.923783 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64987d48-dcd7-411c-a1b0-f9536204c10c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:09.925190 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64987d48-dcd7-411c-a1b0-f9536204c10c None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:09.934938 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 484/972] 10.222.0.42 () {56 vars in 1115 bytes} [Wed Jun 22 08:36:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:36:09.937670 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2802e-d5b8-4fd1-8f06-da7e48ac3c9f None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:09.937970 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2802e-d5b8-4fd1-8f06-da7e48ac3c9f None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:09.938305 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2802e-d5b8-4fd1-8f06-da7e48ac3c9f None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:09.942129 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 485/973] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:36:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:36:09.942129 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d2802e-d5b8-4fd1-8f06-da7e48ac3c9f None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:09.981365 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:09.982493 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e6775-6423-4368-ad39-3139db562e88 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:10.018956 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0373873-2033-4b13-8c2a-4510a16dd5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:10.019636 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0373873-2033-4b13-8c2a-4510a16dd5cd None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:10.019924 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0373873-2033-4b13-8c2a-4510a16dd5cd None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:10.020206 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0373873-2033-4b13-8c2a-4510a16dd5cd None admin] PATH_INFO: `/v3/services` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:10.020921 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0373873-2033-4b13-8c2a-4510a16dd5cd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:10.021237 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0373873-2033-4b13-8c2a-4510a16dd5cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:10.022657 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0373873-2033-4b13-8c2a-4510a16dd5cd None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:10.027614 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 489/974] 10.222.0.42 () {56 vars in 1122 bytes} [Wed Jun 22 08:36:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:36:10.028920 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc5a38-1528-40c3-8476-88c568b31ec0 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:10.029217 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc5a38-1528-40c3-8476-88c568b31ec0 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:10.029500 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc5a38-1528-40c3-8476-88c568b31ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:10.035189 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:10.048730 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-b4cc5a38-1528-40c3-8476-88c568b31ec0 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:36:10.049866 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-b4cc5a38-1528-40c3-8476-88c568b31ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:36:10.064639 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d2802e-d5b8-4fd1-8f06-da7e48ac3c9f None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:10.102142 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f44e9d-58b7-4708-b45d-e49fcb0e3d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:10.102936 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f44e9d-58b7-4708-b45d-e49fcb0e3d61 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:10.103216 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f44e9d-58b7-4708-b45d-e49fcb0e3d61 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:10.103491 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f44e9d-58b7-4708-b45d-e49fcb0e3d61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:10.114061 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f44e9d-58b7-4708-b45d-e49fcb0e3d61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:10.115532 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f44e9d-58b7-4708-b45d-e49fcb0e3d61 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:10.130809 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 490/975] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:36:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:36:10.131655 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cc5a38-1528-40c3-8476-88c568b31ec0 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:10.136161 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-25f44e9d-58b7-4708-b45d-e49fcb0e3d61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:36:10.136161 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:36:10.136161 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:36:10.136161 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:36:10.136161 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:36:10.136161 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:36:10.136161 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:36:10.136161 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:36:10.136161 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:36:10.136161 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:36:10.136161 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:36:10.136161 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:36:10.136161 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:36:10.136161 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:36:10.136161 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:36:10.137030 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:36:10.137030 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:36:10.137030 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:36:10.137030 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:36:10.137030 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:36:10.137030 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:36:10.137030 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:36:10.137030 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:36:10.137030 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:36:10.137030 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:36:10.137030 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:36:10.137030 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:36:10.137030 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:36:10.137030 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:36:10.137030 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:36:10.137030 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:36:10.137030 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:36:10.137920 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:36:10.137920 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:36:10.137920 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:36:10.137920 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:36:10.141410 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 486/976] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:36:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:36:10.144843 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f44e9d-58b7-4708-b45d-e49fcb0e3d61 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:10.235922 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cc5a38-1528-40c3-8476-88c568b31ec0 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:10.242341 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:10.263772 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f44e9d-58b7-4708-b45d-e49fcb0e3d61 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:10.266911 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:10.273317 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e088783-c65c-4deb-b3ad-3431d24fd731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:10.273988 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e088783-c65c-4deb-b3ad-3431d24fd731 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:10.274513 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e088783-c65c-4deb-b3ad-3431d24fd731 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:10.274630 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e088783-c65c-4deb-b3ad-3431d24fd731 None admin] PATH_INFO: `/v3/services` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:10.275282 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e088783-c65c-4deb-b3ad-3431d24fd731 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:10.275869 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e088783-c65c-4deb-b3ad-3431d24fd731 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:10.276981 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e088783-c65c-4deb-b3ad-3431d24fd731 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:10.282056 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 491/977] 10.222.0.42 () {56 vars in 1122 bytes} [Wed Jun 22 08:36:10 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:36:10.282961 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e088783-c65c-4deb-b3ad-3431d24fd731 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:10.308005 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b68fe9-5157-4713-926d-03ecaf74c8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:10.308589 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b68fe9-5157-4713-926d-03ecaf74c8ad None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:10.308872 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b68fe9-5157-4713-926d-03ecaf74c8ad None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:10.309162 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b68fe9-5157-4713-926d-03ecaf74c8ad None admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:10.309923 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b68fe9-5157-4713-926d-03ecaf74c8ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:10.310286 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b68fe9-5157-4713-926d-03ecaf74c8ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:10.312241 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b68fe9-5157-4713-926d-03ecaf74c8ad None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:10.324586 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 487/978] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:36:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:36:10.329206 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b68fe9-5157-4713-926d-03ecaf74c8ad None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:10.394484 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e088783-c65c-4deb-b3ad-3431d24fd731 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:10.431792 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad6337a-ea60-4fde-a088-88f77c91141c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:10.432638 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad6337a-ea60-4fde-a088-88f77c91141c None admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:10.432823 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad6337a-ea60-4fde-a088-88f77c91141c None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:10.433099 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad6337a-ea60-4fde-a088-88f77c91141c None admin] PATH_INFO: `/v3/services` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:10.433627 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b68fe9-5157-4713-926d-03ecaf74c8ad None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:10.433986 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad6337a-ea60-4fde-a088-88f77c91141c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:10.435222 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad6337a-ea60-4fde-a088-88f77c91141c None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:10.451110 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 492/979] 10.222.0.42 () {60 vars in 1141 bytes} [Wed Jun 22 08:36:10 2022] POST /identity/v3/services => generated 242 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:36:10.451851 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad6337a-ea60-4fde-a088-88f77c91141c None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:10.485975 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de721aa1-c48e-409e-9f37-df4c2d1f540b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:10.486686 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de721aa1-c48e-409e-9f37-df4c2d1f540b None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:10.486975 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de721aa1-c48e-409e-9f37-df4c2d1f540b None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:10.487252 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de721aa1-c48e-409e-9f37-df4c2d1f540b None admin] PATH_INFO: `/v3/endpoints` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:10.488081 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de721aa1-c48e-409e-9f37-df4c2d1f540b None admin] RBAC: Adding query filter params (interface=admin, service_id=7568dcfa3c48492295687d7121598259, region_id=RegionOne) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:10.488395 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de721aa1-c48e-409e-9f37-df4c2d1f540b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:10.489989 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de721aa1-c48e-409e-9f37-df4c2d1f540b None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:10.501713 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 488/980] 10.222.0.42 () {56 vars in 1249 bytes} [Wed Jun 22 08:36:10 2022] GET /identity/v3/endpoints?service_id=7568dcfa3c48492295687d7121598259&interface=admin®ion_id=RegionOne => generated 193 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:36:10.503034 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de721aa1-c48e-409e-9f37-df4c2d1f540b None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:10.514671 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:10.530578 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:10.584712 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad6337a-ea60-4fde-a088-88f77c91141c None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:10.625135 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2ffb9e-5aa6-407d-847a-c97cb607b137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:10.626115 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ffb9e-5aa6-407d-847a-c97cb607b137 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:10.626279 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ffb9e-5aa6-407d-847a-c97cb607b137 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:10.627273 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ffb9e-5aa6-407d-847a-c97cb607b137 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:10.631551 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de721aa1-c48e-409e-9f37-df4c2d1f540b None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:10.635535 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2ffb9e-5aa6-407d-847a-c97cb607b137 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:10.637021 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2ffb9e-5aa6-407d-847a-c97cb607b137 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:10.658466 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-4b2ffb9e-5aa6-407d-847a-c97cb607b137 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 08:36:10.658466 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:36:10.658466 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:36:10.658466 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:36:10.658466 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:36:10.658466 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:36:10.658466 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:36:10.658466 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:36:10.658466 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:36:10.658466 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:36:10.658466 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:36:10.658466 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:36:10.658466 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:36:10.658466 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:36:10.658466 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:36:10.658466 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:36:10.659480 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:36:10.659480 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:36:10.659480 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:36:10.659480 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:36:10.659480 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:36:10.659480 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:36:10.659480 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:36:10.659480 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:36:10.659480 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:36:10.659480 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:36:10.659480 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:36:10.659480 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:36:10.659480 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:36:10.659480 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:36:10.659480 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:36:10.659480 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:36:10.659480 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:36:10.659480 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:36:10.660538 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:36:10.660538 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:36:10.660538 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:36:10.660538 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:36:10.660538 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:36:10.660538 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:36:10.660538 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:36:10.660538 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:36:10.660538 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 08:36:10.660538 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:36:10.660538 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 493/981] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Jun 22 08:36:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:36:10.665662 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2ffb9e-5aa6-407d-847a-c97cb607b137 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:10.679942 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f690eb-2a6a-4083-8c58-b4a3e247fbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:10.680988 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f690eb-2a6a-4083-8c58-b4a3e247fbfe None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:10.681278 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f690eb-2a6a-4083-8c58-b4a3e247fbfe None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:10.681725 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f690eb-2a6a-4083-8c58-b4a3e247fbfe None admin] PATH_INFO: `/v3/services` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:10.682483 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f690eb-2a6a-4083-8c58-b4a3e247fbfe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:10.683902 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f690eb-2a6a-4083-8c58-b4a3e247fbfe None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:10.698112 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 489/982] 10.222.0.42 () {56 vars in 1087 bytes} [Wed Jun 22 08:36:10 2022] GET /identity/v3/services => generated 1727 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:36:10.788558 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2ffb9e-5aa6-407d-847a-c97cb607b137 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:10.806716 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:10.827076 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0294db3e-aee0-41dd-a975-9c2383fe6c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:10.828295 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294db3e-aee0-41dd-a975-9c2383fe6c6b None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:10.828582 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294db3e-aee0-41dd-a975-9c2383fe6c6b None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:10.828862 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294db3e-aee0-41dd-a975-9c2383fe6c6b None admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:10.829721 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0294db3e-aee0-41dd-a975-9c2383fe6c6b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:10.830033 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0294db3e-aee0-41dd-a975-9c2383fe6c6b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:10.831546 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0294db3e-aee0-41dd-a975-9c2383fe6c6b None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:10.854192 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 494/983] 10.222.0.42 () {56 vars in 1149 bytes} [Wed Jun 22 08:36:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:36:10.856812 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f690eb-2a6a-4083-8c58-b4a3e247fbfe None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:10.928458 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:10.964375 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f690eb-2a6a-4083-8c58-b4a3e247fbfe None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:10.999995 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d52ad-a944-4bf0-bcc4-52ab4555ec79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:11.000671 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d52ad-a944-4bf0-bcc4-52ab4555ec79 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:11.000953 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d52ad-a944-4bf0-bcc4-52ab4555ec79 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:11.001226 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d52ad-a944-4bf0-bcc4-52ab4555ec79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:11.076951 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744d52ad-a944-4bf0-bcc4-52ab4555ec79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:11.078455 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744d52ad-a944-4bf0-bcc4-52ab4555ec79 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:11.151738 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:11.190723 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 490/984] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Jun 22 08:36:10 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 22 08:36:11.196802 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0294db3e-aee0-41dd-a975-9c2383fe6c6b None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:11.305133 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0294db3e-aee0-41dd-a975-9c2383fe6c6b None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:11.341243 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc4ab9-a0e7-45a9-aa99-ce8d175569ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:11.342413 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc4ab9-a0e7-45a9-aa99-ce8d175569ba None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:11.342915 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc4ab9-a0e7-45a9-aa99-ce8d175569ba None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:11.343377 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc4ab9-a0e7-45a9-aa99-ce8d175569ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:11.354420 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbc4ab9-a0e7-45a9-aa99-ce8d175569ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:11.356131 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbc4ab9-a0e7-45a9-aa99-ce8d175569ba None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:11.376066 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-9cbc4ab9-a0e7-45a9-aa99-ce8d175569ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:36:11.376066 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:36:11.376066 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:36:11.376066 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:36:11.376066 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:36:11.376066 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:36:11.376066 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:36:11.376066 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:36:11.376066 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:36:11.376066 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:36:11.376066 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:36:11.376066 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:36:11.376066 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:36:11.376066 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:36:11.376066 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:36:11.376972 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:36:11.376972 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:36:11.376972 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:36:11.376972 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:36:11.376972 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:36:11.376972 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:36:11.376972 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:36:11.376972 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:36:11.376972 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:36:11.376972 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:36:11.376972 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:36:11.376972 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:36:11.376972 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:36:11.376972 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:36:11.376972 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:36:11.376972 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:36:11.376972 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:36:11.377894 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:36:11.377894 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:36:11.377894 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:36:11.377894 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:36:11.379587 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 495/985] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:36:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:36:11.385118 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d52ad-a944-4bf0-bcc4-52ab4555ec79 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:11.488980 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d52ad-a944-4bf0-bcc4-52ab4555ec79 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:11.524072 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37958eb9-c128-41f3-913b-9dc86c5f37ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:11.524731 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37958eb9-c128-41f3-913b-9dc86c5f37ed None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:11.525014 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37958eb9-c128-41f3-913b-9dc86c5f37ed None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:11.525290 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37958eb9-c128-41f3-913b-9dc86c5f37ed None admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:11.526016 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37958eb9-c128-41f3-913b-9dc86c5f37ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:11.526350 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37958eb9-c128-41f3-913b-9dc86c5f37ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:11.527714 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37958eb9-c128-41f3-913b-9dc86c5f37ed None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:11.539620 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 491/986] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:36:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:36:11.545051 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc4ab9-a0e7-45a9-aa99-ce8d175569ba None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:11.574086 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:11.651408 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc4ab9-a0e7-45a9-aa99-ce8d175569ba None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:11.686053 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3703d5-9d35-47f4-bbe8-019a9c53e4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:11.686901 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3703d5-9d35-47f4-bbe8-019a9c53e4e0 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:11.687183 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3703d5-9d35-47f4-bbe8-019a9c53e4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:11.687455 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3703d5-9d35-47f4-bbe8-019a9c53e4e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:11.694249 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3703d5-9d35-47f4-bbe8-019a9c53e4e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:11.695699 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3703d5-9d35-47f4-bbe8-019a9c53e4e0 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:11.709760 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-fa3703d5-9d35-47f4-bbe8-019a9c53e4e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:36:11.709760 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:36:11.709760 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:36:11.709760 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:36:11.709760 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:36:11.709760 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:36:11.709760 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:36:11.709760 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:36:11.709760 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:36:11.709760 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:36:11.709760 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:36:11.709760 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:36:11.709760 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:36:11.709760 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:36:11.709760 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:36:11.710704 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:36:11.710704 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:36:11.710704 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:36:11.710704 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:36:11.710704 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:36:11.710704 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:36:11.710704 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:36:11.710704 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:36:11.710704 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:36:11.710704 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:36:11.710704 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:36:11.710704 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:36:11.710704 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:36:11.710704 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:36:11.710704 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:36:11.710704 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:36:11.710704 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:36:11.711742 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:36:11.711742 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:36:11.711742 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:36:11.711742 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:36:11.711742 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:36:11.711742 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:36:11.711742 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:36:11.711742 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:36:11.714393 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 496/987] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Jun 22 08:36:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:36:11.716795 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37958eb9-c128-41f3-913b-9dc86c5f37ed None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:11.749817 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:11.828790 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37958eb9-c128-41f3-913b-9dc86c5f37ed None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:11.862980 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99cd156-1b49-4d30-b51c-f6bb6ad194b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:11.863643 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99cd156-1b49-4d30-b51c-f6bb6ad194b4 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:11.863930 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99cd156-1b49-4d30-b51c-f6bb6ad194b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:11.864210 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99cd156-1b49-4d30-b51c-f6bb6ad194b4 None admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:11.864998 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99cd156-1b49-4d30-b51c-f6bb6ad194b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:11.865310 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99cd156-1b49-4d30-b51c-f6bb6ad194b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:11.866855 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99cd156-1b49-4d30-b51c-f6bb6ad194b4 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:11.884448 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 492/988] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Jun 22 08:36:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:36:11.885992 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3703d5-9d35-47f4-bbe8-019a9c53e4e0 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:11.977147 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:11.992850 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3703d5-9d35-47f4-bbe8-019a9c53e4e0 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:12.027413 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b408ca03-0474-4af5-8241-381a7992ddf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:12.027992 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408ca03-0474-4af5-8241-381a7992ddf4 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:12.028277 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408ca03-0474-4af5-8241-381a7992ddf4 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:12.028556 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408ca03-0474-4af5-8241-381a7992ddf4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:12.029392 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b408ca03-0474-4af5-8241-381a7992ddf4 None admin] RBAC: Adding query filter params (role.id=334470a0bef9496daf19b5fe65d90c64, scope.project.id=e1f161193cb440fa8c4a9d23820a5c28, user.id=2bf91272d78b4e8f854c760622465af9) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:12.029708 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b408ca03-0474-4af5-8241-381a7992ddf4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:12.031709 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b408ca03-0474-4af5-8241-381a7992ddf4 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:12.037851 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 497/989] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Jun 22 08:36:11 2022] GET /identity/v3/role_assignments?user.id=2bf91272d78b4e8f854c760622465af9&scope.project.id=e1f161193cb440fa8c4a9d23820a5c28&role.id=334470a0bef9496daf19b5fe65d90c64 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:36:12.537560 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec779f-34f0-45e6-90a9-3633c7dea2f4 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:12.538118 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec779f-34f0-45e6-90a9-3633c7dea2f4 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:12.538307 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec779f-34f0-45e6-90a9-3633c7dea2f4 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:12.539666 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 493/990] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:36:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:36:12.545188 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeae56f-8c1d-4ba8-bd4a-bc96af02bdba None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:12.545726 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeae56f-8c1d-4ba8-bd4a-bc96af02bdba None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:12.545726 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeae56f-8c1d-4ba8-bd4a-bc96af02bdba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:12.564108 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-0eeae56f-8c1d-4ba8-bd4a-bc96af02bdba None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:36:12.565308 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-0eeae56f-8c1d-4ba8-bd4a-bc96af02bdba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:36:12.633491 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 498/991] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:36:12 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:36:12.657104 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec779f-34f0-45e6-90a9-3633c7dea2f4 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:12.750930 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:12.755176 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e3e2f-db79-4a44-b0f9-935244334607 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:12.755982 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e3e2f-db79-4a44-b0f9-935244334607 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:12.758569 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e3e2f-db79-4a44-b0f9-935244334607 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:12.760064 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 499/992] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:36:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:36:12.763880 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec779f-34f0-45e6-90a9-3633c7dea2f4 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:12.767965 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4f628-fca6-4394-a361-8729f898e3f1 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:12.768264 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4f628-fca6-4394-a361-8729f898e3f1 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:12.768549 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4f628-fca6-4394-a361-8729f898e3f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:12.786492 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-97b4f628-fca6-4394-a361-8729f898e3f1 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:36:12.787781 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-97b4f628-fca6-4394-a361-8729f898e3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:36:12.803594 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf83aa7-3426-471e-a2ae-1c30d7c2c982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:12.804385 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf83aa7-3426-471e-a2ae-1c30d7c2c982 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:12.804667 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf83aa7-3426-471e-a2ae-1c30d7c2c982 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:12.804940 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf83aa7-3426-471e-a2ae-1c30d7c2c982 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:12.805712 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf83aa7-3426-471e-a2ae-1c30d7c2c982 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:12.807275 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf83aa7-3426-471e-a2ae-1c30d7c2c982 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:12.820553 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-caf83aa7-3426-471e-a2ae-1c30d7c2c982 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 08:36:12.820553 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:36:12.820553 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:36:12.820553 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:36:12.820553 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:36:12.820553 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:36:12.820553 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:36:12.820553 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:36:12.820553 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 08:36:12.820553 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:36:12.820553 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:36:12.820553 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:36:12.820553 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:36:12.820553 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:36:12.820553 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:36:12.820553 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:36:12.820553 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:36:12.821705 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:36:12.821705 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:36:12.821705 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:36:12.821705 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:36:12.821705 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:36:12.821705 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:36:12.821705 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:36:12.821705 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:36:12.821705 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:36:12.821705 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:36:12.821705 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:36:12.821705 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:36:12.821705 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:36:12.821705 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:36:12.821705 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:36:12.821705 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:36:12.822577 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:36:12.822577 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:36:12.822577 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:36:12.822577 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:36:12.822577 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:36:12.822577 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:36:12.822577 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:36:12.822577 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:36:12.822577 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:36:12.822577 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:36:12.822577 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:36:12.822577 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:36:12.822577 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 08:36:12.822577 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:36:12.822577 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 494/993] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Jun 22 08:36:12 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:36:12.828950 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf83aa7-3426-471e-a2ae-1c30d7c2c982 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:12.862532 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 500/994] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:36:12 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 08:36:12.885054 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4f628-fca6-4394-a361-8729f898e3f1 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:12.897188 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:12.937369 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf83aa7-3426-471e-a2ae-1c30d7c2c982 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:12.981745 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d151fc-6ab8-4aff-b79e-507eb522ec2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:12.982447 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d151fc-6ab8-4aff-b79e-507eb522ec2e None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:12.982734 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d151fc-6ab8-4aff-b79e-507eb522ec2e None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:12.983021 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d151fc-6ab8-4aff-b79e-507eb522ec2e None admin] PATH_INFO: `/v3/services` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:12.983763 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d151fc-6ab8-4aff-b79e-507eb522ec2e None admin] RBAC: Adding query filter params (name=compute) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:12.984076 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d151fc-6ab8-4aff-b79e-507eb522ec2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:12.985460 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d151fc-6ab8-4aff-b79e-507eb522ec2e None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:12.990952 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 495/995] 10.222.0.42 () {56 vars in 1112 bytes} [Wed Jun 22 08:36:12 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:36:12.991469 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4f628-fca6-4394-a361-8729f898e3f1 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:12.996610 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d151fc-6ab8-4aff-b79e-507eb522ec2e None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:13.018198 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:13.034135 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128dac4d-f01b-4778-9d22-0944756db4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:13.035053 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128dac4d-f01b-4778-9d22-0944756db4cf None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:13.035441 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128dac4d-f01b-4778-9d22-0944756db4cf None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:13.035673 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128dac4d-f01b-4778-9d22-0944756db4cf None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:13.036330 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128dac4d-f01b-4778-9d22-0944756db4cf None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:13.037713 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128dac4d-f01b-4778-9d22-0944756db4cf None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:13.050458 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-128dac4d-f01b-4778-9d22-0944756db4cf None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 08:36:13.050458 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:36:13.050458 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:36:13.050458 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:36:13.050458 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:36:13.050458 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:36:13.050458 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:36:13.050458 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:36:13.050458 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 08:36:13.050458 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:36:13.050458 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:36:13.050458 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:36:13.050458 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:36:13.050458 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:36:13.050458 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:36:13.050458 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:36:13.050458 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:36:13.051727 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:36:13.051727 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:36:13.051727 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:36:13.051727 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:36:13.051727 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:36:13.051727 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:36:13.051727 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:36:13.051727 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:36:13.051727 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:36:13.051727 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:36:13.051727 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:36:13.051727 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:36:13.051727 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:36:13.051727 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:36:13.051727 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:36:13.051727 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:36:13.052562 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:36:13.052562 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:36:13.052562 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:36:13.052562 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:36:13.052562 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:36:13.052562 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:36:13.052562 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:36:13.052562 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:36:13.052562 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:36:13.052562 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:36:13.052562 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:36:13.052562 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:36:13.052562 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 08:36:13.052562 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:36:13.052562 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 501/996] 10.222.0.42 () {56 vars in 1126 bytes} [Wed Jun 22 08:36:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:36:13.059095 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128dac4d-f01b-4778-9d22-0944756db4cf None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:13.121349 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d151fc-6ab8-4aff-b79e-507eb522ec2e None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:13.158275 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:13.161692 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b4a427-17f0-43db-a931-127e16036cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:13.162402 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4a427-17f0-43db-a931-127e16036cfd None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:13.162884 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4a427-17f0-43db-a931-127e16036cfd None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:13.163018 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4a427-17f0-43db-a931-127e16036cfd None admin] PATH_INFO: `/v3/services` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:13.163772 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b4a427-17f0-43db-a931-127e16036cfd None admin] RBAC: Adding query filter params (type=compute) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:13.164000 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b4a427-17f0-43db-a931-127e16036cfd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:13.165378 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b4a427-17f0-43db-a931-127e16036cfd None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:13.170762 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 496/997] 10.222.0.42 () {56 vars in 1112 bytes} [Wed Jun 22 08:36:12 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:36:13.177096 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b4a427-17f0-43db-a931-127e16036cfd None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:13.190408 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128dac4d-f01b-4778-9d22-0944756db4cf None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:13.236688 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110af9e9-dec5-4456-9c0a-41c30c5af924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:13.237745 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110af9e9-dec5-4456-9c0a-41c30c5af924 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:13.238214 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110af9e9-dec5-4456-9c0a-41c30c5af924 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:13.238779 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110af9e9-dec5-4456-9c0a-41c30c5af924 None admin] PATH_INFO: `/v3/services` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:13.240093 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110af9e9-dec5-4456-9c0a-41c30c5af924 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:13.240561 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110af9e9-dec5-4456-9c0a-41c30c5af924 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:13.242613 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110af9e9-dec5-4456-9c0a-41c30c5af924 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:13.254375 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 502/998] 10.222.0.42 () {56 vars in 1122 bytes} [Wed Jun 22 08:36:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:36:13.259826 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110af9e9-dec5-4456-9c0a-41c30c5af924 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:13.282743 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:13.313113 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b4a427-17f0-43db-a931-127e16036cfd None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:13.365449 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696dc497-79e0-4655-8536-6b08b8ff7eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:13.366495 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696dc497-79e0-4655-8536-6b08b8ff7eb0 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:13.367221 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696dc497-79e0-4655-8536-6b08b8ff7eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:13.367447 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696dc497-79e0-4655-8536-6b08b8ff7eb0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:13.368691 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696dc497-79e0-4655-8536-6b08b8ff7eb0 None admin] RBAC: Adding query filter params (interface=public, service_id=ba4031b8251142f9a21bf571c1713ec9, region_id=RegionOne) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:13.369170 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696dc497-79e0-4655-8536-6b08b8ff7eb0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:13.371588 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696dc497-79e0-4655-8536-6b08b8ff7eb0 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:13.379738 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 497/999] 10.222.0.42 () {56 vars in 1251 bytes} [Wed Jun 22 08:36:13 2022] GET /identity/v3/endpoints?service_id=ba4031b8251142f9a21bf571c1713ec9&interface=public®ion_id=RegionOne => generated 194 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:36:13.385756 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696dc497-79e0-4655-8536-6b08b8ff7eb0 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:13.387281 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110af9e9-dec5-4456-9c0a-41c30c5af924 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:13.426032 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cdf960-9f82-46eb-b641-918255c5fa70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:13.426738 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cdf960-9f82-46eb-b641-918255c5fa70 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:13.427024 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cdf960-9f82-46eb-b641-918255c5fa70 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:13.427304 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cdf960-9f82-46eb-b641-918255c5fa70 None admin] PATH_INFO: `/v3/services` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:13.428020 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cdf960-9f82-46eb-b641-918255c5fa70 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:13.428333 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cdf960-9f82-46eb-b641-918255c5fa70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:13.429717 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cdf960-9f82-46eb-b641-918255c5fa70 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:13.435304 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 503/1000] 10.222.0.42 () {56 vars in 1122 bytes} [Wed Jun 22 08:36:13 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:36:13.441518 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cdf960-9f82-46eb-b641-918255c5fa70 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:13.444673 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:13.506611 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696dc497-79e0-4655-8536-6b08b8ff7eb0 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:13.547109 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d755b-24f5-4fdf-9a60-d250dc1ed7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:13.547796 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d755b-24f5-4fdf-9a60-d250dc1ed7fa None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:13.548180 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d755b-24f5-4fdf-9a60-d250dc1ed7fa None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:13.548468 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d755b-24f5-4fdf-9a60-d250dc1ed7fa None admin] PATH_INFO: `/v3/services` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:13.549187 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732d755b-24f5-4fdf-9a60-d250dc1ed7fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:13.550669 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732d755b-24f5-4fdf-9a60-d250dc1ed7fa None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:13.566218 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 498/1001] 10.222.0.42 () {56 vars in 1087 bytes} [Wed Jun 22 08:36:13 2022] GET /identity/v3/services => generated 1727 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 08:36:13.587451 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cdf960-9f82-46eb-b641-918255c5fa70 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:13.630179 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078bd82a-3b13-46cf-91b7-f06109f773ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:13.630866 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078bd82a-3b13-46cf-91b7-f06109f773ca None admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:13.631156 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078bd82a-3b13-46cf-91b7-f06109f773ca None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:13.631439 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078bd82a-3b13-46cf-91b7-f06109f773ca None admin] PATH_INFO: `/v3/endpoints` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:13.632214 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078bd82a-3b13-46cf-91b7-f06109f773ca None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:13.633676 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078bd82a-3b13-46cf-91b7-f06109f773ca None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:13.658111 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 504/1002] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Jun 22 08:36:13 2022] POST /identity/v3/endpoints => generated 325 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:36:14.161247 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a13928-dd2f-41ec-9816-e66ec1c1ca09 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:14.161680 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a13928-dd2f-41ec-9816-e66ec1c1ca09 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:14.161833 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a13928-dd2f-41ec-9816-e66ec1c1ca09 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:14.163451 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 499/1003] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:36:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:36:14.168989 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0e8b8-7fcc-4a04-998c-6b158f005d59 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:14.169343 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0e8b8-7fcc-4a04-998c-6b158f005d59 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:14.169628 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0e8b8-7fcc-4a04-998c-6b158f005d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:14.187452 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-8ca0e8b8-7fcc-4a04-998c-6b158f005d59 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:36:14.188674 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-8ca0e8b8-7fcc-4a04-998c-6b158f005d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:36:14.258511 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:14.277540 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 505/1004] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:36:14 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:36:14.300943 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a13928-dd2f-41ec-9816-e66ec1c1ca09 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:14.314505 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:14.406618 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a13928-dd2f-41ec-9816-e66ec1c1ca09 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:14.442632 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ecfd10-4d27-451d-bb13-5a5fa9df39c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:14.443349 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ecfd10-4d27-451d-bb13-5a5fa9df39c4 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:14.443688 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ecfd10-4d27-451d-bb13-5a5fa9df39c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:14.443967 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ecfd10-4d27-451d-bb13-5a5fa9df39c4 None admin] PATH_INFO: `/v3/services/image` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:14.444657 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ecfd10-4d27-451d-bb13-5a5fa9df39c4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:14.446029 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ecfd10-4d27-451d-bb13-5a5fa9df39c4 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:14.458016 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-49ecfd10-4d27-451d-bb13-5a5fa9df39c4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 08:36:14.458016 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:36:14.458016 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:36:14.458016 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:36:14.458016 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:36:14.458016 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:36:14.458016 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:36:14.458016 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:36:14.458016 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 08:36:14.458016 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:36:14.458016 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:36:14.458016 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:36:14.458016 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:36:14.458016 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:36:14.458016 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:36:14.458016 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:36:14.458016 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:36:14.459157 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:36:14.459157 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:36:14.459157 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:36:14.459157 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:36:14.459157 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:36:14.459157 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:36:14.459157 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:36:14.459157 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:36:14.459157 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:36:14.459157 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:36:14.459157 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:36:14.459157 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:36:14.459157 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:36:14.459157 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:36:14.459157 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:36:14.459157 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:36:14.460002 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:36:14.460002 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:36:14.460002 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:36:14.460002 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:36:14.460002 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:36:14.460002 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:36:14.460002 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:36:14.460002 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:36:14.460002 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:36:14.460002 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:36:14.460002 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:36:14.460002 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:36:14.460002 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 08:36:14.460002 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:36:14.462158 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 500/1005] 10.222.0.42 () {56 vars in 1105 bytes} [Wed Jun 22 08:36:14 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:36:14.465479 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0e8b8-7fcc-4a04-998c-6b158f005d59 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:14.575982 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0e8b8-7fcc-4a04-998c-6b158f005d59 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:14.610169 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae02c737-aa78-48a9-b7c6-1dbbbc971a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:14.610979 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02c737-aa78-48a9-b7c6-1dbbbc971a22 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:14.611164 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02c737-aa78-48a9-b7c6-1dbbbc971a22 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:14.611416 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02c737-aa78-48a9-b7c6-1dbbbc971a22 None admin] PATH_INFO: `/v3/services` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:14.612136 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae02c737-aa78-48a9-b7c6-1dbbbc971a22 None admin] RBAC: Adding query filter params (name=image) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:14.612448 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae02c737-aa78-48a9-b7c6-1dbbbc971a22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:14.613825 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae02c737-aa78-48a9-b7c6-1dbbbc971a22 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:14.619026 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 506/1006] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:36:14 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:36:14.624959 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ecfd10-4d27-451d-bb13-5a5fa9df39c4 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:14.707635 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:14.735982 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ecfd10-4d27-451d-bb13-5a5fa9df39c4 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:14.776519 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91796c-3256-460e-9e8c-ad32b6cc25e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:14.777581 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91796c-3256-460e-9e8c-ad32b6cc25e2 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:14.777870 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91796c-3256-460e-9e8c-ad32b6cc25e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:14.778177 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91796c-3256-460e-9e8c-ad32b6cc25e2 None admin] PATH_INFO: `/v3/services` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:14.778893 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad91796c-3256-460e-9e8c-ad32b6cc25e2 None admin] RBAC: Adding query filter params (type=image) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:14.779205 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad91796c-3256-460e-9e8c-ad32b6cc25e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:14.780618 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad91796c-3256-460e-9e8c-ad32b6cc25e2 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:14.790204 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 501/1007] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:36:14 2022] GET /identity/v3/services?type=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:36:15.647352 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d0258-5b15-49bb-b56f-f4a9bd34473c None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:15.647916 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d0258-5b15-49bb-b56f-f4a9bd34473c None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:15.647916 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d0258-5b15-49bb-b56f-f4a9bd34473c None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:15.649492 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 507/1008] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:36:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:36:15.655061 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba44c1-6efa-4917-b377-e20c653a3ffa None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:15.655638 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba44c1-6efa-4917-b377-e20c653a3ffa None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:15.655638 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba44c1-6efa-4917-b377-e20c653a3ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:15.673199 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-bbba44c1-6efa-4917-b377-e20c653a3ffa None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:36:15.674444 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-bbba44c1-6efa-4917-b377-e20c653a3ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:36:15.724829 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437e6e6-4d25-4db6-b7eb-8616ad679b0c None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:15.725119 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437e6e6-4d25-4db6-b7eb-8616ad679b0c None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:15.725396 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437e6e6-4d25-4db6-b7eb-8616ad679b0c None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:15.726780 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 508/1009] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:36:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:36:15.731698 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5ed64-8b54-49c9-918b-d3247eda1827 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:15.731984 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5ed64-8b54-49c9-918b-d3247eda1827 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:15.732282 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5ed64-8b54-49c9-918b-d3247eda1827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:15.747987 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 502/1010] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:36:15 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:36:15.749923 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-5ae5ed64-8b54-49c9-918b-d3247eda1827 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:36:15.751166 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-5ae5ed64-8b54-49c9-918b-d3247eda1827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:36:15.771616 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba44c1-6efa-4917-b377-e20c653a3ffa None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:15.804107 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:15.825875 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 509/1011] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:36:15 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 08:36:15.843846 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:15.850587 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5ed64-8b54-49c9-918b-d3247eda1827 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:15.884136 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba44c1-6efa-4917-b377-e20c653a3ffa None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:15.924578 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8321ad-c629-47e9-b361-449831bd5698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:15.925290 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8321ad-c629-47e9-b361-449831bd5698 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:15.925594 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8321ad-c629-47e9-b361-449831bd5698 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:15.925892 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8321ad-c629-47e9-b361-449831bd5698 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:15.926585 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8321ad-c629-47e9-b361-449831bd5698 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:15.927957 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8321ad-c629-47e9-b361-449831bd5698 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:15.940704 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-2b8321ad-c629-47e9-b361-449831bd5698 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 08:36:15.940704 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:36:15.940704 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:36:15.940704 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:36:15.940704 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:36:15.940704 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:36:15.940704 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:36:15.940704 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:36:15.940704 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 08:36:15.940704 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:36:15.940704 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:36:15.940704 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:36:15.940704 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:36:15.940704 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:36:15.940704 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:36:15.940704 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:36:15.940704 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:36:15.941756 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:36:15.941756 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:36:15.941756 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:36:15.941756 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:36:15.941756 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:36:15.941756 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:36:15.941756 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:36:15.941756 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:36:15.941756 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:36:15.941756 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:36:15.941756 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:36:15.941756 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:36:15.941756 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:36:15.941756 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:36:15.941756 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:36:15.941756 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:36:15.942655 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:36:15.942655 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:36:15.942655 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:36:15.942655 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:36:15.942655 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:36:15.942655 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:36:15.942655 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:36:15.942655 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:36:15.942655 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:36:15.942655 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:36:15.942655 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:36:15.942655 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:36:15.942655 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 08:36:15.942655 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:36:15.942655 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 503/1012] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Jun 22 08:36:15 2022] GET /identity/v3/services/compute => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:36:15.947548 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8321ad-c629-47e9-b361-449831bd5698 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:15.964560 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5ed64-8b54-49c9-918b-d3247eda1827 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:16.002088 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61d439-03b8-4c51-ae6a-eb94e66e676f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:16.002906 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61d439-03b8-4c51-ae6a-eb94e66e676f None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:16.003191 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61d439-03b8-4c51-ae6a-eb94e66e676f None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:16.003471 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61d439-03b8-4c51-ae6a-eb94e66e676f None admin] PATH_INFO: `/v3/domains/default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:16.004652 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e61d439-03b8-4c51-ae6a-eb94e66e676f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:16.006130 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e61d439-03b8-4c51-ae6a-eb94e66e676f None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:16.007877 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 510/1013] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:36:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:36:16.013371 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61d439-03b8-4c51-ae6a-eb94e66e676f None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:16.065338 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8321ad-c629-47e9-b361-449831bd5698 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:16.066320 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:16.097507 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:16.103215 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f77d7-1cdb-4317-9646-29b61943462a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:16.103883 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f77d7-1cdb-4317-9646-29b61943462a None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:16.104169 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f77d7-1cdb-4317-9646-29b61943462a None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:16.104451 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f77d7-1cdb-4317-9646-29b61943462a None admin] PATH_INFO: `/v3/services` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:16.105163 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89f77d7-1cdb-4317-9646-29b61943462a None admin] RBAC: Adding query filter params (name=compute) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:16.105474 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89f77d7-1cdb-4317-9646-29b61943462a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:16.106872 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89f77d7-1cdb-4317-9646-29b61943462a None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:16.111820 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 504/1014] 10.222.0.42 () {56 vars in 1112 bytes} [Wed Jun 22 08:36:15 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:36:16.117330 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f77d7-1cdb-4317-9646-29b61943462a None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:16.127854 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61d439-03b8-4c51-ae6a-eb94e66e676f None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:16.164075 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376084f4-ca12-4412-aa7e-2ea9f8cbff6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:16.164946 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376084f4-ca12-4412-aa7e-2ea9f8cbff6a None admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:16.165403 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376084f4-ca12-4412-aa7e-2ea9f8cbff6a None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:16.165832 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376084f4-ca12-4412-aa7e-2ea9f8cbff6a None admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:16.166576 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376084f4-ca12-4412-aa7e-2ea9f8cbff6a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:16.167993 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376084f4-ca12-4412-aa7e-2ea9f8cbff6a None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:16.206488 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 511/1015] 10.222.0.42 () {60 vars in 1141 bytes} [Wed Jun 22 08:36:16 2022] POST /identity/v3/projects => generated 311 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 08:36:16.239264 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f77d7-1cdb-4317-9646-29b61943462a None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:16.288764 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572b0290-58e2-4daa-a8fe-70c58479aafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:16.289446 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b0290-58e2-4daa-a8fe-70c58479aafe None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:16.289730 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b0290-58e2-4daa-a8fe-70c58479aafe None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:16.290011 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b0290-58e2-4daa-a8fe-70c58479aafe None admin] PATH_INFO: `/v3/services` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:16.290769 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572b0290-58e2-4daa-a8fe-70c58479aafe None admin] RBAC: Adding query filter params (type=compute) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:16.291081 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572b0290-58e2-4daa-a8fe-70c58479aafe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:16.292472 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572b0290-58e2-4daa-a8fe-70c58479aafe None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:16.303961 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 505/1016] 10.222.0.42 () {56 vars in 1112 bytes} [Wed Jun 22 08:36:16 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:36:16.305569 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376084f4-ca12-4412-aa7e-2ea9f8cbff6a None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:16.421477 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376084f4-ca12-4412-aa7e-2ea9f8cbff6a None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:16.423237 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:16.459481 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6871a278-87d0-422d-a485-22204b058c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:16.460065 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871a278-87d0-422d-a485-22204b058c93 None admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:16.460351 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871a278-87d0-422d-a485-22204b058c93 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:16.460628 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871a278-87d0-422d-a485-22204b058c93 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:16.461390 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6871a278-87d0-422d-a485-22204b058c93 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:16.462808 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6871a278-87d0-422d-a485-22204b058c93 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:16.484932 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 512/1017] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Jun 22 08:36:16 2022] POST /identity/v3/endpoints => generated 334 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:36:16.858596 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c2e76-2556-40b7-8170-1dbeec8c6ddd None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:16.859089 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c2e76-2556-40b7-8170-1dbeec8c6ddd None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:16.859089 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c2e76-2556-40b7-8170-1dbeec8c6ddd None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:16.860579 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 506/1018] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:36:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:36:16.865512 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0fa3c6-21ac-47f4-8b23-8c1b4578db4f None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:16.865903 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0fa3c6-21ac-47f4-8b23-8c1b4578db4f None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:16.866070 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0fa3c6-21ac-47f4-8b23-8c1b4578db4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:16.882799 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-7f0fa3c6-21ac-47f4-8b23-8c1b4578db4f None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:36:16.883993 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-7f0fa3c6-21ac-47f4-8b23-8c1b4578db4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:36:16.961365 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 513/1019] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:36:16 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:36:16.985020 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4c2e76-2556-40b7-8170-1dbeec8c6ddd None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:17.046677 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:17.091344 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4c2e76-2556-40b7-8170-1dbeec8c6ddd None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:17.127656 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f92df8-393e-495c-8f7c-765a7b2f1175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:17.128292 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f92df8-393e-495c-8f7c-765a7b2f1175 None admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:17.128573 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f92df8-393e-495c-8f7c-765a7b2f1175 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:17.128856 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f92df8-393e-495c-8f7c-765a7b2f1175 None admin] PATH_INFO: `/v3/services` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:17.129589 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f92df8-393e-495c-8f7c-765a7b2f1175 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:17.131049 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f92df8-393e-495c-8f7c-765a7b2f1175 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:17.145964 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 507/1020] 10.222.0.42 () {60 vars in 1141 bytes} [Wed Jun 22 08:36:16 2022] POST /identity/v3/services => generated 242 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:36:18.309504 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5627d-e6cc-4001-b7de-c2a99850eefa None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:18.310042 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5627d-e6cc-4001-b7de-c2a99850eefa None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:18.310042 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5627d-e6cc-4001-b7de-c2a99850eefa None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:18.311572 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 514/1021] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:36:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:36:18.316834 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ca814-4445-4926-8996-ba250dc87169 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:18.317250 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ca814-4445-4926-8996-ba250dc87169 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:18.317418 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ca814-4445-4926-8996-ba250dc87169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:18.335413 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-5d4ca814-4445-4926-8996-ba250dc87169 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:36:18.336604 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-5d4ca814-4445-4926-8996-ba250dc87169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:36:18.408426 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 508/1022] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:36:18 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:36:18.433237 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e5627d-e6cc-4001-b7de-c2a99850eefa None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:18.521563 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:18.541690 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e5627d-e6cc-4001-b7de-c2a99850eefa None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:18.576172 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4804a1-8412-4e42-931f-9bf92a6015a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:18.576997 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4804a1-8412-4e42-931f-9bf92a6015a8 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:18.577283 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4804a1-8412-4e42-931f-9bf92a6015a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:18.577555 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4804a1-8412-4e42-931f-9bf92a6015a8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:18.578731 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4804a1-8412-4e42-931f-9bf92a6015a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:18.580168 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4804a1-8412-4e42-931f-9bf92a6015a8 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:18.581936 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 515/1023] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:36:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:36:18.587464 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ca814-4445-4926-8996-ba250dc87169 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:18.639064 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:18.652341 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7356a2-2c7a-4518-8906-0eff093977a9 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:18.652635 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7356a2-2c7a-4518-8906-0eff093977a9 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:18.652917 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7356a2-2c7a-4518-8906-0eff093977a9 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:18.654449 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 516/1024] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:36:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:36:18.659445 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f52911-9614-4470-b5cb-7c045264c525 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:18.659720 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f52911-9614-4470-b5cb-7c045264c525 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:18.660004 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f52911-9614-4470-b5cb-7c045264c525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:18.676907 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-65f52911-9614-4470-b5cb-7c045264c525 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:36:18.678135 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-65f52911-9614-4470-b5cb-7c045264c525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:36:18.699618 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ca814-4445-4926-8996-ba250dc87169 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:18.743706 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7e536-90c8-445b-83d9-310646ff57ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:18.744434 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7e536-90c8-445b-83d9-310646ff57ae None admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:18.744700 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7e536-90c8-445b-83d9-310646ff57ae None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:18.744981 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7e536-90c8-445b-83d9-310646ff57ae None admin] PATH_INFO: `/v3/users` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:18.745737 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b7e536-90c8-445b-83d9-310646ff57ae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:18.747256 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b7e536-90c8-445b-83d9-310646ff57ae None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:18.754326 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 517/1025] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:36:18 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 08:36:18.771294 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 509/1026] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Jun 22 08:36:18 2022] POST /identity/v3/users => generated 285 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:36:18.783471 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f52911-9614-4470-b5cb-7c045264c525 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:18.876053 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:18.897593 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f52911-9614-4470-b5cb-7c045264c525 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:18.938478 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8fc4d2-a1a3-44fc-9bd9-4746b2aae4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:18.939643 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8fc4d2-a1a3-44fc-9bd9-4746b2aae4b8 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:18.940111 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8fc4d2-a1a3-44fc-9bd9-4746b2aae4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:18.940578 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8fc4d2-a1a3-44fc-9bd9-4746b2aae4b8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:18.952563 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8fc4d2-a1a3-44fc-9bd9-4746b2aae4b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:36:18.960870 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-8e8fc4d2-a1a3-44fc-9bd9-4746b2aae4b8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 08:36:18.960870 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:36:18.960870 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:36:18.960870 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:36:18.960870 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:36:18.960870 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:36:18.960870 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:36:18.960870 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:36:18.960870 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:36:18.960870 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:36:18.960870 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:36:18.960870 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:36:18.960870 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:36:18.960870 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:36:18.960870 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:36:18.960870 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:36:18.961827 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:36:18.961827 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:36:18.961827 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:36:18.961827 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:36:18.961827 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:36:18.961827 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:36:18.961827 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:36:18.961827 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:36:18.961827 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:36:18.961827 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:36:18.961827 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:36:18.961827 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:36:18.961827 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:36:18.961827 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:36:18.961827 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:36:18.961827 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:36:18.962732 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:36:18.962732 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:36:18.962732 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:36:18.962732 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:36:18.962732 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:36:18.962732 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:36:18.962732 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:36:18.962732 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:36:18.962732 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:36:18.962732 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:36:18.962732 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 08:36:18.962732 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:36:18.962732 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 518/1027] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Jun 22 08:36:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:36:18.968929 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7e536-90c8-445b-83d9-310646ff57ae None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:19.079779 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7e536-90c8-445b-83d9-310646ff57ae None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:19.081302 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:19.117048 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82757bbd-1e11-4be3-9a3b-5c69b4f0082e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:19.117714 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82757bbd-1e11-4be3-9a3b-5c69b4f0082e None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:19.117996 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82757bbd-1e11-4be3-9a3b-5c69b4f0082e None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:19.118300 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82757bbd-1e11-4be3-9a3b-5c69b4f0082e None admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:19.119046 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82757bbd-1e11-4be3-9a3b-5c69b4f0082e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:19.119352 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82757bbd-1e11-4be3-9a3b-5c69b4f0082e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:19.120705 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82757bbd-1e11-4be3-9a3b-5c69b4f0082e None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:19.129726 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 510/1028] 10.222.0.42 () {56 vars in 1115 bytes} [Wed Jun 22 08:36:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:36:19.135141 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8fc4d2-a1a3-44fc-9bd9-4746b2aae4b8 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:19.228489 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a6c0f-5a7a-41b7-9214-b252bd354fb9 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:19.228777 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a6c0f-5a7a-41b7-9214-b252bd354fb9 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:19.229062 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a6c0f-5a7a-41b7-9214-b252bd354fb9 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:19.230632 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 511/1029] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:36:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:36:19.236211 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfaf03-8b22-4ad3-bbef-6dbddb20ca72 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:19.236787 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfaf03-8b22-4ad3-bbef-6dbddb20ca72 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:19.236787 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfaf03-8b22-4ad3-bbef-6dbddb20ca72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:19.247274 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8fc4d2-a1a3-44fc-9bd9-4746b2aae4b8 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:19.260832 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-9fcfaf03-8b22-4ad3-bbef-6dbddb20ca72 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:36:19.262041 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-9fcfaf03-8b22-4ad3-bbef-6dbddb20ca72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:36:19.286474 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf725fc-7f74-408c-b854-25d90292c30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:19.286981 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf725fc-7f74-408c-b854-25d90292c30a None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:19.287259 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf725fc-7f74-408c-b854-25d90292c30a None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:19.287537 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf725fc-7f74-408c-b854-25d90292c30a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:19.300722 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf725fc-7f74-408c-b854-25d90292c30a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:19.303112 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf725fc-7f74-408c-b854-25d90292c30a None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:19.305316 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:19.328087 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-fcf725fc-7f74-408c-b854-25d90292c30a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:36:19.328087 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:36:19.328087 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:36:19.328087 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:36:19.328087 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:36:19.328087 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:36:19.328087 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:36:19.328087 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:36:19.328087 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:36:19.328087 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:36:19.328087 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:36:19.328087 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:36:19.328087 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:36:19.328087 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:36:19.328087 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:36:19.329897 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:36:19.329897 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:36:19.329897 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:36:19.329897 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:36:19.329897 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:36:19.329897 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:36:19.329897 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:36:19.329897 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:36:19.329897 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:36:19.329897 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:36:19.329897 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:36:19.329897 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:36:19.329897 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:36:19.329897 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:36:19.329897 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:36:19.329897 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:36:19.329897 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:36:19.331978 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:36:19.331978 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:36:19.331978 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:36:19.331978 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:36:19.331978 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 519/1030] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:36:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:36:19.334982 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf725fc-7f74-408c-b854-25d90292c30a None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:19.345561 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 512/1031] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:36:19 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 08:36:19.368657 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcfaf03-8b22-4ad3-bbef-6dbddb20ca72 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:19.458804 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf725fc-7f74-408c-b854-25d90292c30a None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:19.482369 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:19.491401 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcfaf03-8b22-4ad3-bbef-6dbddb20ca72 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:19.510940 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c7a67-6918-47ed-99ad-3e40ac5072f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:19.511627 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c7a67-6918-47ed-99ad-3e40ac5072f0 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:19.511916 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c7a67-6918-47ed-99ad-3e40ac5072f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:19.512201 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c7a67-6918-47ed-99ad-3e40ac5072f0 None admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:19.512964 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9c7a67-6918-47ed-99ad-3e40ac5072f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:19.513279 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9c7a67-6918-47ed-99ad-3e40ac5072f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:19.515325 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9c7a67-6918-47ed-99ad-3e40ac5072f0 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:19.529430 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 520/1032] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:36:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:36:19.532474 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c782c61-1990-4914-9150-bf97ecf3c5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:19.533304 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c782c61-1990-4914-9150-bf97ecf3c5e3 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:19.533594 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c782c61-1990-4914-9150-bf97ecf3c5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:19.533871 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c782c61-1990-4914-9150-bf97ecf3c5e3 None admin] PATH_INFO: `/v3/services/image` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:19.534588 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c782c61-1990-4914-9150-bf97ecf3c5e3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:19.535109 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c7a67-6918-47ed-99ad-3e40ac5072f0 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:19.536007 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c782c61-1990-4914-9150-bf97ecf3c5e3 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:19.549603 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-3c782c61-1990-4914-9150-bf97ecf3c5e3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 08:36:19.549603 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:36:19.549603 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:36:19.549603 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:36:19.549603 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:36:19.549603 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:36:19.549603 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:36:19.549603 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:36:19.549603 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 08:36:19.549603 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:36:19.549603 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:36:19.549603 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:36:19.549603 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:36:19.549603 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:36:19.549603 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:36:19.549603 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:36:19.549603 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:36:19.550803 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:36:19.550803 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:36:19.550803 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:36:19.550803 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:36:19.550803 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:36:19.550803 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:36:19.550803 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:36:19.550803 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:36:19.550803 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:36:19.550803 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:36:19.550803 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:36:19.550803 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:36:19.550803 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:36:19.550803 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:36:19.550803 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:36:19.550803 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:36:19.555195 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:36:19.555195 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:36:19.555195 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:36:19.555195 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:36:19.555195 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:36:19.555195 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:36:19.555195 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:36:19.555195 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:36:19.555195 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:36:19.555195 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:36:19.555195 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:36:19.555195 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:36:19.555195 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 08:36:19.555195 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:36:19.555195 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 513/1033] 10.222.0.42 () {56 vars in 1105 bytes} [Wed Jun 22 08:36:19 2022] GET /identity/v3/services/image => generated 86 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:36:19.557226 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c782c61-1990-4914-9150-bf97ecf3c5e3 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:19.604344 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:19.669562 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c7a67-6918-47ed-99ad-3e40ac5072f0 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:19.674287 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c782c61-1990-4914-9150-bf97ecf3c5e3 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:19.709941 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280ece8a-ad70-4aa9-9c18-035fb04c5ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:19.710949 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ece8a-ad70-4aa9-9c18-035fb04c5ad1 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:19.711234 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ece8a-ad70-4aa9-9c18-035fb04c5ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:19.711561 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ece8a-ad70-4aa9-9c18-035fb04c5ad1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:19.714615 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097131db-478a-495f-800c-8ee92815b06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:19.715293 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097131db-478a-495f-800c-8ee92815b06b None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:19.715579 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097131db-478a-495f-800c-8ee92815b06b None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:19.715858 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097131db-478a-495f-800c-8ee92815b06b None admin] PATH_INFO: `/v3/services` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:19.716584 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097131db-478a-495f-800c-8ee92815b06b None admin] RBAC: Adding query filter params (name=image) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:19.716895 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097131db-478a-495f-800c-8ee92815b06b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:19.718444 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097131db-478a-495f-800c-8ee92815b06b None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:19.721120 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280ece8a-ad70-4aa9-9c18-035fb04c5ad1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:19.722849 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280ece8a-ad70-4aa9-9c18-035fb04c5ad1 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:19.725546 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 514/1034] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:36:19 2022] GET /identity/v3/services?name=image => generated 122 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:36:19.732388 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097131db-478a-495f-800c-8ee92815b06b None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:19.751004 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-280ece8a-ad70-4aa9-9c18-035fb04c5ad1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 08:36:19.751004 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:36:19.751004 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:36:19.751004 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:36:19.751004 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:36:19.751004 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:36:19.751004 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:36:19.751004 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:36:19.751004 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:36:19.751004 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:36:19.751004 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:36:19.751004 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:36:19.751004 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:36:19.751004 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:36:19.751004 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:36:19.751004 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:36:19.752097 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:36:19.752097 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:36:19.752097 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:36:19.752097 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:36:19.752097 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:36:19.752097 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:36:19.752097 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:36:19.752097 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:36:19.752097 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:36:19.752097 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:36:19.752097 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:36:19.752097 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:36:19.752097 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:36:19.752097 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:36:19.752097 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:36:19.752097 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:36:19.752097 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:36:19.752097 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:36:19.753050 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:36:19.753050 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:36:19.753050 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:36:19.753050 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:36:19.753050 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:36:19.753050 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:36:19.753050 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:36:19.753050 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:36:19.753050 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 08:36:19.753050 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:36:19.753050 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 521/1035] 10.222.0.42 () {56 vars in 1093 bytes} [Wed Jun 22 08:36:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:36:19.758435 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280ece8a-ad70-4aa9-9c18-035fb04c5ad1 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:19.765484 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:19.853192 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097131db-478a-495f-800c-8ee92815b06b None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:19.872299 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280ece8a-ad70-4aa9-9c18-035fb04c5ad1 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:19.888988 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:19.894251 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb4e87e-ecb7-4565-8e98-2d08accf2b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:19.895149 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb4e87e-ecb7-4565-8e98-2d08accf2b39 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:19.895435 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb4e87e-ecb7-4565-8e98-2d08accf2b39 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:19.895713 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb4e87e-ecb7-4565-8e98-2d08accf2b39 None admin] PATH_INFO: `/v3/services` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:19.896435 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb4e87e-ecb7-4565-8e98-2d08accf2b39 None admin] RBAC: Adding query filter params (type=image) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:19.896739 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb4e87e-ecb7-4565-8e98-2d08accf2b39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:19.898146 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb4e87e-ecb7-4565-8e98-2d08accf2b39 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:19.903870 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 515/1036] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:36:19 2022] GET /identity/v3/services?type=image => generated 350 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:36:19.910224 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb4e87e-ecb7-4565-8e98-2d08accf2b39 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:19.914095 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00413be2-a249-407d-adec-8456844acdfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:19.914775 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00413be2-a249-407d-adec-8456844acdfa None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:19.915067 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00413be2-a249-407d-adec-8456844acdfa None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:19.915349 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00413be2-a249-407d-adec-8456844acdfa None admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:19.916201 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00413be2-a249-407d-adec-8456844acdfa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:19.916516 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00413be2-a249-407d-adec-8456844acdfa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:19.917974 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00413be2-a249-407d-adec-8456844acdfa None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:19.937583 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 522/1037] 10.222.0.42 () {56 vars in 1133 bytes} [Wed Jun 22 08:36:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:36:19.942991 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00413be2-a249-407d-adec-8456844acdfa None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:20.007305 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:20.024789 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb4e87e-ecb7-4565-8e98-2d08accf2b39 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:20.051284 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00413be2-a249-407d-adec-8456844acdfa None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:20.060710 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acdec50-3300-49e5-b64e-2fa836313a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:20.061906 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acdec50-3300-49e5-b64e-2fa836313a58 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:20.062588 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acdec50-3300-49e5-b64e-2fa836313a58 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:20.062872 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acdec50-3300-49e5-b64e-2fa836313a58 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:20.063989 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acdec50-3300-49e5-b64e-2fa836313a58 None admin] RBAC: Adding query filter params (interface=public, service_id=401152fe8161408cb8ad11f6e25d7525, region_id=RegionOne) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:20.064313 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acdec50-3300-49e5-b64e-2fa836313a58 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:20.065703 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acdec50-3300-49e5-b64e-2fa836313a58 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:20.071001 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 516/1038] 10.222.0.42 () {56 vars in 1251 bytes} [Wed Jun 22 08:36:19 2022] GET /identity/v3/endpoints?service_id=401152fe8161408cb8ad11f6e25d7525&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:36:20.076380 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acdec50-3300-49e5-b64e-2fa836313a58 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:20.096654 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da9dfe-e3e4-4c6c-9473-1f072f7ae0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:20.097306 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da9dfe-e3e4-4c6c-9473-1f072f7ae0e6 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:20.097589 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da9dfe-e3e4-4c6c-9473-1f072f7ae0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:20.097881 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da9dfe-e3e4-4c6c-9473-1f072f7ae0e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:20.146265 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:20.178582 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da9dfe-e3e4-4c6c-9473-1f072f7ae0e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:20.180194 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da9dfe-e3e4-4c6c-9473-1f072f7ae0e6 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:20.187334 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acdec50-3300-49e5-b64e-2fa836313a58 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:20.222402 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d800835f-ae30-4a12-b0ac-71d05e1d8474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:20.223067 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d800835f-ae30-4a12-b0ac-71d05e1d8474 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:20.223354 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d800835f-ae30-4a12-b0ac-71d05e1d8474 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:20.223631 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d800835f-ae30-4a12-b0ac-71d05e1d8474 None admin] PATH_INFO: `/v3/services` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:20.224311 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d800835f-ae30-4a12-b0ac-71d05e1d8474 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:20.225695 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d800835f-ae30-4a12-b0ac-71d05e1d8474 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:20.232495 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 517/1039] 10.222.0.42 () {56 vars in 1087 bytes} [Wed Jun 22 08:36:20 2022] GET /identity/v3/services => generated 1957 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 08:36:20.307498 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 523/1040] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Jun 22 08:36:19 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 22 08:36:20.313782 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d800835f-ae30-4a12-b0ac-71d05e1d8474 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:20.331471 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:20.427037 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d800835f-ae30-4a12-b0ac-71d05e1d8474 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:20.463655 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e23d0-ab31-4af3-a62a-f6a6898fce92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:20.464605 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e23d0-ab31-4af3-a62a-f6a6898fce92 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:20.464897 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e23d0-ab31-4af3-a62a-f6a6898fce92 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:20.465176 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e23d0-ab31-4af3-a62a-f6a6898fce92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:20.476475 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9e23d0-ab31-4af3-a62a-f6a6898fce92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:20.477926 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9e23d0-ab31-4af3-a62a-f6a6898fce92 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:20.496286 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-ad9e23d0-ab31-4af3-a62a-f6a6898fce92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:36:20.496286 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:36:20.496286 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:36:20.496286 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:36:20.496286 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:36:20.496286 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:36:20.496286 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:36:20.496286 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:36:20.496286 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:36:20.496286 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:36:20.496286 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:36:20.496286 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:36:20.496286 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:36:20.496286 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:36:20.496286 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:36:20.497325 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:36:20.497325 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:36:20.497325 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:36:20.497325 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:36:20.497325 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:36:20.497325 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:36:20.497325 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:36:20.497325 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:36:20.497325 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:36:20.497325 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:36:20.497325 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:36:20.497325 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:36:20.497325 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:36:20.497325 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:36:20.497325 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:36:20.497325 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:36:20.497325 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:36:20.498262 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:36:20.498262 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:36:20.498262 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:36:20.498262 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:36:20.498262 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 518/1041] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:36:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:36:20.504680 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da9dfe-e3e4-4c6c-9473-1f072f7ae0e6 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:20.577653 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:20.609695 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da9dfe-e3e4-4c6c-9473-1f072f7ae0e6 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:20.645537 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d3ee5-351f-48e9-bbf9-4d4b5c29b172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:20.646231 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d3ee5-351f-48e9-bbf9-4d4b5c29b172 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:20.646520 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d3ee5-351f-48e9-bbf9-4d4b5c29b172 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:20.646799 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d3ee5-351f-48e9-bbf9-4d4b5c29b172 None admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:20.647529 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d3ee5-351f-48e9-bbf9-4d4b5c29b172 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:20.647839 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d3ee5-351f-48e9-bbf9-4d4b5c29b172 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:20.649207 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d3ee5-351f-48e9-bbf9-4d4b5c29b172 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:20.665577 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 524/1042] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:36:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:36:20.666873 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e23d0-ab31-4af3-a62a-f6a6898fce92 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:20.736445 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:20.773004 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e23d0-ab31-4af3-a62a-f6a6898fce92 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:20.808608 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387b5a74-4a19-4d99-bda3-424fc1e21e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:20.809396 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b5a74-4a19-4d99-bda3-424fc1e21e10 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:20.809685 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b5a74-4a19-4d99-bda3-424fc1e21e10 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:20.809963 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b5a74-4a19-4d99-bda3-424fc1e21e10 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:20.817386 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387b5a74-4a19-4d99-bda3-424fc1e21e10 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:20.818841 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387b5a74-4a19-4d99-bda3-424fc1e21e10 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:20.832988 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-387b5a74-4a19-4d99-bda3-424fc1e21e10 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:36:20.832988 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:36:20.832988 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:36:20.832988 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:36:20.832988 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:36:20.832988 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:36:20.832988 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:36:20.832988 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:36:20.832988 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:36:20.832988 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:36:20.832988 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:36:20.832988 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:36:20.832988 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:36:20.832988 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:36:20.832988 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:36:20.833904 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:36:20.833904 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:36:20.833904 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:36:20.833904 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:36:20.833904 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:36:20.833904 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:36:20.833904 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:36:20.833904 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:36:20.833904 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:36:20.833904 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:36:20.833904 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:36:20.833904 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:36:20.833904 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:36:20.833904 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:36:20.833904 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:36:20.833904 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:36:20.833904 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:36:20.834832 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:36:20.834832 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:36:20.834832 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:36:20.834832 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:36:20.834832 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:36:20.834832 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:36:20.834832 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:36:20.834832 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:36:20.834832 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 519/1043] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Jun 22 08:36:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:36:20.841163 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d3ee5-351f-48e9-bbf9-4d4b5c29b172 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:20.943254 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d3ee5-351f-48e9-bbf9-4d4b5c29b172 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:20.974739 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:20.981266 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eecf18-796b-4412-bfc0-8e72bdd6409d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:20.981938 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eecf18-796b-4412-bfc0-8e72bdd6409d None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:20.982252 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eecf18-796b-4412-bfc0-8e72bdd6409d None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:20.982530 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eecf18-796b-4412-bfc0-8e72bdd6409d None admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:20.983877 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eecf18-796b-4412-bfc0-8e72bdd6409d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:20.984186 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eecf18-796b-4412-bfc0-8e72bdd6409d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:20.985634 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eecf18-796b-4412-bfc0-8e72bdd6409d None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:20.998206 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 525/1044] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Jun 22 08:36:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:36:21.004910 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387b5a74-4a19-4d99-bda3-424fc1e21e10 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:21.107584 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387b5a74-4a19-4d99-bda3-424fc1e21e10 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:21.133083 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:21.143183 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8875ca7-5e2c-4927-a6b5-2e44500e85cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:21.144208 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8875ca7-5e2c-4927-a6b5-2e44500e85cf None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:21.144498 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8875ca7-5e2c-4927-a6b5-2e44500e85cf None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:21.144778 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8875ca7-5e2c-4927-a6b5-2e44500e85cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:21.145660 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8875ca7-5e2c-4927-a6b5-2e44500e85cf None admin] RBAC: Adding query filter params (role.id=334470a0bef9496daf19b5fe65d90c64, scope.project.id=e1f161193cb440fa8c4a9d23820a5c28, user.id=4f1809a35b244c1db7a185d82859369e) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:21.145979 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8875ca7-5e2c-4927-a6b5-2e44500e85cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:21.147438 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8875ca7-5e2c-4927-a6b5-2e44500e85cf None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:21.158150 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 520/1045] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Jun 22 08:36:21 2022] GET /identity/v3/role_assignments?user.id=4f1809a35b244c1db7a185d82859369e&scope.project.id=e1f161193cb440fa8c4a9d23820a5c28&role.id=334470a0bef9496daf19b5fe65d90c64 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:36:21.348006 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d2753-4629-4b1c-8a68-e358d340d0b5 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:21.348349 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d2753-4629-4b1c-8a68-e358d340d0b5 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:21.348580 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d2753-4629-4b1c-8a68-e358d340d0b5 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:21.350220 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 526/1046] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:36:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:36:21.355905 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b01f5-c26d-4434-b03b-207cf709be0d None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:21.356202 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b01f5-c26d-4434-b03b-207cf709be0d None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:21.356482 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b01f5-c26d-4434-b03b-207cf709be0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:21.373683 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-381b01f5-c26d-4434-b03b-207cf709be0d None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:36:21.374920 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-381b01f5-c26d-4434-b03b-207cf709be0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:36:21.444782 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 521/1047] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:36:21 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:36:21.469481 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d2753-4629-4b1c-8a68-e358d340d0b5 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:21.576328 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d2753-4629-4b1c-8a68-e358d340d0b5 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:21.613921 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a094e-e55e-4ade-a303-d4825cbeb02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:21.614737 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a094e-e55e-4ade-a303-d4825cbeb02a None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:21.615025 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a094e-e55e-4ade-a303-d4825cbeb02a None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:21.615300 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a094e-e55e-4ade-a303-d4825cbeb02a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:21.625924 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7a094e-e55e-4ade-a303-d4825cbeb02a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:36:21.633409 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-5c7a094e-e55e-4ade-a303-d4825cbeb02a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:36:21.633409 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:36:21.633409 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:36:21.633409 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:36:21.633409 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:36:21.633409 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:36:21.633409 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:36:21.633409 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:36:21.633409 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:36:21.633409 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:36:21.633409 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:36:21.633409 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:36:21.633409 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:36:21.633409 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:36:21.633409 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:36:21.633409 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:36:21.634392 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:36:21.634392 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:36:21.634392 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:36:21.634392 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:36:21.634392 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:36:21.634392 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:36:21.634392 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:36:21.634392 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:36:21.634392 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:36:21.634392 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:36:21.634392 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:36:21.634392 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:36:21.634392 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:36:21.634392 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:36:21.634392 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:36:21.634392 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:36:21.641104 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:36:21.641104 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:36:21.641104 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:36:21.641104 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:36:21.641104 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:36:21.641104 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:36:21.641104 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:36:21.641104 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:36:21.641104 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:36:21.641104 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:36:21.641104 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:36:21.641104 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:36:21.641104 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 527/1048] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Jun 22 08:36:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:36:21.641812 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b01f5-c26d-4434-b03b-207cf709be0d None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:21.742271 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b01f5-c26d-4434-b03b-207cf709be0d None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:21.763162 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:21.779494 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e5d926-9ff2-43df-a429-01f75accc61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:21.780198 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5d926-9ff2-43df-a429-01f75accc61f None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:21.780487 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5d926-9ff2-43df-a429-01f75accc61f None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:21.780767 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5d926-9ff2-43df-a429-01f75accc61f None admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:21.781519 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e5d926-9ff2-43df-a429-01f75accc61f None admin] RBAC: Adding query filter params (name=admin) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:21.781829 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e5d926-9ff2-43df-a429-01f75accc61f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:21.783246 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e5d926-9ff2-43df-a429-01f75accc61f None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:21.796487 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 522/1049] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Jun 22 08:36:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:36:21.798005 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a094e-e55e-4ade-a303-d4825cbeb02a None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:21.852986 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:21.903403 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a094e-e55e-4ade-a303-d4825cbeb02a None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:21.937529 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82add7d-3f56-4c69-808a-11f9618c85a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:21.938424 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82add7d-3f56-4c69-808a-11f9618c85a6 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:21.938711 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82add7d-3f56-4c69-808a-11f9618c85a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:21.938990 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82add7d-3f56-4c69-808a-11f9618c85a6 None admin] PATH_INFO: `/v3/users/1331600c03754f04ae65e2559fb27069` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:21.953029 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82add7d-3f56-4c69-808a-11f9618c85a6 None admin] RBAC: Authorizing `identity:get_user(user_id=1331600c03754f04ae65e2559fb27069)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:21.954516 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82add7d-3f56-4c69-808a-11f9618c85a6 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:21.956378 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 528/1050] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Jun 22 08:36:21 2022] GET /identity/v3/users/1331600c03754f04ae65e2559fb27069 => generated 285 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:36:21.961923 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e5d926-9ff2-43df-a429-01f75accc61f None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:22.065249 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e5d926-9ff2-43df-a429-01f75accc61f None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:22.099948 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d2609e-aa36-41ff-b3e0-56621605f250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:22.100602 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2609e-aa36-41ff-b3e0-56621605f250 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:22.100887 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2609e-aa36-41ff-b3e0-56621605f250 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:22.101165 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2609e-aa36-41ff-b3e0-56621605f250 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:22.151206 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:22.171724 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d2609e-aa36-41ff-b3e0-56621605f250 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:22.173183 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d2609e-aa36-41ff-b3e0-56621605f250 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:22.284180 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 523/1051] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Jun 22 08:36:21 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 08:36:22.290172 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82add7d-3f56-4c69-808a-11f9618c85a6 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:22.290919 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f98ad4-e1f5-4c2a-a236-7960c3495700 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:22.291221 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f98ad4-e1f5-4c2a-a236-7960c3495700 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:22.291504 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f98ad4-e1f5-4c2a-a236-7960c3495700 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:22.293023 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 524/1052] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:36:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:36:22.298876 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9fdbd4-b2a5-45c9-a53f-077dacddd634 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:22.299168 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9fdbd4-b2a5-45c9-a53f-077dacddd634 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:22.299452 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9fdbd4-b2a5-45c9-a53f-077dacddd634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:22.319489 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-3e9fdbd4-b2a5-45c9-a53f-077dacddd634 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:36:22.320690 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-3e9fdbd4-b2a5-45c9-a53f-077dacddd634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:36:22.399131 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 525/1053] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:36:22 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 08:36:22.409930 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82add7d-3f56-4c69-808a-11f9618c85a6 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:22.421998 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:22.442479 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9fdbd4-b2a5-45c9-a53f-077dacddd634 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:22.446837 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523dcd7d-8ed9-4797-940c-e8c04cd0c393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:22.447692 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523dcd7d-8ed9-4797-940c-e8c04cd0c393 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:22.448754 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523dcd7d-8ed9-4797-940c-e8c04cd0c393 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:22.449053 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523dcd7d-8ed9-4797-940c-e8c04cd0c393 None admin] PATH_INFO: `/v3/projects/ed25c8ba9ef240d6a532935178db1e3b` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:22.450293 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523dcd7d-8ed9-4797-940c-e8c04cd0c393 None admin] RBAC: Authorizing `identity:get_project(project_id=ed25c8ba9ef240d6a532935178db1e3b)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:22.451777 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523dcd7d-8ed9-4797-940c-e8c04cd0c393 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:22.453445 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 529/1054] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Jun 22 08:36:22 2022] GET /identity/v3/projects/ed25c8ba9ef240d6a532935178db1e3b => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:36:22.462796 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:22.463413 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523dcd7d-8ed9-4797-940c-e8c04cd0c393 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:22.555571 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9fdbd4-b2a5-45c9-a53f-077dacddd634 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:22.587380 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523dcd7d-8ed9-4797-940c-e8c04cd0c393 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:22.590573 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693fbd5b-6ed7-43b0-92fb-7481a1f2d168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:22.591454 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fbd5b-6ed7-43b0-92fb-7481a1f2d168 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:22.591742 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fbd5b-6ed7-43b0-92fb-7481a1f2d168 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:22.592019 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fbd5b-6ed7-43b0-92fb-7481a1f2d168 None admin] PATH_INFO: `/v3/services/image` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:22.592715 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693fbd5b-6ed7-43b0-92fb-7481a1f2d168 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:22.594107 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693fbd5b-6ed7-43b0-92fb-7481a1f2d168 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:22.606226 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-693fbd5b-6ed7-43b0-92fb-7481a1f2d168 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 08:36:22.606226 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:36:22.606226 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:36:22.606226 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:36:22.606226 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:36:22.606226 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:36:22.606226 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:36:22.606226 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:36:22.606226 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 08:36:22.606226 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:36:22.606226 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:36:22.606226 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:36:22.606226 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:36:22.606226 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:36:22.606226 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:36:22.606226 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:36:22.606226 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:36:22.607270 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:36:22.607270 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:36:22.607270 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:36:22.607270 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:36:22.607270 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:36:22.607270 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:36:22.607270 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:36:22.607270 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:36:22.607270 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:36:22.607270 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:36:22.607270 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:36:22.607270 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:36:22.607270 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:36:22.607270 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:36:22.607270 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:36:22.607270 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:36:22.608645 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:36:22.608645 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:36:22.608645 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:36:22.608645 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:36:22.608645 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:36:22.608645 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:36:22.608645 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:36:22.608645 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:36:22.608645 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:36:22.608645 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:36:22.608645 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:36:22.608645 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:36:22.608645 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 08:36:22.608645 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:36:22.608645 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 526/1055] 10.222.0.42 () {56 vars in 1105 bytes} [Wed Jun 22 08:36:22 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:36:22.614345 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693fbd5b-6ed7-43b0-92fb-7481a1f2d168 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:22.630943 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fe733b-3582-4c10-971c-57adad8d942b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:22.632054 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe733b-3582-4c10-971c-57adad8d942b None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:22.632526 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe733b-3582-4c10-971c-57adad8d942b None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:22.632975 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe733b-3582-4c10-971c-57adad8d942b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:22.634159 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fe733b-3582-4c10-971c-57adad8d942b None admin] RBAC: Adding query filter params (role.id=c7518e0f532945af80c33860f2ac506d, scope.project.id=ed25c8ba9ef240d6a532935178db1e3b, user.id=1331600c03754f04ae65e2559fb27069) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:22.634761 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fe733b-3582-4c10-971c-57adad8d942b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:22.636408 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fe733b-3582-4c10-971c-57adad8d942b None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:22.645551 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 530/1056] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Jun 22 08:36:22 2022] GET /identity/v3/role_assignments?user.id=1331600c03754f04ae65e2559fb27069&scope.project.id=ed25c8ba9ef240d6a532935178db1e3b&role.id=c7518e0f532945af80c33860f2ac506d => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:36:22.708044 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:22.737117 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693fbd5b-6ed7-43b0-92fb-7481a1f2d168 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:22.774026 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2935f29-53b8-45b2-b14b-48a0864b71c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:22.774733 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2935f29-53b8-45b2-b14b-48a0864b71c4 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:22.775020 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2935f29-53b8-45b2-b14b-48a0864b71c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:22.775302 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2935f29-53b8-45b2-b14b-48a0864b71c4 None admin] PATH_INFO: `/v3/services` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:22.776035 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2935f29-53b8-45b2-b14b-48a0864b71c4 None admin] RBAC: Adding query filter params (name=image) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:22.776345 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2935f29-53b8-45b2-b14b-48a0864b71c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:22.777746 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2935f29-53b8-45b2-b14b-48a0864b71c4 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:22.788074 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 527/1057] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:36:22 2022] GET /identity/v3/services?name=image => generated 122 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:36:22.789460 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fe733b-3582-4c10-971c-57adad8d942b None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:22.838292 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:22.908443 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fe733b-3582-4c10-971c-57adad8d942b None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:22.944655 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e25e0-c6bb-49b6-a4c4-3f59874857b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:22.945585 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e25e0-c6bb-49b6-a4c4-3f59874857b8 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:22.946050 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e25e0-c6bb-49b6-a4c4-3f59874857b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:22.946531 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e25e0-c6bb-49b6-a4c4-3f59874857b8 None admin] PATH_INFO: `/v3/services` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:22.947409 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60e25e0-c6bb-49b6-a4c4-3f59874857b8 None admin] RBAC: Adding query filter params (type=image) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:22.947875 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60e25e0-c6bb-49b6-a4c4-3f59874857b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:22.949436 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60e25e0-c6bb-49b6-a4c4-3f59874857b8 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:22.955589 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 531/1058] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:36:22 2022] GET /identity/v3/services?type=image => generated 350 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:36:22.961416 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2935f29-53b8-45b2-b14b-48a0864b71c4 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:23.065529 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2935f29-53b8-45b2-b14b-48a0864b71c4 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:23.100748 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318cfda9-77b4-428f-8bc7-1cdcfc9f7134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:23.101491 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318cfda9-77b4-428f-8bc7-1cdcfc9f7134 None admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:23.101786 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318cfda9-77b4-428f-8bc7-1cdcfc9f7134 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:23.102146 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318cfda9-77b4-428f-8bc7-1cdcfc9f7134 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:23.102866 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318cfda9-77b4-428f-8bc7-1cdcfc9f7134 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:23.104256 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318cfda9-77b4-428f-8bc7-1cdcfc9f7134 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:23.112989 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:23.130120 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 528/1059] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Jun 22 08:36:22 2022] POST /identity/v3/endpoints => generated 327 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:36:23.193439 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e35d1-14b2-4e05-beb8-c72e7b3131b7 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:23.193721 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e35d1-14b2-4e05-beb8-c72e7b3131b7 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:23.193996 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e35d1-14b2-4e05-beb8-c72e7b3131b7 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:23.195428 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 532/1060] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:36:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:36:23.201544 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2e4f7-bfca-4b6f-b99a-10ea4dc3b035 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:23.201994 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2e4f7-bfca-4b6f-b99a-10ea4dc3b035 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:23.202864 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2e4f7-bfca-4b6f-b99a-10ea4dc3b035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:23.220951 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-ada2e4f7-bfca-4b6f-b99a-10ea4dc3b035 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:36:23.222137 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-ada2e4f7-bfca-4b6f-b99a-10ea4dc3b035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:36:23.312802 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 529/1061] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:36:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 08:36:23.336567 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e35d1-14b2-4e05-beb8-c72e7b3131b7 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:23.448919 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e35d1-14b2-4e05-beb8-c72e7b3131b7 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:23.457131 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:23.486715 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4853cb30-e113-4020-9668-ba4a8738cca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:23.487429 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853cb30-e113-4020-9668-ba4a8738cca1 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:23.487730 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853cb30-e113-4020-9668-ba4a8738cca1 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:23.487988 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853cb30-e113-4020-9668-ba4a8738cca1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:23.504925 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4853cb30-e113-4020-9668-ba4a8738cca1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:36:23.519731 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-4853cb30-e113-4020-9668-ba4a8738cca1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 08:36:23.519731 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:36:23.519731 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:36:23.519731 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:36:23.519731 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:36:23.519731 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:36:23.519731 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:36:23.519731 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:36:23.519731 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:36:23.519731 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:36:23.519731 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:36:23.519731 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:36:23.519731 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:36:23.519731 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:36:23.519731 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:36:23.519731 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:36:23.520735 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:36:23.520735 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:36:23.520735 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:36:23.520735 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:36:23.520735 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:36:23.520735 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:36:23.520735 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:36:23.520735 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:36:23.520735 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:36:23.520735 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:36:23.520735 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:36:23.520735 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:36:23.520735 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:36:23.520735 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:36:23.520735 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:36:23.520735 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:36:23.521543 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:36:23.521543 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:36:23.521543 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:36:23.521543 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:36:23.521543 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:36:23.521543 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:36:23.521543 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:36:23.521543 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:36:23.521543 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:36:23.521543 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:36:23.521543 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 08:36:23.521543 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:36:23.522843 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 533/1062] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Jun 22 08:36:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:36:23.528308 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada2e4f7-bfca-4b6f-b99a-10ea4dc3b035 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:23.637439 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada2e4f7-bfca-4b6f-b99a-10ea4dc3b035 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:23.664328 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:23.677249 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582a58c2-563d-4323-957a-dc710bf94a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:23.678019 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a58c2-563d-4323-957a-dc710bf94a56 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:23.679095 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a58c2-563d-4323-957a-dc710bf94a56 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:23.679095 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a58c2-563d-4323-957a-dc710bf94a56 None admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:23.679262 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582a58c2-563d-4323-957a-dc710bf94a56 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:23.680139 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582a58c2-563d-4323-957a-dc710bf94a56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:23.680908 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582a58c2-563d-4323-957a-dc710bf94a56 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:23.691949 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 530/1063] 10.222.0.42 () {56 vars in 1115 bytes} [Wed Jun 22 08:36:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:36:23.697736 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4853cb30-e113-4020-9668-ba4a8738cca1 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:23.804825 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4853cb30-e113-4020-9668-ba4a8738cca1 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:23.840531 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fd98b9-b8cb-46ff-8eb5-3a362ada5a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:23.841329 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd98b9-b8cb-46ff-8eb5-3a362ada5a4e None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:23.841614 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd98b9-b8cb-46ff-8eb5-3a362ada5a4e None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:23.841893 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd98b9-b8cb-46ff-8eb5-3a362ada5a4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:23.853398 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fd98b9-b8cb-46ff-8eb5-3a362ada5a4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:23.854877 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fd98b9-b8cb-46ff-8eb5-3a362ada5a4e None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:23.872426 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-f3fd98b9-b8cb-46ff-8eb5-3a362ada5a4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:36:23.872426 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:36:23.872426 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:36:23.872426 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:36:23.872426 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:36:23.872426 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:36:23.872426 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:36:23.872426 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:36:23.872426 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:36:23.872426 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:36:23.872426 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:36:23.872426 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:36:23.872426 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:36:23.872426 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:36:23.872426 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:36:23.873415 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:36:23.873415 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:36:23.873415 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:36:23.873415 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:36:23.873415 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:36:23.873415 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:36:23.873415 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:36:23.873415 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:36:23.873415 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:36:23.873415 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:36:23.873415 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:36:23.873415 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:36:23.873415 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:36:23.873415 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:36:23.873415 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:36:23.873415 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:36:23.873415 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:36:23.875078 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:36:23.875078 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:36:23.875078 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:36:23.875078 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:36:23.878147 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 534/1064] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:36:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:36:23.879726 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582a58c2-563d-4323-957a-dc710bf94a56 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:23.982726 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582a58c2-563d-4323-957a-dc710bf94a56 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:24.016569 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae5ca7-c797-4277-a6e1-e5ff1b16f859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:24.017229 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae5ca7-c797-4277-a6e1-e5ff1b16f859 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:24.017514 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae5ca7-c797-4277-a6e1-e5ff1b16f859 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:24.017789 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae5ca7-c797-4277-a6e1-e5ff1b16f859 None admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:24.018803 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae5ca7-c797-4277-a6e1-e5ff1b16f859 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:24.019110 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae5ca7-c797-4277-a6e1-e5ff1b16f859 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:24.020460 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae5ca7-c797-4277-a6e1-e5ff1b16f859 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:24.032922 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 531/1065] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:36:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:36:24.038480 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fd98b9-b8cb-46ff-8eb5-3a362ada5a4e None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:24.058908 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:24.147321 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fd98b9-b8cb-46ff-8eb5-3a362ada5a4e None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:24.181638 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba94fc-a711-4d24-a16e-90dc98414fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:24.182460 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba94fc-a711-4d24-a16e-90dc98414fb8 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:24.182745 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba94fc-a711-4d24-a16e-90dc98414fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:24.183018 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba94fc-a711-4d24-a16e-90dc98414fb8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:24.190801 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bba94fc-a711-4d24-a16e-90dc98414fb8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:24.192242 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bba94fc-a711-4d24-a16e-90dc98414fb8 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:24.206759 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-6bba94fc-a711-4d24-a16e-90dc98414fb8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 08:36:24.206759 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:36:24.206759 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:36:24.206759 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:36:24.206759 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:36:24.206759 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:36:24.206759 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:36:24.206759 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:36:24.206759 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:36:24.206759 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:36:24.206759 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:36:24.206759 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:36:24.206759 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:36:24.206759 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:36:24.206759 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:36:24.206759 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:36:24.207750 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:36:24.207750 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:36:24.207750 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:36:24.207750 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:36:24.207750 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:36:24.207750 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:36:24.207750 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:36:24.207750 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:36:24.207750 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:36:24.207750 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:36:24.207750 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:36:24.207750 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:36:24.207750 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:36:24.207750 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:36:24.207750 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:36:24.207750 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:36:24.207750 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:36:24.207750 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:36:24.208665 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:36:24.208665 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:36:24.208665 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:36:24.208665 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:36:24.208665 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:36:24.208665 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:36:24.208665 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:36:24.208665 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:36:24.208665 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 08:36:24.208665 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:36:24.210201 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 535/1066] 10.222.0.42 () {56 vars in 1093 bytes} [Wed Jun 22 08:36:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:36:24.214144 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae5ca7-c797-4277-a6e1-e5ff1b16f859 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:24.271230 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:24.329944 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae5ca7-c797-4277-a6e1-e5ff1b16f859 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:24.364175 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa8c83-8488-4a4b-ad69-c29eaf3ce494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:24.364849 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa8c83-8488-4a4b-ad69-c29eaf3ce494 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:24.365133 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa8c83-8488-4a4b-ad69-c29eaf3ce494 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:24.365413 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa8c83-8488-4a4b-ad69-c29eaf3ce494 None admin] PATH_INFO: `/v3/users` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:24.366274 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aa8c83-8488-4a4b-ad69-c29eaf3ce494 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:24.366588 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aa8c83-8488-4a4b-ad69-c29eaf3ce494 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:24.368011 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aa8c83-8488-4a4b-ad69-c29eaf3ce494 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:24.385748 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 532/1067] 10.222.0.42 () {56 vars in 1133 bytes} [Wed Jun 22 08:36:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:36:24.391812 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba94fc-a711-4d24-a16e-90dc98414fb8 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:24.472101 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:24.499562 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba94fc-a711-4d24-a16e-90dc98414fb8 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:24.533841 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf35e6-6fb2-4dcf-ad22-44c5c48ccf46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:24.534666 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf35e6-6fb2-4dcf-ad22-44c5c48ccf46 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:24.534955 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf35e6-6fb2-4dcf-ad22-44c5c48ccf46 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:24.535231 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf35e6-6fb2-4dcf-ad22-44c5c48ccf46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:24.546600 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaf35e6-6fb2-4dcf-ad22-44c5c48ccf46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:24.548060 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaf35e6-6fb2-4dcf-ad22-44c5c48ccf46 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:24.565366 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-bbaf35e6-6fb2-4dcf-ad22-44c5c48ccf46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:36:24.565366 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:36:24.565366 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:36:24.565366 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:36:24.565366 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:36:24.565366 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:36:24.565366 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:36:24.565366 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:36:24.565366 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:36:24.565366 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:36:24.565366 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:36:24.565366 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:36:24.565366 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:36:24.565366 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:36:24.565366 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:36:24.566350 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:36:24.566350 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:36:24.566350 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:36:24.566350 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:36:24.566350 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:36:24.566350 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:36:24.566350 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:36:24.566350 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:36:24.566350 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:36:24.566350 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:36:24.566350 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:36:24.566350 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:36:24.566350 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:36:24.566350 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:36:24.566350 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:36:24.566350 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:36:24.566350 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:36:24.567254 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:36:24.567254 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:36:24.567254 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:36:24.567254 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:36:24.570161 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 536/1068] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:36:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:36:24.572591 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa8c83-8488-4a4b-ad69-c29eaf3ce494 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:24.680055 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa8c83-8488-4a4b-ad69-c29eaf3ce494 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:24.681669 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:24.716683 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3d0949-a27e-418f-82ca-3cb1353678ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:24.717842 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d0949-a27e-418f-82ca-3cb1353678ef None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:24.718201 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d0949-a27e-418f-82ca-3cb1353678ef None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:24.718435 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d0949-a27e-418f-82ca-3cb1353678ef None admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:24.718786 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31f38b-c1f4-476b-a52a-6209b9e0b672 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:24.719211 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31f38b-c1f4-476b-a52a-6209b9e0b672 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:24.719284 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3d0949-a27e-418f-82ca-3cb1353678ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:24.719353 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31f38b-c1f4-476b-a52a-6209b9e0b672 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:24.719539 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3d0949-a27e-418f-82ca-3cb1353678ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:24.720846 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 537/1069] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:36:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:36:24.720950 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3d0949-a27e-418f-82ca-3cb1353678ef None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:24.725778 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff624208-eb97-405c-b377-824b3dbb32b1 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:24.726062 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff624208-eb97-405c-b377-824b3dbb32b1 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:24.726376 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff624208-eb97-405c-b377-824b3dbb32b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:24.733825 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 533/1070] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:36:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:36:24.739330 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3d0949-a27e-418f-82ca-3cb1353678ef None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:24.744214 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-ff624208-eb97-405c-b377-824b3dbb32b1 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:36:24.745416 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-ff624208-eb97-405c-b377-824b3dbb32b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:36:24.817248 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 538/1071] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:36:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 08:36:24.843869 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff624208-eb97-405c-b377-824b3dbb32b1 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:24.849013 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3d0949-a27e-418f-82ca-3cb1353678ef None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:24.885311 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029da7d-f256-4c0f-ad72-680c160eba4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:24.886121 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029da7d-f256-4c0f-ad72-680c160eba4f None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:24.886410 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029da7d-f256-4c0f-ad72-680c160eba4f None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:24.886686 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029da7d-f256-4c0f-ad72-680c160eba4f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:24.893873 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6029da7d-f256-4c0f-ad72-680c160eba4f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:24.895329 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6029da7d-f256-4c0f-ad72-680c160eba4f None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:24.909691 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-6029da7d-f256-4c0f-ad72-680c160eba4f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:36:24.909691 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:36:24.909691 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:36:24.909691 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:36:24.909691 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:36:24.909691 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:36:24.909691 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:36:24.909691 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:36:24.909691 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:36:24.909691 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:36:24.909691 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:36:24.909691 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:36:24.909691 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:36:24.909691 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:36:24.909691 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:36:24.910936 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:36:24.910936 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:36:24.910936 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:36:24.910936 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:36:24.910936 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:36:24.910936 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:36:24.910936 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:36:24.910936 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:36:24.910936 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:36:24.910936 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:36:24.910936 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:36:24.910936 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:36:24.910936 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:36:24.910936 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:36:24.910936 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:36:24.910936 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:36:24.910936 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:36:24.912012 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:36:24.912012 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:36:24.912012 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:36:24.912012 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:36:24.912012 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:36:24.912012 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:36:24.912012 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:36:24.912012 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:36:24.912012 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 534/1072] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Jun 22 08:36:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:36:24.915937 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:24.916582 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029da7d-f256-4c0f-ad72-680c160eba4f None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:24.944276 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:24.961872 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff624208-eb97-405c-b377-824b3dbb32b1 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:25.000481 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c92ee5-6316-412a-9702-be80da11d9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:25.001286 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c92ee5-6316-412a-9702-be80da11d9d0 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:25.001567 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c92ee5-6316-412a-9702-be80da11d9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:25.001850 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c92ee5-6316-412a-9702-be80da11d9d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:25.012678 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c92ee5-6316-412a-9702-be80da11d9d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:36:25.022391 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-80c92ee5-6316-412a-9702-be80da11d9d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:36:25.022391 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:36:25.022391 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:36:25.022391 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:36:25.022391 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:36:25.022391 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:36:25.022391 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:36:25.022391 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:36:25.022391 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:36:25.022391 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:36:25.022391 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:36:25.022391 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:36:25.022391 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:36:25.022391 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:36:25.022391 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:36:25.022391 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:36:25.023504 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:36:25.023504 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:36:25.023504 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:36:25.023504 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:36:25.023504 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:36:25.023504 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:36:25.023504 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:36:25.023504 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:36:25.023504 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:36:25.023504 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:36:25.023504 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:36:25.023504 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:36:25.023504 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:36:25.023504 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:36:25.023504 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:36:25.023504 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:36:25.024680 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:36:25.024680 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:36:25.024680 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:36:25.024680 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:36:25.024680 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:36:25.024680 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:36:25.024680 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:36:25.024680 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:36:25.024680 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:36:25.024680 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:36:25.024680 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:36:25.024680 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:36:25.024680 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 539/1073] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Jun 22 08:36:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:36:25.029510 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c92ee5-6316-412a-9702-be80da11d9d0 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:25.030417 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029da7d-f256-4c0f-ad72-680c160eba4f None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:25.068071 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2101f44f-6cb7-4e43-b36b-63c34e090989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:25.068978 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101f44f-6cb7-4e43-b36b-63c34e090989 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:25.069421 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101f44f-6cb7-4e43-b36b-63c34e090989 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:25.069707 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101f44f-6cb7-4e43-b36b-63c34e090989 None admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:25.070541 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2101f44f-6cb7-4e43-b36b-63c34e090989 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:25.070853 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2101f44f-6cb7-4e43-b36b-63c34e090989 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:25.072449 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2101f44f-6cb7-4e43-b36b-63c34e090989 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:25.089364 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 535/1074] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Jun 22 08:36:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:36:25.090426 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2101f44f-6cb7-4e43-b36b-63c34e090989 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:25.140809 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c92ee5-6316-412a-9702-be80da11d9d0 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:25.163814 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:25.180991 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03bbe19-9387-4f61-baa5-663c76c65a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:25.181886 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03bbe19-9387-4f61-baa5-663c76c65a64 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:25.182296 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03bbe19-9387-4f61-baa5-663c76c65a64 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:25.182674 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03bbe19-9387-4f61-baa5-663c76c65a64 None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:25.183538 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03bbe19-9387-4f61-baa5-663c76c65a64 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:25.183946 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03bbe19-9387-4f61-baa5-663c76c65a64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:25.185471 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03bbe19-9387-4f61-baa5-663c76c65a64 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:25.185994 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:25.199938 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 540/1075] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Jun 22 08:36:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:36:25.201276 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03bbe19-9387-4f61-baa5-663c76c65a64 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:25.207245 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2101f44f-6cb7-4e43-b36b-63c34e090989 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:25.245856 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9a162-6e94-4134-9193-fc0fc2e28c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:25.247168 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9a162-6e94-4134-9193-fc0fc2e28c02 None admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:25.247799 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9a162-6e94-4134-9193-fc0fc2e28c02 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:25.248093 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9a162-6e94-4134-9193-fc0fc2e28c02 None admin] PATH_INFO: `/v3/projects/e1f161193cb440fa8c4a9d23820a5c28/users/4f1809a35b244c1db7a185d82859369e/roles/334470a0bef9496daf19b5fe65d90c64` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:25.251460 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d9a162-6e94-4134-9193-fc0fc2e28c02 None admin] RBAC: Authorizing `identity:create_grant(project_id=e1f161193cb440fa8c4a9d23820a5c28, user_id=4f1809a35b244c1db7a185d82859369e, role_id=334470a0bef9496daf19b5fe65d90c64)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:25.252904 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d9a162-6e94-4134-9193-fc0fc2e28c02 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:25.267818 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 536/1076] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Jun 22 08:36:25 2022] PUT /identity/v3/projects/e1f161193cb440fa8c4a9d23820a5c28/users/4f1809a35b244c1db7a185d82859369e/roles/334470a0bef9496daf19b5fe65d90c64 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:36:25.276489 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e2566-8e0a-443d-badf-436efcaa7af2 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:25.276812 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e2566-8e0a-443d-badf-436efcaa7af2 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:25.277130 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e2566-8e0a-443d-badf-436efcaa7af2 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:25.278970 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 537/1077] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:36:25 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:36:25.285229 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f65ce8-28e6-4ef0-8556-f59a5e956c68 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:25.285524 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f65ce8-28e6-4ef0-8556-f59a5e956c68 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:25.285791 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f65ce8-28e6-4ef0-8556-f59a5e956c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:25.304363 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-f4f65ce8-28e6-4ef0-8556-f59a5e956c68 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:36:25.305600 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-f4f65ce8-28e6-4ef0-8556-f59a5e956c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:36:25.319648 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03bbe19-9387-4f61-baa5-663c76c65a64 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:25.359196 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268adb2e-c99a-4b75-97b9-b023fbea3b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:25.360089 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268adb2e-c99a-4b75-97b9-b023fbea3b5a None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:25.360373 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268adb2e-c99a-4b75-97b9-b023fbea3b5a None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:25.360651 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268adb2e-c99a-4b75-97b9-b023fbea3b5a None admin] PATH_INFO: `/v3/users/1331600c03754f04ae65e2559fb27069` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:25.361958 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268adb2e-c99a-4b75-97b9-b023fbea3b5a None admin] RBAC: Authorizing `identity:get_user(user_id=1331600c03754f04ae65e2559fb27069)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:25.363456 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268adb2e-c99a-4b75-97b9-b023fbea3b5a None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:25.365316 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 541/1078] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Jun 22 08:36:25 2022] GET /identity/v3/users/1331600c03754f04ae65e2559fb27069 => generated 285 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:36:25.371221 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268adb2e-c99a-4b75-97b9-b023fbea3b5a None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:25.382140 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 538/1079] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:36:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 08:36:25.406526 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f65ce8-28e6-4ef0-8556-f59a5e956c68 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:25.431727 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:25.485761 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:25.492248 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268adb2e-c99a-4b75-97b9-b023fbea3b5a None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:25.522632 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f65ce8-28e6-4ef0-8556-f59a5e956c68 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:25.536978 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ab199-e72f-4a9e-89be-0c3fe250ecae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:25.538450 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ab199-e72f-4a9e-89be-0c3fe250ecae None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:25.538450 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ab199-e72f-4a9e-89be-0c3fe250ecae None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:25.538450 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ab199-e72f-4a9e-89be-0c3fe250ecae None admin] PATH_INFO: `/v3/projects/ed25c8ba9ef240d6a532935178db1e3b` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:25.539610 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036ab199-e72f-4a9e-89be-0c3fe250ecae None admin] RBAC: Authorizing `identity:get_project(project_id=ed25c8ba9ef240d6a532935178db1e3b)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:25.541151 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036ab199-e72f-4a9e-89be-0c3fe250ecae None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:25.542957 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 542/1080] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Jun 22 08:36:25 2022] GET /identity/v3/projects/ed25c8ba9ef240d6a532935178db1e3b => generated 311 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:36:25.549269 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ab199-e72f-4a9e-89be-0c3fe250ecae None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:25.559769 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6cfa4d-60da-471e-8648-f36e3a62a1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:25.560419 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6cfa4d-60da-471e-8648-f36e3a62a1da None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:25.560705 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6cfa4d-60da-471e-8648-f36e3a62a1da None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:25.561518 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6cfa4d-60da-471e-8648-f36e3a62a1da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:25.643004 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6cfa4d-60da-471e-8648-f36e3a62a1da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:25.645215 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6cfa4d-60da-471e-8648-f36e3a62a1da None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:25.658518 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ab199-e72f-4a9e-89be-0c3fe250ecae None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:25.683418 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:25.706461 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca14f2e-f0ac-421f-a2a3-06d036d96843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:25.707368 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca14f2e-f0ac-421f-a2a3-06d036d96843 None admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:25.707698 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca14f2e-f0ac-421f-a2a3-06d036d96843 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:25.708013 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca14f2e-f0ac-421f-a2a3-06d036d96843 None admin] PATH_INFO: `/v3/projects/ed25c8ba9ef240d6a532935178db1e3b/users/1331600c03754f04ae65e2559fb27069/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:25.709941 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca14f2e-f0ac-421f-a2a3-06d036d96843 None admin] RBAC: Authorizing `identity:create_grant(project_id=ed25c8ba9ef240d6a532935178db1e3b, user_id=1331600c03754f04ae65e2559fb27069, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:25.711450 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca14f2e-f0ac-421f-a2a3-06d036d96843 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:25.720323 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:25.729877 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 543/1081] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Jun 22 08:36:25 2022] PUT /identity/v3/projects/ed25c8ba9ef240d6a532935178db1e3b/users/1331600c03754f04ae65e2559fb27069/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 08:36:25.762738 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 539/1082] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Jun 22 08:36:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 22 08:36:25.769427 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca14f2e-f0ac-421f-a2a3-06d036d96843 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:25.896460 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca14f2e-f0ac-421f-a2a3-06d036d96843 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:25.941595 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65961d2d-fcf8-4fbe-a48d-7eb596284e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:25.942429 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65961d2d-fcf8-4fbe-a48d-7eb596284e9f None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:25.942721 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65961d2d-fcf8-4fbe-a48d-7eb596284e9f None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:25.943003 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65961d2d-fcf8-4fbe-a48d-7eb596284e9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:25.955224 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65961d2d-fcf8-4fbe-a48d-7eb596284e9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:25.956702 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65961d2d-fcf8-4fbe-a48d-7eb596284e9f None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:25.977460 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-65961d2d-fcf8-4fbe-a48d-7eb596284e9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:36:25.977460 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:36:25.977460 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:36:25.977460 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:36:25.977460 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:36:25.977460 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:36:25.977460 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:36:25.977460 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:36:25.977460 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:36:25.977460 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:36:25.977460 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:36:25.977460 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:36:25.977460 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:36:25.977460 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:36:25.977460 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:36:25.978720 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:36:25.978720 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:36:25.978720 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:36:25.978720 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:36:25.978720 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:36:25.978720 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:36:25.978720 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:36:25.978720 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:36:25.978720 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:36:25.978720 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:36:25.978720 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:36:25.978720 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:36:25.978720 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:36:25.978720 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:36:25.978720 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:36:25.978720 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:36:25.978720 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:36:25.979779 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:36:25.979779 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:36:25.979779 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:36:25.979779 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:36:25.979779 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 544/1083] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:36:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:36:25.984717 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6cfa4d-60da-471e-8648-f36e3a62a1da None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:26.120966 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6cfa4d-60da-471e-8648-f36e3a62a1da None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:26.157513 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c502dd-ab7a-4908-8c6b-90a88574861b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:26.158206 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c502dd-ab7a-4908-8c6b-90a88574861b None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:26.158490 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c502dd-ab7a-4908-8c6b-90a88574861b None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:26.158762 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c502dd-ab7a-4908-8c6b-90a88574861b None admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:26.159479 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c502dd-ab7a-4908-8c6b-90a88574861b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:26.159782 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c502dd-ab7a-4908-8c6b-90a88574861b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:26.161138 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c502dd-ab7a-4908-8c6b-90a88574861b None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:26.182131 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 540/1084] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:36:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:36:27.367615 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21421465-c613-4796-a02e-b01d216c4efc None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:27.368161 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21421465-c613-4796-a02e-b01d216c4efc None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:27.368161 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21421465-c613-4796-a02e-b01d216c4efc None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:27.369541 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 545/1085] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:36:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:36:27.374826 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72e952-4834-4308-99df-e276b90fd713 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:27.375249 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72e952-4834-4308-99df-e276b90fd713 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:27.375397 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72e952-4834-4308-99df-e276b90fd713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:27.392720 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-ef72e952-4834-4308-99df-e276b90fd713 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:36:27.394185 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-ef72e952-4834-4308-99df-e276b90fd713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:36:27.420587 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:27.462909 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 541/1086] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:36:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:36:27.487398 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21421465-c613-4796-a02e-b01d216c4efc None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:27.520601 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:27.594327 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21421465-c613-4796-a02e-b01d216c4efc None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:27.627959 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc8403c-c1d4-4ecb-a0c0-9da1d826db9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:27.628772 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8403c-c1d4-4ecb-a0c0-9da1d826db9c None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:27.629054 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8403c-c1d4-4ecb-a0c0-9da1d826db9c None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:27.629325 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8403c-c1d4-4ecb-a0c0-9da1d826db9c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:27.640447 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc8403c-c1d4-4ecb-a0c0-9da1d826db9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:36:27.648737 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-bfc8403c-c1d4-4ecb-a0c0-9da1d826db9c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 08:36:27.648737 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:36:27.648737 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:36:27.648737 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:36:27.648737 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:36:27.648737 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:36:27.648737 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:36:27.648737 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:36:27.648737 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:36:27.648737 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:36:27.648737 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:36:27.648737 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:36:27.648737 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:36:27.648737 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:36:27.648737 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:36:27.648737 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:36:27.649993 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:36:27.649993 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:36:27.649993 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:36:27.649993 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:36:27.649993 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:36:27.649993 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:36:27.649993 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:36:27.649993 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:36:27.649993 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:36:27.649993 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:36:27.649993 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:36:27.649993 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:36:27.649993 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:36:27.649993 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:36:27.649993 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:36:27.649993 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:36:27.650900 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:36:27.650900 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:36:27.650900 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:36:27.650900 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:36:27.650900 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:36:27.650900 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:36:27.650900 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:36:27.650900 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:36:27.650900 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:36:27.650900 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:36:27.650900 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 08:36:27.650900 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:36:27.650900 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 546/1087] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Jun 22 08:36:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:36:27.656490 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef72e952-4834-4308-99df-e276b90fd713 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:27.754472 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef72e952-4834-4308-99df-e276b90fd713 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:27.789343 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b28166-59e8-4470-96a4-7a2396ab820a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:27.789938 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b28166-59e8-4470-96a4-7a2396ab820a None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:27.790262 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b28166-59e8-4470-96a4-7a2396ab820a None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:27.790548 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b28166-59e8-4470-96a4-7a2396ab820a None admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:27.791300 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b28166-59e8-4470-96a4-7a2396ab820a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:27.791612 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b28166-59e8-4470-96a4-7a2396ab820a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:27.792980 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b28166-59e8-4470-96a4-7a2396ab820a None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:27.799335 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9954841-e900-4912-b8d9-36b86b5a629c None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:27.799621 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9954841-e900-4912-b8d9-36b86b5a629c None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:27.799920 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9954841-e900-4912-b8d9-36b86b5a629c None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:27.801255 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 547/1088] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:36:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:36:27.806364 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 542/1089] 10.222.0.42 () {56 vars in 1115 bytes} [Wed Jun 22 08:36:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:36:27.807310 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b28166-59e8-4470-96a4-7a2396ab820a None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:27.807594 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fe58b-a97b-48aa-9eaf-052d6604ef5c None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:27.807883 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fe58b-a97b-48aa-9eaf-052d6604ef5c None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:27.808162 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fe58b-a97b-48aa-9eaf-052d6604ef5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:27.825415 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-0d4fe58b-a97b-48aa-9eaf-052d6604ef5c None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:36:27.827207 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-0d4fe58b-a97b-48aa-9eaf-052d6604ef5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:36:27.838627 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:27.901080 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 548/1090] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:36:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 08:36:27.924636 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b28166-59e8-4470-96a4-7a2396ab820a None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:27.926578 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4fe58b-a97b-48aa-9eaf-052d6604ef5c None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:27.952410 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:27.961165 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b433d799-d869-476b-8ec7-98726d795fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:27.961971 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433d799-d869-476b-8ec7-98726d795fdf None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:27.962287 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433d799-d869-476b-8ec7-98726d795fdf None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:27.962588 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433d799-d869-476b-8ec7-98726d795fdf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:27.975213 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b433d799-d869-476b-8ec7-98726d795fdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:27.976700 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b433d799-d869-476b-8ec7-98726d795fdf None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:27.995437 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-b433d799-d869-476b-8ec7-98726d795fdf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:36:27.995437 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:36:27.995437 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:36:27.995437 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:36:27.995437 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:36:27.995437 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:36:27.995437 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:36:27.995437 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:36:27.995437 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:36:27.995437 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:36:27.995437 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:36:27.995437 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:36:27.995437 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:36:27.995437 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:36:27.995437 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:36:27.996600 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:36:27.996600 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:36:27.996600 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:36:27.996600 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:36:27.996600 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:36:27.996600 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:36:27.996600 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:36:27.996600 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:36:27.996600 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:36:27.996600 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:36:27.996600 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:36:27.996600 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:36:27.996600 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:36:27.996600 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:36:27.996600 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:36:27.996600 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:36:27.996600 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:36:27.997688 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:36:27.997688 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:36:27.997688 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:36:27.997688 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:36:27.997688 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 543/1091] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:36:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:36:28.003703 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b433d799-d869-476b-8ec7-98726d795fdf None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:28.051701 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4fe58b-a97b-48aa-9eaf-052d6604ef5c None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:28.086456 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:28.089047 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609eb786-dd7e-486f-b974-dae964170d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:28.089941 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609eb786-dd7e-486f-b974-dae964170d44 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:28.090260 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609eb786-dd7e-486f-b974-dae964170d44 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:28.090540 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609eb786-dd7e-486f-b974-dae964170d44 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:28.101735 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609eb786-dd7e-486f-b974-dae964170d44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:36:28.110036 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-609eb786-dd7e-486f-b974-dae964170d44 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:36:28.110036 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:36:28.110036 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:36:28.110036 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:36:28.110036 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:36:28.110036 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:36:28.110036 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:36:28.110036 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:36:28.110036 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:36:28.110036 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:36:28.110036 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:36:28.110036 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:36:28.110036 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:36:28.110036 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:36:28.110036 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:36:28.110036 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:36:28.111420 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:36:28.111420 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:36:28.111420 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:36:28.111420 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:36:28.111420 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:36:28.111420 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:36:28.111420 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:36:28.111420 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:36:28.111420 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:36:28.111420 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:36:28.111420 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:36:28.111420 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:36:28.111420 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:36:28.111420 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:36:28.111420 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:36:28.111420 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:36:28.112875 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:36:28.112875 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:36:28.112875 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:36:28.112875 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:36:28.112875 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:36:28.112875 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:36:28.112875 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:36:28.112875 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:36:28.112875 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:36:28.112875 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:36:28.112875 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:36:28.112875 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:36:28.112875 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 549/1092] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Jun 22 08:36:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:36:28.113627 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b433d799-d869-476b-8ec7-98726d795fdf None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:28.119815 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609eb786-dd7e-486f-b974-dae964170d44 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:28.150813 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b13a77-4303-435a-8de9-01470e452b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:28.151493 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b13a77-4303-435a-8de9-01470e452b37 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:28.151796 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b13a77-4303-435a-8de9-01470e452b37 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:28.152057 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b13a77-4303-435a-8de9-01470e452b37 None admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:28.152789 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b13a77-4303-435a-8de9-01470e452b37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:28.153097 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b13a77-4303-435a-8de9-01470e452b37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:28.154593 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b13a77-4303-435a-8de9-01470e452b37 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:28.167981 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 544/1093] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:36:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:36:28.174260 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b13a77-4303-435a-8de9-01470e452b37 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:28.220037 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:28.240450 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609eb786-dd7e-486f-b974-dae964170d44 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:28.281708 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417746c-2c36-47b9-a455-8d4fb5a9d35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:28.282423 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417746c-2c36-47b9-a455-8d4fb5a9d35b None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:28.282706 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417746c-2c36-47b9-a455-8d4fb5a9d35b None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:28.282984 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417746c-2c36-47b9-a455-8d4fb5a9d35b None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:28.283844 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8417746c-2c36-47b9-a455-8d4fb5a9d35b None admin] RBAC: Adding query filter params (name=admin) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:28.284169 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8417746c-2c36-47b9-a455-8d4fb5a9d35b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:28.285597 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8417746c-2c36-47b9-a455-8d4fb5a9d35b None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:28.292882 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b13a77-4303-435a-8de9-01470e452b37 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:28.294434 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 550/1094] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Jun 22 08:36:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:36:28.303326 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417746c-2c36-47b9-a455-8d4fb5a9d35b None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:28.345702 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c5962f-0f55-41a0-8fe4-011725b56481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:28.346633 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c5962f-0f55-41a0-8fe4-011725b56481 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:28.346917 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c5962f-0f55-41a0-8fe4-011725b56481 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:28.347194 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c5962f-0f55-41a0-8fe4-011725b56481 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:28.350538 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:28.356130 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c5962f-0f55-41a0-8fe4-011725b56481 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:28.357818 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c5962f-0f55-41a0-8fe4-011725b56481 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:28.375036 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-22c5962f-0f55-41a0-8fe4-011725b56481 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 08:36:28.375036 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:36:28.375036 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:36:28.375036 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:36:28.375036 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:36:28.375036 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:36:28.375036 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:36:28.375036 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:36:28.375036 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:36:28.375036 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:36:28.375036 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:36:28.375036 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:36:28.375036 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:36:28.375036 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:36:28.375036 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:36:28.375036 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:36:28.377024 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:36:28.377024 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:36:28.377024 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:36:28.377024 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:36:28.377024 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:36:28.377024 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:36:28.377024 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:36:28.377024 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:36:28.377024 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:36:28.377024 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:36:28.377024 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:36:28.377024 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:36:28.377024 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:36:28.377024 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:36:28.377024 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:36:28.377024 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:36:28.377024 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:36:28.377024 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:36:28.378463 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:36:28.378463 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:36:28.378463 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:36:28.378463 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:36:28.378463 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:36:28.378463 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:36:28.378463 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:36:28.378463 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:36:28.378463 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 08:36:28.378463 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:36:28.378463 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 545/1095] 10.222.0.42 () {56 vars in 1093 bytes} [Wed Jun 22 08:36:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:36:28.382212 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c5962f-0f55-41a0-8fe4-011725b56481 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:28.418086 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417746c-2c36-47b9-a455-8d4fb5a9d35b None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:28.457178 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f5c7c-bb3f-4e31-a218-f0c023ef7f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:28.458303 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f5c7c-bb3f-4e31-a218-f0c023ef7f46 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:28.458769 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f5c7c-bb3f-4e31-a218-f0c023ef7f46 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:28.459110 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f5c7c-bb3f-4e31-a218-f0c023ef7f46 None admin] PATH_INFO: `/v3/users/1331600c03754f04ae65e2559fb27069` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:28.460595 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919f5c7c-bb3f-4e31-a218-f0c023ef7f46 None admin] RBAC: Authorizing `identity:get_user(user_id=1331600c03754f04ae65e2559fb27069)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:28.462419 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919f5c7c-bb3f-4e31-a218-f0c023ef7f46 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:28.464901 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 551/1096] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Jun 22 08:36:28 2022] GET /identity/v3/users/1331600c03754f04ae65e2559fb27069 => generated 285 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:36:28.470996 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f5c7c-bb3f-4e31-a218-f0c023ef7f46 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:28.483756 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:28.497242 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c5962f-0f55-41a0-8fe4-011725b56481 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:28.534663 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5561c1-c849-46ef-bafc-895e0bb60a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:28.535626 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5561c1-c849-46ef-bafc-895e0bb60a5d None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:28.535905 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5561c1-c849-46ef-bafc-895e0bb60a5d None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:28.536190 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5561c1-c849-46ef-bafc-895e0bb60a5d None admin] PATH_INFO: `/v3/users` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:28.537043 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5561c1-c849-46ef-bafc-895e0bb60a5d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:28.537356 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5561c1-c849-46ef-bafc-895e0bb60a5d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:28.538859 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5561c1-c849-46ef-bafc-895e0bb60a5d None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:28.567551 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 546/1097] 10.222.0.42 () {56 vars in 1133 bytes} [Wed Jun 22 08:36:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:36:28.568638 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5561c1-c849-46ef-bafc-895e0bb60a5d None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:28.589135 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f5c7c-bb3f-4e31-a218-f0c023ef7f46 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:28.627826 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b3877b-4558-4642-be07-9ebb412ea006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:28.628597 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b3877b-4558-4642-be07-9ebb412ea006 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:28.628986 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b3877b-4558-4642-be07-9ebb412ea006 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:28.629357 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b3877b-4558-4642-be07-9ebb412ea006 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:28.630443 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:28.693865 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5561c1-c849-46ef-bafc-895e0bb60a5d None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:28.710819 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b3877b-4558-4642-be07-9ebb412ea006 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:28.712331 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b3877b-4558-4642-be07-9ebb412ea006 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:28.724253 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:28.742322 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5a5cf1-ebcc-4705-a920-78a45088ff21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:28.743136 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a5cf1-ebcc-4705-a920-78a45088ff21 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:28.743754 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a5cf1-ebcc-4705-a920-78a45088ff21 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:28.744169 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a5cf1-ebcc-4705-a920-78a45088ff21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:28.822897 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 552/1098] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Jun 22 08:36:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 22 08:36:28.828898 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b3877b-4558-4642-be07-9ebb412ea006 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:28.849091 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5a5cf1-ebcc-4705-a920-78a45088ff21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:28.851923 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5a5cf1-ebcc-4705-a920-78a45088ff21 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:28.911422 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:28.934057 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b3877b-4558-4642-be07-9ebb412ea006 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:28.945767 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:28.964560 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 547/1099] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Jun 22 08:36:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 22 08:36:28.974449 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5a5cf1-ebcc-4705-a920-78a45088ff21 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:28.975975 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae909c76-8d24-4f39-8a2d-ddde05b594aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:28.976850 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae909c76-8d24-4f39-8a2d-ddde05b594aa None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:28.977132 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae909c76-8d24-4f39-8a2d-ddde05b594aa None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:28.977409 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae909c76-8d24-4f39-8a2d-ddde05b594aa None admin] PATH_INFO: `/v3/projects/ed25c8ba9ef240d6a532935178db1e3b` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:28.978685 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae909c76-8d24-4f39-8a2d-ddde05b594aa None admin] RBAC: Authorizing `identity:get_project(project_id=ed25c8ba9ef240d6a532935178db1e3b)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:28.980125 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae909c76-8d24-4f39-8a2d-ddde05b594aa None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:28.981847 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 553/1100] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Jun 22 08:36:28 2022] GET /identity/v3/projects/ed25c8ba9ef240d6a532935178db1e3b => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:36:28.988487 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae909c76-8d24-4f39-8a2d-ddde05b594aa None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:29.090597 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5a5cf1-ebcc-4705-a920-78a45088ff21 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:29.105010 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae909c76-8d24-4f39-8a2d-ddde05b594aa None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:29.129993 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e4690-e633-4dd7-81a7-7f6b66819a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:29.130856 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e4690-e633-4dd7-81a7-7f6b66819a97 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:29.131143 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e4690-e633-4dd7-81a7-7f6b66819a97 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:29.131422 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e4690-e633-4dd7-81a7-7f6b66819a97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:29.143779 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800e4690-e633-4dd7-81a7-7f6b66819a97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:29.145355 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800e4690-e633-4dd7-81a7-7f6b66819a97 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:29.145593 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9232c543-6003-4446-a314-1bbe93a74f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:29.146327 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9232c543-6003-4446-a314-1bbe93a74f13 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:29.146622 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9232c543-6003-4446-a314-1bbe93a74f13 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:29.146904 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9232c543-6003-4446-a314-1bbe93a74f13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:29.147797 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9232c543-6003-4446-a314-1bbe93a74f13 None admin] RBAC: Adding query filter params (role.id=c7518e0f532945af80c33860f2ac506d, scope.project.id=ed25c8ba9ef240d6a532935178db1e3b, user.id=1331600c03754f04ae65e2559fb27069) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:29.148117 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9232c543-6003-4446-a314-1bbe93a74f13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:29.149621 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9232c543-6003-4446-a314-1bbe93a74f13 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:29.157511 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 554/1101] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Jun 22 08:36:28 2022] GET /identity/v3/role_assignments?user.id=1331600c03754f04ae65e2559fb27069&scope.project.id=ed25c8ba9ef240d6a532935178db1e3b&role.id=c7518e0f532945af80c33860f2ac506d => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:36:29.166343 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-800e4690-e633-4dd7-81a7-7f6b66819a97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:36:29.166343 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:36:29.166343 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:36:29.166343 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:36:29.166343 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:36:29.166343 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:36:29.166343 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:36:29.166343 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:36:29.166343 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:36:29.166343 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:36:29.166343 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:36:29.166343 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:36:29.166343 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:36:29.166343 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:36:29.166343 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:36:29.167964 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:36:29.167964 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:36:29.167964 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:36:29.167964 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:36:29.167964 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:36:29.167964 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:36:29.167964 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:36:29.167964 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:36:29.167964 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:36:29.167964 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:36:29.167964 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:36:29.167964 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:36:29.167964 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:36:29.167964 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:36:29.167964 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:36:29.167964 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:36:29.167964 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:36:29.169253 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:36:29.169253 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:36:29.169253 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:36:29.169253 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:36:29.169253 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 548/1102] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:36:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:36:29.174547 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9232c543-6003-4446-a314-1bbe93a74f13 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:29.225623 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:29.299545 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9232c543-6003-4446-a314-1bbe93a74f13 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:29.341546 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e385894e-4044-4b55-8968-f363b3372171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:29.342237 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e385894e-4044-4b55-8968-f363b3372171 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:29.342527 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e385894e-4044-4b55-8968-f363b3372171 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:29.342811 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e385894e-4044-4b55-8968-f363b3372171 None admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:29.343556 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e385894e-4044-4b55-8968-f363b3372171 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:29.343871 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e385894e-4044-4b55-8968-f363b3372171 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:29.345285 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e385894e-4044-4b55-8968-f363b3372171 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:29.358622 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 555/1103] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:36:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:36:29.364666 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e4690-e633-4dd7-81a7-7f6b66819a97 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:29.378193 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:29.484580 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e4690-e633-4dd7-81a7-7f6b66819a97 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:29.524130 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d09c53-2439-4a97-80b1-d2142ec4a5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:29.524923 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d09c53-2439-4a97-80b1-d2142ec4a5e3 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:29.525204 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d09c53-2439-4a97-80b1-d2142ec4a5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:29.525479 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d09c53-2439-4a97-80b1-d2142ec4a5e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:29.534017 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d09c53-2439-4a97-80b1-d2142ec4a5e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:29.535532 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d09c53-2439-4a97-80b1-d2142ec4a5e3 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:29.550582 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-d7d09c53-2439-4a97-80b1-d2142ec4a5e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:36:29.550582 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:36:29.550582 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:36:29.550582 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:36:29.550582 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:36:29.550582 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:36:29.550582 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:36:29.550582 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:36:29.550582 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:36:29.550582 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:36:29.550582 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:36:29.550582 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:36:29.550582 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:36:29.550582 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:36:29.550582 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:36:29.552448 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:36:29.552448 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:36:29.552448 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:36:29.552448 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:36:29.552448 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:36:29.552448 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:36:29.552448 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:36:29.552448 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:36:29.552448 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:36:29.552448 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:36:29.552448 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:36:29.552448 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:36:29.552448 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:36:29.552448 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:36:29.552448 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:36:29.552448 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:36:29.552448 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:36:29.554259 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:36:29.554259 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:36:29.554259 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:36:29.554259 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:36:29.554259 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:36:29.554259 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:36:29.554259 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:36:29.554259 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:36:29.554259 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 549/1104] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Jun 22 08:36:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:36:29.560821 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e385894e-4044-4b55-8968-f363b3372171 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:29.680889 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e385894e-4044-4b55-8968-f363b3372171 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:29.683334 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:29.741003 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d3997f-dab7-46aa-9e24-0705184cce25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:29.742145 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3997f-dab7-46aa-9e24-0705184cce25 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:29.742627 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3997f-dab7-46aa-9e24-0705184cce25 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:29.743098 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3997f-dab7-46aa-9e24-0705184cce25 None admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:29.744569 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d3997f-dab7-46aa-9e24-0705184cce25 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:29.745113 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d3997f-dab7-46aa-9e24-0705184cce25 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:29.747841 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d3997f-dab7-46aa-9e24-0705184cce25 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:29.776562 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 556/1105] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Jun 22 08:36:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:36:29.778102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d09c53-2439-4a97-80b1-d2142ec4a5e3 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:29.851084 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:29.891649 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d09c53-2439-4a97-80b1-d2142ec4a5e3 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:29.931939 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb315f3-739e-4c14-b11d-79b3b1496827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:29.932496 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb315f3-739e-4c14-b11d-79b3b1496827 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:29.932776 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb315f3-739e-4c14-b11d-79b3b1496827 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:29.933052 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb315f3-739e-4c14-b11d-79b3b1496827 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:29.933894 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb315f3-739e-4c14-b11d-79b3b1496827 None admin] RBAC: Adding query filter params (role.id=334470a0bef9496daf19b5fe65d90c64, scope.project.id=e1f161193cb440fa8c4a9d23820a5c28, user.id=4f1809a35b244c1db7a185d82859369e) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:29.934274 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb315f3-739e-4c14-b11d-79b3b1496827 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:29.936252 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb315f3-739e-4c14-b11d-79b3b1496827 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:29.943263 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 550/1106] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Jun 22 08:36:29 2022] GET /identity/v3/role_assignments?user.id=4f1809a35b244c1db7a185d82859369e&scope.project.id=e1f161193cb440fa8c4a9d23820a5c28&role.id=334470a0bef9496daf19b5fe65d90c64 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:36:31.399322 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd3ce6-9c8e-49d7-bcde-9e7b5974fb70 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:31.399878 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd3ce6-9c8e-49d7-bcde-9e7b5974fb70 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:31.400016 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd3ce6-9c8e-49d7-bcde-9e7b5974fb70 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:31.401383 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 557/1107] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:36:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:36:31.407230 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115cc91-0855-4427-b799-5feb14bd293e None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:31.407753 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115cc91-0855-4427-b799-5feb14bd293e None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:31.407878 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115cc91-0855-4427-b799-5feb14bd293e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:31.425318 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-2115cc91-0855-4427-b799-5feb14bd293e None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:36:31.426660 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-2115cc91-0855-4427-b799-5feb14bd293e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:36:31.522508 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 551/1108] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:36:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 08:36:31.547428 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd3ce6-9c8e-49d7-bcde-9e7b5974fb70 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:31.658817 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd3ce6-9c8e-49d7-bcde-9e7b5974fb70 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:31.693599 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e81317a-c2ec-4c4b-a040-88f0fc2dbdc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:31.694489 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81317a-c2ec-4c4b-a040-88f0fc2dbdc1 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:31.694820 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81317a-c2ec-4c4b-a040-88f0fc2dbdc1 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:31.695201 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81317a-c2ec-4c4b-a040-88f0fc2dbdc1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:31.696471 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e81317a-c2ec-4c4b-a040-88f0fc2dbdc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:31.697978 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e81317a-c2ec-4c4b-a040-88f0fc2dbdc1 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:31.699696 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 558/1109] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:36:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:36:31.706215 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2115cc91-0855-4427-b799-5feb14bd293e None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:31.769568 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:31.813387 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2115cc91-0855-4427-b799-5feb14bd293e None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:31.849376 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f390f93-e485-4f34-a8ff-7f6ee4381501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:31.850053 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f390f93-e485-4f34-a8ff-7f6ee4381501 None admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:31.850369 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f390f93-e485-4f34-a8ff-7f6ee4381501 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:31.850644 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f390f93-e485-4f34-a8ff-7f6ee4381501 None admin] PATH_INFO: `/v3/users` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:31.851368 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f390f93-e485-4f34-a8ff-7f6ee4381501 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:31.852813 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f390f93-e485-4f34-a8ff-7f6ee4381501 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:31.874570 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 552/1110] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Jun 22 08:36:31 2022] POST /identity/v3/users => generated 286 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:36:34.044354 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db983654-b632-411f-9a89-33f35bbd6ef6 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:34.044935 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db983654-b632-411f-9a89-33f35bbd6ef6 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:34.044935 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db983654-b632-411f-9a89-33f35bbd6ef6 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:34.046316 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 559/1111] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:36:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:36:34.051586 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f5887-778e-4527-9f61-fe7f88dd1894 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:34.052066 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f5887-778e-4527-9f61-fe7f88dd1894 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:34.052169 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f5887-778e-4527-9f61-fe7f88dd1894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:34.068711 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-f63f5887-778e-4527-9f61-fe7f88dd1894 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:36:34.069935 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-f63f5887-778e-4527-9f61-fe7f88dd1894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:36:34.140906 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 553/1112] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:36:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:36:34.165277 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db983654-b632-411f-9a89-33f35bbd6ef6 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:34.195249 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:34.268851 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db983654-b632-411f-9a89-33f35bbd6ef6 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:34.305211 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334098c4-85c8-426e-a68f-aacb29c03195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:34.305981 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334098c4-85c8-426e-a68f-aacb29c03195 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:34.306298 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334098c4-85c8-426e-a68f-aacb29c03195 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:34.306574 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334098c4-85c8-426e-a68f-aacb29c03195 None admin] PATH_INFO: `/v3/roles/a92b520fb33f4333aad569d98be2bd7e` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:34.308039 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334098c4-85c8-426e-a68f-aacb29c03195 None admin] RBAC: Authorizing `identity:get_role(role_id=a92b520fb33f4333aad569d98be2bd7e)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:34.309430 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334098c4-85c8-426e-a68f-aacb29c03195 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:34.310869 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 560/1113] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Jun 22 08:36:34 2022] GET /identity/v3/roles/a92b520fb33f4333aad569d98be2bd7e => generated 223 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:36:34.316683 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f5887-778e-4527-9f61-fe7f88dd1894 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:34.362690 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:34.414858 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f5887-778e-4527-9f61-fe7f88dd1894 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:34.448640 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ffde2b-b1d4-48b8-a226-02b658e63e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:34.449518 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ffde2b-b1d4-48b8-a226-02b658e63e1f None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:34.449800 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ffde2b-b1d4-48b8-a226-02b658e63e1f None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:34.450098 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ffde2b-b1d4-48b8-a226-02b658e63e1f None admin] PATH_INFO: `/v3/users/c74a1249a07c49dda5424bcaff828475` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:34.463204 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ffde2b-b1d4-48b8-a226-02b658e63e1f None admin] RBAC: Authorizing `identity:get_user(user_id=c74a1249a07c49dda5424bcaff828475)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:34.464611 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ffde2b-b1d4-48b8-a226-02b658e63e1f None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:34.466286 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 554/1114] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Jun 22 08:36:34 2022] GET /identity/v3/users/c74a1249a07c49dda5424bcaff828475 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:36:34.472638 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334098c4-85c8-426e-a68f-aacb29c03195 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:34.568365 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:34.572622 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334098c4-85c8-426e-a68f-aacb29c03195 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:34.606910 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f8bd0a-54e3-4860-a3de-f7e2cc541535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:34.608118 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f8bd0a-54e3-4860-a3de-f7e2cc541535 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:34.608404 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f8bd0a-54e3-4860-a3de-f7e2cc541535 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:34.608683 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f8bd0a-54e3-4860-a3de-f7e2cc541535 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:34.674942 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f8bd0a-54e3-4860-a3de-f7e2cc541535 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:34.676399 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f8bd0a-54e3-4860-a3de-f7e2cc541535 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:34.773018 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:34.777322 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 561/1115] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Jun 22 08:36:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 08:36:34.783120 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ffde2b-b1d4-48b8-a226-02b658e63e1f None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:34.880171 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ffde2b-b1d4-48b8-a226-02b658e63e1f None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:34.882527 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:34.914907 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035ad364-c9d2-43c0-98ac-a4f76858f5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:34.915765 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ad364-c9d2-43c0-98ac-a4f76858f5c3 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:34.916049 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ad364-c9d2-43c0-98ac-a4f76858f5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:34.916327 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ad364-c9d2-43c0-98ac-a4f76858f5c3 None admin] PATH_INFO: `/v3/projects/ed25c8ba9ef240d6a532935178db1e3b` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:34.917500 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035ad364-c9d2-43c0-98ac-a4f76858f5c3 None admin] RBAC: Authorizing `identity:get_project(project_id=ed25c8ba9ef240d6a532935178db1e3b)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:34.918952 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035ad364-c9d2-43c0-98ac-a4f76858f5c3 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:34.920689 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 555/1116] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Jun 22 08:36:34 2022] GET /identity/v3/projects/ed25c8ba9ef240d6a532935178db1e3b => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:36:34.926917 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f8bd0a-54e3-4860-a3de-f7e2cc541535 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:35.027625 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f8bd0a-54e3-4860-a3de-f7e2cc541535 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:35.061416 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a46ccd6-d9f1-4634-866c-5656ad354a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:35.062112 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a46ccd6-d9f1-4634-866c-5656ad354a77 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:35.062372 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a46ccd6-d9f1-4634-866c-5656ad354a77 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:35.062650 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a46ccd6-d9f1-4634-866c-5656ad354a77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:35.063488 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a46ccd6-d9f1-4634-866c-5656ad354a77 None admin] RBAC: Adding query filter params (role.id=a92b520fb33f4333aad569d98be2bd7e, scope.project.id=ed25c8ba9ef240d6a532935178db1e3b, user.id=c74a1249a07c49dda5424bcaff828475) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:35.063806 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a46ccd6-d9f1-4634-866c-5656ad354a77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:35.065252 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a46ccd6-d9f1-4634-866c-5656ad354a77 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:35.070800 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 562/1117] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Jun 22 08:36:34 2022] GET /identity/v3/role_assignments?user.id=c74a1249a07c49dda5424bcaff828475&scope.project.id=ed25c8ba9ef240d6a532935178db1e3b&role.id=a92b520fb33f4333aad569d98be2bd7e => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:36:37.092493 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696614c-bd31-41cd-9f0c-8fd5ba3af709 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:37.093062 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696614c-bd31-41cd-9f0c-8fd5ba3af709 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:37.093062 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696614c-bd31-41cd-9f0c-8fd5ba3af709 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:37.094450 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 556/1118] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:36:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:36:37.100025 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b93d6-762d-4808-a85d-7d3d6f278769 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:37.100456 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b93d6-762d-4808-a85d-7d3d6f278769 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:37.100591 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b93d6-762d-4808-a85d-7d3d6f278769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:37.118634 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-d38b93d6-762d-4808-a85d-7d3d6f278769 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:36:37.119839 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-d38b93d6-762d-4808-a85d-7d3d6f278769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:36:37.176936 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:37.187862 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 563/1119] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:36:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:36:37.212455 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b696614c-bd31-41cd-9f0c-8fd5ba3af709 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:37.315005 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b696614c-bd31-41cd-9f0c-8fd5ba3af709 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:37.347282 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fde5f15-52f2-44e3-834b-48a1b65c49df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:37.348062 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde5f15-52f2-44e3-834b-48a1b65c49df None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:37.348341 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde5f15-52f2-44e3-834b-48a1b65c49df None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:37.348614 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde5f15-52f2-44e3-834b-48a1b65c49df None admin] PATH_INFO: `/v3/roles/a92b520fb33f4333aad569d98be2bd7e` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:37.350088 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fde5f15-52f2-44e3-834b-48a1b65c49df None admin] RBAC: Authorizing `identity:get_role(role_id=a92b520fb33f4333aad569d98be2bd7e)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:37.351441 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fde5f15-52f2-44e3-834b-48a1b65c49df None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:37.352800 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 557/1120] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Jun 22 08:36:37 2022] GET /identity/v3/roles/a92b520fb33f4333aad569d98be2bd7e => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:36:37.358864 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38b93d6-762d-4808-a85d-7d3d6f278769 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:37.454474 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38b93d6-762d-4808-a85d-7d3d6f278769 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:37.487873 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60953b7c-3f34-469c-8caa-21493ada029e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:37.488731 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60953b7c-3f34-469c-8caa-21493ada029e None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:37.489017 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60953b7c-3f34-469c-8caa-21493ada029e None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:37.489290 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60953b7c-3f34-469c-8caa-21493ada029e None admin] PATH_INFO: `/v3/users/c74a1249a07c49dda5424bcaff828475` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:37.490489 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60953b7c-3f34-469c-8caa-21493ada029e None admin] RBAC: Authorizing `identity:get_user(user_id=c74a1249a07c49dda5424bcaff828475)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:37.491952 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60953b7c-3f34-469c-8caa-21493ada029e None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:37.493641 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 564/1121] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Jun 22 08:36:37 2022] GET /identity/v3/users/c74a1249a07c49dda5424bcaff828475 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:36:37.499987 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fde5f15-52f2-44e3-834b-48a1b65c49df None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:37.541560 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:37.597033 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fde5f15-52f2-44e3-834b-48a1b65c49df None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:37.629359 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9b80e1-5bfb-4f4b-91c1-97aba863357e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:37.630163 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b80e1-5bfb-4f4b-91c1-97aba863357e None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:37.630448 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b80e1-5bfb-4f4b-91c1-97aba863357e None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:37.630722 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b80e1-5bfb-4f4b-91c1-97aba863357e None admin] PATH_INFO: `/v3/projects/ed25c8ba9ef240d6a532935178db1e3b` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:37.631883 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9b80e1-5bfb-4f4b-91c1-97aba863357e None admin] RBAC: Authorizing `identity:get_project(project_id=ed25c8ba9ef240d6a532935178db1e3b)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:37.633296 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9b80e1-5bfb-4f4b-91c1-97aba863357e None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:37.635003 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 558/1122] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Jun 22 08:36:37 2022] GET /identity/v3/projects/ed25c8ba9ef240d6a532935178db1e3b => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:36:37.641454 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60953b7c-3f34-469c-8caa-21493ada029e None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:37.698163 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:37.739096 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60953b7c-3f34-469c-8caa-21493ada029e None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:37.771679 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca06d3ef-a20c-498d-bbce-fa9ac0dc724d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:37.772554 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06d3ef-a20c-498d-bbce-fa9ac0dc724d None admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:37.772836 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06d3ef-a20c-498d-bbce-fa9ac0dc724d None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:37.773112 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06d3ef-a20c-498d-bbce-fa9ac0dc724d None admin] PATH_INFO: `/v3/projects/ed25c8ba9ef240d6a532935178db1e3b/users/c74a1249a07c49dda5424bcaff828475/roles/a92b520fb33f4333aad569d98be2bd7e` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:37.775281 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca06d3ef-a20c-498d-bbce-fa9ac0dc724d None admin] RBAC: Authorizing `identity:create_grant(project_id=ed25c8ba9ef240d6a532935178db1e3b, user_id=c74a1249a07c49dda5424bcaff828475, role_id=a92b520fb33f4333aad569d98be2bd7e)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:37.776714 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca06d3ef-a20c-498d-bbce-fa9ac0dc724d None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:37.789046 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 565/1123] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Jun 22 08:36:37 2022] PUT /identity/v3/projects/ed25c8ba9ef240d6a532935178db1e3b/users/c74a1249a07c49dda5424bcaff828475/roles/a92b520fb33f4333aad569d98be2bd7e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:36:39.810832 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3358ebb2-3458-4404-82f3-7beb25a4e4bc None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:39.811392 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3358ebb2-3458-4404-82f3-7beb25a4e4bc None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:39.811392 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3358ebb2-3458-4404-82f3-7beb25a4e4bc None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:39.812754 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 559/1124] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:36:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:36:39.818399 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197eea8e-de04-4fe6-91bb-5ee3f300c773 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:39.818836 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197eea8e-de04-4fe6-91bb-5ee3f300c773 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:39.818957 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197eea8e-de04-4fe6-91bb-5ee3f300c773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:39.840047 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-197eea8e-de04-4fe6-91bb-5ee3f300c773 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:36:39.841394 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-197eea8e-de04-4fe6-91bb-5ee3f300c773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:36:39.922780 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 566/1125] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:36:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:36:39.947339 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3358ebb2-3458-4404-82f3-7beb25a4e4bc None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:40.071652 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3358ebb2-3458-4404-82f3-7beb25a4e4bc None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:40.081966 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:40.109670 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cb438a-5c15-4226-90a6-12e67320f5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:40.110571 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb438a-5c15-4226-90a6-12e67320f5e9 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:40.110855 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb438a-5c15-4226-90a6-12e67320f5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:40.111134 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb438a-5c15-4226-90a6-12e67320f5e9 None admin] PATH_INFO: `/v3/roles/a92b520fb33f4333aad569d98be2bd7e` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:40.112690 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cb438a-5c15-4226-90a6-12e67320f5e9 None admin] RBAC: Authorizing `identity:get_role(role_id=a92b520fb33f4333aad569d98be2bd7e)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:40.114112 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cb438a-5c15-4226-90a6-12e67320f5e9 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:40.115546 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 560/1126] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Jun 22 08:36:39 2022] GET /identity/v3/roles/a92b520fb33f4333aad569d98be2bd7e => generated 223 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:36:40.124645 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197eea8e-de04-4fe6-91bb-5ee3f300c773 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:40.177194 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:40.260165 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197eea8e-de04-4fe6-91bb-5ee3f300c773 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:40.297404 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019563f-83f7-40f2-a768-d1715c2ccec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:40.298326 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019563f-83f7-40f2-a768-d1715c2ccec9 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:40.298609 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019563f-83f7-40f2-a768-d1715c2ccec9 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:40.298883 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019563f-83f7-40f2-a768-d1715c2ccec9 None admin] PATH_INFO: `/v3/users/c74a1249a07c49dda5424bcaff828475` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:40.300385 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f019563f-83f7-40f2-a768-d1715c2ccec9 None admin] RBAC: Authorizing `identity:get_user(user_id=c74a1249a07c49dda5424bcaff828475)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:40.301841 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f019563f-83f7-40f2-a768-d1715c2ccec9 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:40.303568 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 567/1127] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Jun 22 08:36:40 2022] GET /identity/v3/users/c74a1249a07c49dda5424bcaff828475 => generated 286 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:36:40.313369 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cb438a-5c15-4226-90a6-12e67320f5e9 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:40.481336 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cb438a-5c15-4226-90a6-12e67320f5e9 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:40.538400 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ebc71b-4189-470c-8db1-74a40b3d2882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:40.539524 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ebc71b-4189-470c-8db1-74a40b3d2882 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:40.540031 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ebc71b-4189-470c-8db1-74a40b3d2882 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:40.540538 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ebc71b-4189-470c-8db1-74a40b3d2882 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:40.619343 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:40.662520 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ebc71b-4189-470c-8db1-74a40b3d2882 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:40.664185 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ebc71b-4189-470c-8db1-74a40b3d2882 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:40.774755 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 561/1128] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Jun 22 08:36:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 08:36:40.781481 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019563f-83f7-40f2-a768-d1715c2ccec9 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:40.886923 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019563f-83f7-40f2-a768-d1715c2ccec9 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:40.905193 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:40.924172 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a460b67-dd02-4fc3-9af6-1c538aa43db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:40.925040 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a460b67-dd02-4fc3-9af6-1c538aa43db9 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:40.925324 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a460b67-dd02-4fc3-9af6-1c538aa43db9 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:40.925598 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a460b67-dd02-4fc3-9af6-1c538aa43db9 None admin] PATH_INFO: `/v3/projects/ed25c8ba9ef240d6a532935178db1e3b` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:40.926828 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a460b67-dd02-4fc3-9af6-1c538aa43db9 None admin] RBAC: Authorizing `identity:get_project(project_id=ed25c8ba9ef240d6a532935178db1e3b)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:40.928263 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a460b67-dd02-4fc3-9af6-1c538aa43db9 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:40.929962 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 568/1129] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Jun 22 08:36:40 2022] GET /identity/v3/projects/ed25c8ba9ef240d6a532935178db1e3b => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:36:40.936744 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ebc71b-4189-470c-8db1-74a40b3d2882 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:41.020811 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:41.057163 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ebc71b-4189-470c-8db1-74a40b3d2882 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:41.116813 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8492cc8f-7589-47a5-bf53-f397bb6c34cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:41.117917 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492cc8f-7589-47a5-bf53-f397bb6c34cb None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:41.118457 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492cc8f-7589-47a5-bf53-f397bb6c34cb None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:41.118955 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492cc8f-7589-47a5-bf53-f397bb6c34cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:41.120528 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8492cc8f-7589-47a5-bf53-f397bb6c34cb None admin] RBAC: Adding query filter params (role.id=a92b520fb33f4333aad569d98be2bd7e, scope.project.id=ed25c8ba9ef240d6a532935178db1e3b, user.id=c74a1249a07c49dda5424bcaff828475) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:41.121099 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8492cc8f-7589-47a5-bf53-f397bb6c34cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:41.124230 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8492cc8f-7589-47a5-bf53-f397bb6c34cb None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:41.134342 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 562/1130] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Jun 22 08:36:40 2022] GET /identity/v3/role_assignments?user.id=c74a1249a07c49dda5424bcaff828475&scope.project.id=ed25c8ba9ef240d6a532935178db1e3b&role.id=a92b520fb33f4333aad569d98be2bd7e => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:36:43.221500 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5daa658-b8a0-4db5-bf9e-c398b9976ca7 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:43.222098 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5daa658-b8a0-4db5-bf9e-c398b9976ca7 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:43.222098 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5daa658-b8a0-4db5-bf9e-c398b9976ca7 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:43.223438 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 569/1131] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:36:43.229186 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1485f57-81b9-421b-853f-6c34280b90eb None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:43.229653 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1485f57-81b9-421b-853f-6c34280b90eb None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:43.229905 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1485f57-81b9-421b-853f-6c34280b90eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:43.248199 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-c1485f57-81b9-421b-853f-6c34280b90eb None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:36:43.249425 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-c1485f57-81b9-421b-853f-6c34280b90eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:36:43.323108 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 563/1132] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:36:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:36:43.348732 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5daa658-b8a0-4db5-bf9e-c398b9976ca7 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:43.460650 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5daa658-b8a0-4db5-bf9e-c398b9976ca7 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:43.496400 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2512126-32e8-4443-ae42-c17e4a4f8958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:43.497123 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2512126-32e8-4443-ae42-c17e4a4f8958 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:43.497937 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2512126-32e8-4443-ae42-c17e4a4f8958 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:43.498244 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2512126-32e8-4443-ae42-c17e4a4f8958 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:43.499445 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2512126-32e8-4443-ae42-c17e4a4f8958 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:43.500895 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2512126-32e8-4443-ae42-c17e4a4f8958 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:43.502550 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 570/1133] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:36:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:36:43.508688 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1485f57-81b9-421b-853f-6c34280b90eb None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:43.581241 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:43.614854 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1485f57-81b9-421b-853f-6c34280b90eb None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:43.655973 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d91aca1-f4cb-45a9-a124-b365c17d0db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:43.656644 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91aca1-f4cb-45a9-a124-b365c17d0db4 None admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:43.656932 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91aca1-f4cb-45a9-a124-b365c17d0db4 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:43.657215 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91aca1-f4cb-45a9-a124-b365c17d0db4 None admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:43.657946 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d91aca1-f4cb-45a9-a124-b365c17d0db4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:43.659423 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d91aca1-f4cb-45a9-a124-b365c17d0db4 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:43.687040 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 564/1134] 10.222.0.42 () {60 vars in 1141 bytes} [Wed Jun 22 08:36:43 2022] POST /identity/v3/projects => generated 311 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:36:45.846178 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a86a40-4f70-4d89-b655-bf119f9b52d4 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:45.846779 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a86a40-4f70-4d89-b655-bf119f9b52d4 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:45.846779 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a86a40-4f70-4d89-b655-bf119f9b52d4 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:45.848077 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 571/1135] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:36:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:36:45.853724 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d6a9c-0fb2-49ca-b46d-712813a91375 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:45.854268 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d6a9c-0fb2-49ca-b46d-712813a91375 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:45.854393 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d6a9c-0fb2-49ca-b46d-712813a91375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:45.872464 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-580d6a9c-0fb2-49ca-b46d-712813a91375 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:36:45.873665 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-580d6a9c-0fb2-49ca-b46d-712813a91375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:36:45.944152 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 565/1136] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:36:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:36:45.970096 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a86a40-4f70-4d89-b655-bf119f9b52d4 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:46.028720 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:46.079046 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a86a40-4f70-4d89-b655-bf119f9b52d4 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:46.113668 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171909fa-4b48-4ad5-b7ae-090159b371be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:46.114459 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171909fa-4b48-4ad5-b7ae-090159b371be None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:46.114784 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171909fa-4b48-4ad5-b7ae-090159b371be None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:46.115108 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171909fa-4b48-4ad5-b7ae-090159b371be None admin] PATH_INFO: `/v3/domains/default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:46.116382 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171909fa-4b48-4ad5-b7ae-090159b371be None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:46.117898 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171909fa-4b48-4ad5-b7ae-090159b371be None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:46.119600 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 572/1137] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:36:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:36:46.126343 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d6a9c-0fb2-49ca-b46d-712813a91375 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:46.181215 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:46.233119 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d6a9c-0fb2-49ca-b46d-712813a91375 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:46.274953 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcbde5b-6715-4451-a5b4-bb8357d6c881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:46.275624 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcbde5b-6715-4451-a5b4-bb8357d6c881 None admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:46.275904 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcbde5b-6715-4451-a5b4-bb8357d6c881 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:46.276177 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcbde5b-6715-4451-a5b4-bb8357d6c881 None admin] PATH_INFO: `/v3/users` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:46.276902 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcbde5b-6715-4451-a5b4-bb8357d6c881 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:46.278356 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcbde5b-6715-4451-a5b4-bb8357d6c881 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:46.301088 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 566/1138] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Jun 22 08:36:46 2022] POST /identity/v3/users => generated 286 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 08:36:48.504502 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674c614-398d-498f-8c95-8130b4f6235c None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:48.505062 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674c614-398d-498f-8c95-8130b4f6235c None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:48.505062 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674c614-398d-498f-8c95-8130b4f6235c None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:48.506390 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 573/1139] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:36:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:36:48.512275 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25caaa5-8307-4fb8-b3b1-8cb9c474b06b None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:48.512865 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25caaa5-8307-4fb8-b3b1-8cb9c474b06b None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:48.513001 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25caaa5-8307-4fb8-b3b1-8cb9c474b06b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:48.531607 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-c25caaa5-8307-4fb8-b3b1-8cb9c474b06b None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:36:48.532809 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-c25caaa5-8307-4fb8-b3b1-8cb9c474b06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:36:48.606603 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 567/1140] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:36:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:36:48.630682 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674c614-398d-498f-8c95-8130b4f6235c None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:48.747919 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674c614-398d-498f-8c95-8130b4f6235c None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:48.772291 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:48.785185 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b3142b-8d1d-4034-aab2-037730b9ed51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:48.785972 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b3142b-8d1d-4034-aab2-037730b9ed51 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:48.786476 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b3142b-8d1d-4034-aab2-037730b9ed51 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:48.786787 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b3142b-8d1d-4034-aab2-037730b9ed51 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:48.799415 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b3142b-8d1d-4034-aab2-037730b9ed51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:36:48.810233 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-58b3142b-8d1d-4034-aab2-037730b9ed51 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:36:48.810233 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:36:48.810233 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:36:48.810233 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:36:48.810233 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:36:48.810233 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:36:48.810233 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:36:48.810233 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:36:48.810233 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:36:48.810233 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:36:48.810233 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:36:48.810233 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:36:48.810233 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:36:48.810233 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:36:48.810233 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:36:48.810233 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:36:48.812286 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:36:48.812286 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:36:48.812286 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:36:48.812286 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:36:48.812286 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:36:48.812286 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:36:48.812286 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:36:48.812286 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:36:48.812286 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:36:48.812286 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:36:48.812286 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:36:48.812286 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:36:48.812286 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:36:48.812286 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:36:48.812286 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:36:48.812286 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:36:48.813800 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:36:48.813800 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:36:48.813800 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:36:48.813800 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:36:48.813800 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:36:48.813800 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:36:48.813800 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:36:48.813800 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:36:48.813800 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:36:48.813800 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:36:48.813800 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:36:48.813800 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:36:48.813800 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 574/1141] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Jun 22 08:36:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:36:48.819428 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25caaa5-8307-4fb8-b3b1-8cb9c474b06b None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:48.861340 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:48.937925 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25caaa5-8307-4fb8-b3b1-8cb9c474b06b None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:48.973762 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa6d50a-aed3-487e-9349-0eaf4929e4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:48.974458 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6d50a-aed3-487e-9349-0eaf4929e4e8 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:48.974741 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6d50a-aed3-487e-9349-0eaf4929e4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:48.975022 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6d50a-aed3-487e-9349-0eaf4929e4e8 None admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:48.975808 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa6d50a-aed3-487e-9349-0eaf4929e4e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:48.976115 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa6d50a-aed3-487e-9349-0eaf4929e4e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:48.977524 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa6d50a-aed3-487e-9349-0eaf4929e4e8 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:48.987763 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 568/1142] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Jun 22 08:36:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:36:48.995324 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b3142b-8d1d-4034-aab2-037730b9ed51 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:49.117001 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b3142b-8d1d-4034-aab2-037730b9ed51 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:49.157589 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f7a2a-6e69-466c-898d-08a6e62ced7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:49.158497 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f7a2a-6e69-466c-898d-08a6e62ced7e None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:49.158782 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f7a2a-6e69-466c-898d-08a6e62ced7e None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:49.159056 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f7a2a-6e69-466c-898d-08a6e62ced7e None admin] PATH_INFO: `/v3/users/636a2cd5c58047f0b3288dad50fc0b2e` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:49.175400 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33f7a2a-6e69-466c-898d-08a6e62ced7e None admin] RBAC: Authorizing `identity:get_user(user_id=636a2cd5c58047f0b3288dad50fc0b2e)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:49.177281 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33f7a2a-6e69-466c-898d-08a6e62ced7e None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:49.184933 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 575/1143] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Jun 22 08:36:48 2022] GET /identity/v3/users/636a2cd5c58047f0b3288dad50fc0b2e => generated 286 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:36:49.186574 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa6d50a-aed3-487e-9349-0eaf4929e4e8 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:49.314792 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:49.318001 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa6d50a-aed3-487e-9349-0eaf4929e4e8 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:49.352744 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4826d3b-8f1c-4b6c-808a-cda4bbe43bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:49.353396 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4826d3b-8f1c-4b6c-808a-cda4bbe43bf6 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:49.353684 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4826d3b-8f1c-4b6c-808a-cda4bbe43bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:49.353965 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4826d3b-8f1c-4b6c-808a-cda4bbe43bf6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:49.425056 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4826d3b-8f1c-4b6c-808a-cda4bbe43bf6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:49.426550 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4826d3b-8f1c-4b6c-808a-cda4bbe43bf6 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:49.527028 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:49.531013 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 569/1144] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Jun 22 08:36:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 08:36:49.536745 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f7a2a-6e69-466c-898d-08a6e62ced7e None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:49.583746 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:49.656728 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f7a2a-6e69-466c-898d-08a6e62ced7e None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:49.697742 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de1f672-409b-4ae7-8ba8-9926a48650c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:49.698595 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1f672-409b-4ae7-8ba8-9926a48650c9 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:49.698882 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1f672-409b-4ae7-8ba8-9926a48650c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:49.699162 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1f672-409b-4ae7-8ba8-9926a48650c9 None admin] PATH_INFO: `/v3/projects/5c73e1adc11a4527bfcf7c396d11ca4e` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:49.700585 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de1f672-409b-4ae7-8ba8-9926a48650c9 None admin] RBAC: Authorizing `identity:get_project(project_id=5c73e1adc11a4527bfcf7c396d11ca4e)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:49.702062 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de1f672-409b-4ae7-8ba8-9926a48650c9 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:49.703902 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 576/1145] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Jun 22 08:36:49 2022] GET /identity/v3/projects/5c73e1adc11a4527bfcf7c396d11ca4e => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:36:49.710370 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4826d3b-8f1c-4b6c-808a-cda4bbe43bf6 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:49.831555 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4826d3b-8f1c-4b6c-808a-cda4bbe43bf6 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:49.871559 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b1b404-46a5-4eb1-ba53-33ca37e60cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:49.872810 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1b404-46a5-4eb1-ba53-33ca37e60cf4 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:49.873097 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1b404-46a5-4eb1-ba53-33ca37e60cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:49.873382 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1b404-46a5-4eb1-ba53-33ca37e60cf4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:49.874267 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b1b404-46a5-4eb1-ba53-33ca37e60cf4 None admin] RBAC: Adding query filter params (role.id=c7518e0f532945af80c33860f2ac506d, scope.project.id=5c73e1adc11a4527bfcf7c396d11ca4e, user.id=636a2cd5c58047f0b3288dad50fc0b2e) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:49.874581 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b1b404-46a5-4eb1-ba53-33ca37e60cf4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:49.876065 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b1b404-46a5-4eb1-ba53-33ca37e60cf4 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:49.883078 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 570/1146] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Jun 22 08:36:49 2022] GET /identity/v3/role_assignments?user.id=636a2cd5c58047f0b3288dad50fc0b2e&scope.project.id=5c73e1adc11a4527bfcf7c396d11ca4e&role.id=c7518e0f532945af80c33860f2ac506d => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:36:51.979812 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00fb13-2274-413f-9476-06e04042b057 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:51.980434 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00fb13-2274-413f-9476-06e04042b057 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:51.980434 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00fb13-2274-413f-9476-06e04042b057 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:51.981771 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 577/1147] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:36:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:36:51.987677 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50de5d-6fc8-49ff-937e-d96496c27254 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:51.988190 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50de5d-6fc8-49ff-937e-d96496c27254 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:51.988360 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50de5d-6fc8-49ff-937e-d96496c27254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:52.006600 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-5a50de5d-6fc8-49ff-937e-d96496c27254 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:36:52.007825 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-5a50de5d-6fc8-49ff-937e-d96496c27254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:36:52.071950 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:52.082055 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 571/1148] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:36:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 08:36:52.124104 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f00fb13-2274-413f-9476-06e04042b057 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:52.233877 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f00fb13-2274-413f-9476-06e04042b057 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:52.245152 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:52.276973 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f12f83-6cf1-4d41-b9c3-6f8a2ff1c2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:52.277828 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f12f83-6cf1-4d41-b9c3-6f8a2ff1c2c3 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:52.278794 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f12f83-6cf1-4d41-b9c3-6f8a2ff1c2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:52.279122 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f12f83-6cf1-4d41-b9c3-6f8a2ff1c2c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:52.290486 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f12f83-6cf1-4d41-b9c3-6f8a2ff1c2c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:36:52.298722 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-76f12f83-6cf1-4d41-b9c3-6f8a2ff1c2c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:36:52.298722 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:36:52.298722 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:36:52.298722 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:36:52.298722 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:36:52.298722 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:36:52.298722 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:36:52.298722 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:36:52.298722 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:36:52.298722 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:36:52.298722 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:36:52.298722 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:36:52.298722 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:36:52.298722 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:36:52.298722 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:36:52.298722 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:36:52.300479 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:36:52.300479 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:36:52.300479 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:36:52.300479 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:36:52.300479 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:36:52.300479 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:36:52.300479 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:36:52.300479 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:36:52.300479 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:36:52.300479 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:36:52.300479 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:36:52.300479 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:36:52.300479 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:36:52.300479 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:36:52.300479 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:36:52.300479 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:36:52.301705 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:36:52.301705 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:36:52.301705 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:36:52.301705 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:36:52.301705 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:36:52.301705 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:36:52.301705 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:36:52.301705 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:36:52.301705 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:36:52.301705 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:36:52.301705 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:36:52.301705 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:36:52.301705 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 578/1149] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Jun 22 08:36:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:36:52.306434 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a50de5d-6fc8-49ff-937e-d96496c27254 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:52.421840 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a50de5d-6fc8-49ff-937e-d96496c27254 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:52.480208 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c64d4-2e0d-4682-b085-659142c04091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:52.481312 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c64d4-2e0d-4682-b085-659142c04091 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:52.482424 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c64d4-2e0d-4682-b085-659142c04091 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:52.482876 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c64d4-2e0d-4682-b085-659142c04091 None admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:52.484254 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686c64d4-2e0d-4682-b085-659142c04091 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:52.484722 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686c64d4-2e0d-4682-b085-659142c04091 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:52.487328 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686c64d4-2e0d-4682-b085-659142c04091 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:52.503317 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 572/1150] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Jun 22 08:36:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:36:52.509402 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f12f83-6cf1-4d41-b9c3-6f8a2ff1c2c3 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:52.619519 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f12f83-6cf1-4d41-b9c3-6f8a2ff1c2c3 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:52.656930 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475856ca-f3d6-4daf-9920-e68aa7209d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:52.657816 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475856ca-f3d6-4daf-9920-e68aa7209d13 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:52.658132 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475856ca-f3d6-4daf-9920-e68aa7209d13 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:52.658418 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475856ca-f3d6-4daf-9920-e68aa7209d13 None admin] PATH_INFO: `/v3/users/636a2cd5c58047f0b3288dad50fc0b2e` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:52.659657 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475856ca-f3d6-4daf-9920-e68aa7209d13 None admin] RBAC: Authorizing `identity:get_user(user_id=636a2cd5c58047f0b3288dad50fc0b2e)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:52.661105 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475856ca-f3d6-4daf-9920-e68aa7209d13 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:52.662810 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 579/1151] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Jun 22 08:36:52 2022] GET /identity/v3/users/636a2cd5c58047f0b3288dad50fc0b2e => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:36:52.668897 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c64d4-2e0d-4682-b085-659142c04091 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:52.729887 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:52.805643 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c64d4-2e0d-4682-b085-659142c04091 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:52.866565 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a1590-4e76-4b66-a0af-68e90b694623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:52.867502 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a1590-4e76-4b66-a0af-68e90b694623 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:52.867855 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a1590-4e76-4b66-a0af-68e90b694623 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:52.868189 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a1590-4e76-4b66-a0af-68e90b694623 None admin] PATH_INFO: `/v3/projects/5c73e1adc11a4527bfcf7c396d11ca4e` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:52.869579 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00a1590-4e76-4b66-a0af-68e90b694623 None admin] RBAC: Authorizing `identity:get_project(project_id=5c73e1adc11a4527bfcf7c396d11ca4e)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:52.871572 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00a1590-4e76-4b66-a0af-68e90b694623 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:52.874145 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 573/1152] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Jun 22 08:36:52 2022] GET /identity/v3/projects/5c73e1adc11a4527bfcf7c396d11ca4e => generated 311 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:36:52.880863 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475856ca-f3d6-4daf-9920-e68aa7209d13 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:52.922623 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:52.997574 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475856ca-f3d6-4daf-9920-e68aa7209d13 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:53.037006 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3104d3df-0d25-490c-81ca-74ca44d84f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:53.037910 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3104d3df-0d25-490c-81ca-74ca44d84f5e None admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:53.038234 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3104d3df-0d25-490c-81ca-74ca44d84f5e None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:53.038515 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3104d3df-0d25-490c-81ca-74ca44d84f5e None admin] PATH_INFO: `/v3/projects/5c73e1adc11a4527bfcf7c396d11ca4e/users/636a2cd5c58047f0b3288dad50fc0b2e/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:53.040550 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3104d3df-0d25-490c-81ca-74ca44d84f5e None admin] RBAC: Authorizing `identity:create_grant(project_id=5c73e1adc11a4527bfcf7c396d11ca4e, user_id=636a2cd5c58047f0b3288dad50fc0b2e, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:53.042023 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3104d3df-0d25-490c-81ca-74ca44d84f5e None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:53.058368 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 580/1153] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Jun 22 08:36:52 2022] PUT /identity/v3/projects/5c73e1adc11a4527bfcf7c396d11ca4e/users/636a2cd5c58047f0b3288dad50fc0b2e/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:36:56.600065 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956eea63-3ef8-4333-a64c-426cc8faf2d4 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:56.600675 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956eea63-3ef8-4333-a64c-426cc8faf2d4 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:56.600675 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956eea63-3ef8-4333-a64c-426cc8faf2d4 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:56.602097 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 574/1154] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:36:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:36:56.611660 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205469f5-a98a-4e2c-a711-6f01b13ef459 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:56.612189 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205469f5-a98a-4e2c-a711-6f01b13ef459 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:56.612560 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205469f5-a98a-4e2c-a711-6f01b13ef459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:56.641202 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-205469f5-a98a-4e2c-a711-6f01b13ef459 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:36:56.643466 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-205469f5-a98a-4e2c-a711-6f01b13ef459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:36:56.762887 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 581/1155] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:36:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:36:56.790766 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956eea63-3ef8-4333-a64c-426cc8faf2d4 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:56.906884 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956eea63-3ef8-4333-a64c-426cc8faf2d4 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:56.948338 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:56.961553 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be166f1a-ee36-43ae-8ba2-e99ac188eee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:56.962386 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be166f1a-ee36-43ae-8ba2-e99ac188eee3 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:56.962674 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be166f1a-ee36-43ae-8ba2-e99ac188eee3 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:56.962953 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be166f1a-ee36-43ae-8ba2-e99ac188eee3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:56.974964 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be166f1a-ee36-43ae-8ba2-e99ac188eee3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:36:56.983560 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-be166f1a-ee36-43ae-8ba2-e99ac188eee3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:36:56.983560 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:36:56.983560 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:36:56.983560 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:36:56.983560 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:36:56.983560 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:36:56.983560 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:36:56.983560 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:36:56.983560 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:36:56.983560 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:36:56.983560 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:36:56.983560 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:36:56.983560 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:36:56.983560 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:36:56.983560 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:36:56.983560 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:36:56.985459 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:36:56.985459 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:36:56.985459 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:36:56.985459 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:36:56.985459 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:36:56.985459 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:36:56.985459 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:36:56.985459 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:36:56.985459 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:36:56.985459 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:36:56.985459 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:36:56.985459 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:36:56.985459 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:36:56.985459 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:36:56.985459 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:36:56.985459 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:36:56.987527 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:36:56.987527 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:36:56.987527 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:36:56.987527 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:36:56.987527 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:36:56.987527 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:36:56.987527 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:36:56.987527 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:36:56.987527 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:36:56.987527 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:36:56.987527 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:36:56.987527 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:36:56.987527 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 575/1156] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Jun 22 08:36:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:36:56.992721 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205469f5-a98a-4e2c-a711-6f01b13ef459 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:57.022503 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:57.105615 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205469f5-a98a-4e2c-a711-6f01b13ef459 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:57.143300 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728343c2-8092-4ee5-8f71-1719ab2b6bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:57.143974 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728343c2-8092-4ee5-8f71-1719ab2b6bb8 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:57.144261 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728343c2-8092-4ee5-8f71-1719ab2b6bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:57.144540 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728343c2-8092-4ee5-8f71-1719ab2b6bb8 None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:57.145296 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728343c2-8092-4ee5-8f71-1719ab2b6bb8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:57.145610 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728343c2-8092-4ee5-8f71-1719ab2b6bb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:57.147050 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728343c2-8092-4ee5-8f71-1719ab2b6bb8 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:57.157036 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 582/1157] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Jun 22 08:36:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:36:57.165939 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be166f1a-ee36-43ae-8ba2-e99ac188eee3 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:57.275589 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be166f1a-ee36-43ae-8ba2-e99ac188eee3 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:57.313010 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d928d43f-50f9-468f-902b-3af121917b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:57.314118 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928d43f-50f9-468f-902b-3af121917b84 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:57.314463 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928d43f-50f9-468f-902b-3af121917b84 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:57.314789 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928d43f-50f9-468f-902b-3af121917b84 None admin] PATH_INFO: `/v3/users/636a2cd5c58047f0b3288dad50fc0b2e` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:57.316097 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d928d43f-50f9-468f-902b-3af121917b84 None admin] RBAC: Authorizing `identity:get_user(user_id=636a2cd5c58047f0b3288dad50fc0b2e)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:57.317815 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d928d43f-50f9-468f-902b-3af121917b84 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:57.319546 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 576/1158] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Jun 22 08:36:57 2022] GET /identity/v3/users/636a2cd5c58047f0b3288dad50fc0b2e => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:36:57.326058 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728343c2-8092-4ee5-8f71-1719ab2b6bb8 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:57.425628 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:57.440138 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728343c2-8092-4ee5-8f71-1719ab2b6bb8 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:57.475297 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124746ed-a3ba-4d61-b113-05b5614c9d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:57.475955 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124746ed-a3ba-4d61-b113-05b5614c9d12 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:57.476241 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124746ed-a3ba-4d61-b113-05b5614c9d12 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:57.476520 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124746ed-a3ba-4d61-b113-05b5614c9d12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:57.549124 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124746ed-a3ba-4d61-b113-05b5614c9d12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:57.550944 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124746ed-a3ba-4d61-b113-05b5614c9d12 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:57.652738 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:57.668329 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 583/1159] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Jun 22 08:36:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 22 08:36:57.675144 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d928d43f-50f9-468f-902b-3af121917b84 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:57.739329 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:36:57.797941 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d928d43f-50f9-468f-902b-3af121917b84 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:57.837565 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa79c329-289c-494f-bdb6-fe76c80edbc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:57.838457 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79c329-289c-494f-bdb6-fe76c80edbc0 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:57.838745 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79c329-289c-494f-bdb6-fe76c80edbc0 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:57.839024 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79c329-289c-494f-bdb6-fe76c80edbc0 None admin] PATH_INFO: `/v3/projects/5c73e1adc11a4527bfcf7c396d11ca4e` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:57.840303 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa79c329-289c-494f-bdb6-fe76c80edbc0 None admin] RBAC: Authorizing `identity:get_project(project_id=5c73e1adc11a4527bfcf7c396d11ca4e)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:57.841754 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa79c329-289c-494f-bdb6-fe76c80edbc0 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:57.843548 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 577/1160] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Jun 22 08:36:57 2022] GET /identity/v3/projects/5c73e1adc11a4527bfcf7c396d11ca4e => generated 311 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:36:57.850513 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124746ed-a3ba-4d61-b113-05b5614c9d12 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:36:57.957292 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124746ed-a3ba-4d61-b113-05b5614c9d12 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:36:57.994581 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728786ae-7386-4c3a-88ad-8581b1f46786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:36:57.995157 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728786ae-7386-4c3a-88ad-8581b1f46786 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:36:57.995443 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728786ae-7386-4c3a-88ad-8581b1f46786 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:36:57.995724 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728786ae-7386-4c3a-88ad-8581b1f46786 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:36:57.997124 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728786ae-7386-4c3a-88ad-8581b1f46786 None admin] RBAC: Adding query filter params (role.id=c7518e0f532945af80c33860f2ac506d, scope.project.id=5c73e1adc11a4527bfcf7c396d11ca4e, user.id=636a2cd5c58047f0b3288dad50fc0b2e) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:36:57.997454 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728786ae-7386-4c3a-88ad-8581b1f46786 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:36:57.998923 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728786ae-7386-4c3a-88ad-8581b1f46786 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:36:58.005183 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 584/1161] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Jun 22 08:36:57 2022] GET /identity/v3/role_assignments?user.id=636a2cd5c58047f0b3288dad50fc0b2e&scope.project.id=5c73e1adc11a4527bfcf7c396d11ca4e&role.id=c7518e0f532945af80c33860f2ac506d => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:37:00.128290 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec137232-f429-4c7a-a3ce-93c2d9fca576 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:37:00.128896 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec137232-f429-4c7a-a3ce-93c2d9fca576 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:37:00.128896 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec137232-f429-4c7a-a3ce-93c2d9fca576 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:37:00.130404 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 578/1162] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:37:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:37:00.136307 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35096e06-83f0-4945-9bdc-c3726d258d71 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:37:00.136900 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35096e06-83f0-4945-9bdc-c3726d258d71 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:37:00.136900 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35096e06-83f0-4945-9bdc-c3726d258d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:37:00.156238 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-35096e06-83f0-4945-9bdc-c3726d258d71 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:37:00.157461 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-35096e06-83f0-4945-9bdc-c3726d258d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:37:00.211322 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:37:00.234459 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 585/1163] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:37:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:37:00.257474 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec137232-f429-4c7a-a3ce-93c2d9fca576 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:37:00.363705 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec137232-f429-4c7a-a3ce-93c2d9fca576 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:37:00.387783 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:37:00.403944 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd891f-516f-400e-86ce-e4aeb068f107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:37:00.404595 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd891f-516f-400e-86ce-e4aeb068f107 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:37:00.404879 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd891f-516f-400e-86ce-e4aeb068f107 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:37:00.405155 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd891f-516f-400e-86ce-e4aeb068f107 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:37:00.475552 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcd891f-516f-400e-86ce-e4aeb068f107 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:37:00.476984 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcd891f-516f-400e-86ce-e4aeb068f107 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:37:00.586428 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 579/1164] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Jun 22 08:37:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 08:37:00.593185 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35096e06-83f0-4945-9bdc-c3726d258d71 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:37:00.695573 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35096e06-83f0-4945-9bdc-c3726d258d71 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:37:00.731977 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da233f-f8ba-42b5-8aa6-8410dd87f7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:37:00.732851 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da233f-f8ba-42b5-8aa6-8410dd87f7a8 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:37:00.733177 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da233f-f8ba-42b5-8aa6-8410dd87f7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:37:00.733497 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da233f-f8ba-42b5-8aa6-8410dd87f7a8 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:37:00.740712 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8da233f-f8ba-42b5-8aa6-8410dd87f7a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:37:00.742260 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8da233f-f8ba-42b5-8aa6-8410dd87f7a8 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:37:00.756692 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-c8da233f-f8ba-42b5-8aa6-8410dd87f7a8 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 22 08:37:00.756692 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:37:00.756692 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 22 08:37:00.756692 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 22 08:37:00.756692 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:37:00.756692 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:37:00.756692 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:37:00.756692 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:37:00.756692 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 22 08:37:00.756692 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:37:00.756692 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:37:00.756692 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:37:00.756692 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:37:00.756692 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:37:00.756692 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:37:00.756692 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:37:00.756692 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:37:00.758656 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:37:00.758656 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:37:00.758656 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:37:00.758656 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:37:00.758656 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:37:00.758656 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:37:00.758656 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:37:00.758656 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:37:00.758656 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:37:00.758656 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:37:00.758656 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:37:00.758656 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:37:00.758656 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:37:00.758656 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:37:00.758656 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:37:00.758656 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:37:00.760273 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:37:00.760273 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:37:00.760273 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:37:00.760273 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:37:00.760273 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:37:00.760273 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:37:00.760273 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:37:00.760273 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:37:00.760273 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:37:00.760273 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:37:00.760273 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 22 08:37:00.760273 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:37:00.760273 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 22 08:37:00.760273 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:37:00.760273 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 586/1165] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Jun 22 08:37:00 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:37:00.765483 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd891f-516f-400e-86ce-e4aeb068f107 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:37:00.787410 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:37:00.869625 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd891f-516f-400e-86ce-e4aeb068f107 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:37:00.905032 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0916e95-e67c-499c-bacd-a66ad4c3231d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:37:00.905690 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0916e95-e67c-499c-bacd-a66ad4c3231d None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:37:00.905975 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0916e95-e67c-499c-bacd-a66ad4c3231d None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:37:00.906283 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0916e95-e67c-499c-bacd-a66ad4c3231d None admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:37:00.907007 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0916e95-e67c-499c-bacd-a66ad4c3231d None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:37:00.907313 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0916e95-e67c-499c-bacd-a66ad4c3231d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:37:00.908667 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0916e95-e67c-499c-bacd-a66ad4c3231d None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:37:00.915922 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 580/1166] 10.222.0.42 () {56 vars in 1115 bytes} [Wed Jun 22 08:37:00 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:37:02.970555 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156b500-7779-4ac0-8718-d5e02bc08142 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:37:02.971150 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156b500-7779-4ac0-8718-d5e02bc08142 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:37:02.971150 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156b500-7779-4ac0-8718-d5e02bc08142 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:37:02.972589 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 587/1167] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:37:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:37:02.978382 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5bac33-9996-4be8-a2a3-a97e0c4979fa None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:37:02.978908 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5bac33-9996-4be8-a2a3-a97e0c4979fa None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:37:02.979044 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5bac33-9996-4be8-a2a3-a97e0c4979fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:37:02.996102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-ca5bac33-9996-4be8-a2a3-a97e0c4979fa None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:37:02.997903 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-ca5bac33-9996-4be8-a2a3-a97e0c4979fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:37:03.069967 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 581/1168] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:37:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:37:03.093601 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f156b500-7779-4ac0-8718-d5e02bc08142 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:37:03.141695 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:37:03.203323 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f156b500-7779-4ac0-8718-d5e02bc08142 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:37:03.240619 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ab71f-5412-4827-9d98-48602e750a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:37:03.241271 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ab71f-5412-4827-9d98-48602e750a06 None admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:37:03.241599 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ab71f-5412-4827-9d98-48602e750a06 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:37:03.241923 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ab71f-5412-4827-9d98-48602e750a06 None admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:37:03.242798 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845ab71f-5412-4827-9d98-48602e750a06 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:37:03.244259 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845ab71f-5412-4827-9d98-48602e750a06 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:37:03.265037 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 588/1169] 10.222.0.42 () {60 vars in 1138 bytes} [Wed Jun 22 08:37:03 2022] POST /identity/v3/domains => generated 267 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 08:37:05.447956 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8338c7e-09d1-4654-b6f4-bc616dfa64ff None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:37:05.448492 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8338c7e-09d1-4654-b6f4-bc616dfa64ff None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:37:05.448661 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8338c7e-09d1-4654-b6f4-bc616dfa64ff None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:37:05.450123 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 582/1170] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:37:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:37:05.455985 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f4a7b-70f0-47ba-ac5f-b9c9c0fe99ed None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:37:05.456495 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f4a7b-70f0-47ba-ac5f-b9c9c0fe99ed None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:37:05.456613 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f4a7b-70f0-47ba-ac5f-b9c9c0fe99ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:37:05.473814 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-638f4a7b-70f0-47ba-ac5f-b9c9c0fe99ed None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:37:05.475108 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-638f4a7b-70f0-47ba-ac5f-b9c9c0fe99ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:37:05.548563 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 589/1171] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:37:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 08:37:05.572467 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8338c7e-09d1-4654-b6f4-bc616dfa64ff None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:37:05.589216 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:37:05.679365 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8338c7e-09d1-4654-b6f4-bc616dfa64ff None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:37:05.715872 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8bb1cf-4b00-40f4-ba5d-fcd034148511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:37:05.716767 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8bb1cf-4b00-40f4-ba5d-fcd034148511 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:37:05.717049 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8bb1cf-4b00-40f4-ba5d-fcd034148511 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:37:05.717323 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8bb1cf-4b00-40f4-ba5d-fcd034148511 None admin] PATH_INFO: `/v3/domains/cfd97d7cdb5940f39c3d9b4ccfedd16b` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:37:05.730205 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8bb1cf-4b00-40f4-ba5d-fcd034148511 None admin] RBAC: Authorizing `identity:get_domain(domain_id=cfd97d7cdb5940f39c3d9b4ccfedd16b)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:37:05.732081 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8bb1cf-4b00-40f4-ba5d-fcd034148511 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:37:05.734025 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 583/1172] 10.222.0.42 () {56 vars in 1183 bytes} [Wed Jun 22 08:37:05 2022] GET /identity/v3/domains/cfd97d7cdb5940f39c3d9b4ccfedd16b => generated 267 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:37:05.743154 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f4a7b-70f0-47ba-ac5f-b9c9c0fe99ed None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:37:05.780437 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:37:05.864444 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f4a7b-70f0-47ba-ac5f-b9c9c0fe99ed None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:37:05.904990 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b22bb1-6c69-4cf6-8bca-c70cf4285587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:37:05.905661 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b22bb1-6c69-4cf6-8bca-c70cf4285587 None admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:37:05.905942 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b22bb1-6c69-4cf6-8bca-c70cf4285587 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:37:05.906254 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b22bb1-6c69-4cf6-8bca-c70cf4285587 None admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:37:05.906995 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b22bb1-6c69-4cf6-8bca-c70cf4285587 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:37:05.908469 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b22bb1-6c69-4cf6-8bca-c70cf4285587 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:37:05.937122 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 590/1173] 10.222.0.42 () {60 vars in 1141 bytes} [Wed Jun 22 08:37:05 2022] POST /identity/v3/projects => generated 361 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:37:08.067968 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f2bcf-5d4a-4a29-8d92-d8216359fe95 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:37:08.068581 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f2bcf-5d4a-4a29-8d92-d8216359fe95 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:37:08.068581 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f2bcf-5d4a-4a29-8d92-d8216359fe95 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:37:08.069945 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 584/1174] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:37:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:37:08.076025 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ef8c8-aae5-48c1-b69b-74886460e11d None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:37:08.076593 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ef8c8-aae5-48c1-b69b-74886460e11d None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:37:08.076593 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ef8c8-aae5-48c1-b69b-74886460e11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:37:08.095543 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-696ef8c8-aae5-48c1-b69b-74886460e11d None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:37:08.096792 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-696ef8c8-aae5-48c1-b69b-74886460e11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:37:08.173904 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 591/1175] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:37:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:37:08.199516 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f2bcf-5d4a-4a29-8d92-d8216359fe95 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:37:08.286244 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:37:08.331954 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f2bcf-5d4a-4a29-8d92-d8216359fe95 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:37:08.389468 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f60b2-6f09-4dcc-b728-e39feee6cbd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:37:08.390962 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f60b2-6f09-4dcc-b728-e39feee6cbd8 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:37:08.391468 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f60b2-6f09-4dcc-b728-e39feee6cbd8 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:37:08.391983 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f60b2-6f09-4dcc-b728-e39feee6cbd8 None admin] PATH_INFO: `/v3/domains/cfd97d7cdb5940f39c3d9b4ccfedd16b` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:37:08.394379 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757f60b2-6f09-4dcc-b728-e39feee6cbd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=cfd97d7cdb5940f39c3d9b4ccfedd16b)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:37:08.397046 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757f60b2-6f09-4dcc-b728-e39feee6cbd8 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:37:08.400028 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 585/1176] 10.222.0.42 () {56 vars in 1183 bytes} [Wed Jun 22 08:37:08 2022] GET /identity/v3/domains/cfd97d7cdb5940f39c3d9b4ccfedd16b => generated 267 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:37:08.406667 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ef8c8-aae5-48c1-b69b-74886460e11d None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:37:08.422329 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:37:08.518744 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ef8c8-aae5-48c1-b69b-74886460e11d None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:37:08.555216 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac29ec15-9588-4f3a-b9cb-de3c987dddc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:37:08.555887 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29ec15-9588-4f3a-b9cb-de3c987dddc0 None admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:37:08.556173 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29ec15-9588-4f3a-b9cb-de3c987dddc0 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:37:08.556453 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29ec15-9588-4f3a-b9cb-de3c987dddc0 None admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:37:08.557202 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac29ec15-9588-4f3a-b9cb-de3c987dddc0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:37:08.559272 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac29ec15-9588-4f3a-b9cb-de3c987dddc0 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:37:08.582996 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 592/1177] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Jun 22 08:37:08 2022] POST /identity/v3/users => generated 311 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 08:37:10.906382 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2aa5a3-964b-4806-8002-424619af02f2 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:37:10.906985 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2aa5a3-964b-4806-8002-424619af02f2 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:37:10.906985 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2aa5a3-964b-4806-8002-424619af02f2 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:37:10.908312 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 586/1178] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:37:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:37:10.914134 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba77c6c8-74ea-456b-83c0-1be8bdbf7af4 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:37:10.914755 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba77c6c8-74ea-456b-83c0-1be8bdbf7af4 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:37:10.914892 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba77c6c8-74ea-456b-83c0-1be8bdbf7af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:37:10.932756 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-ba77c6c8-74ea-456b-83c0-1be8bdbf7af4 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:37:10.934595 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-ba77c6c8-74ea-456b-83c0-1be8bdbf7af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:37:11.004186 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:37:11.009907 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 593/1179] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:37:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:37:11.036726 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2aa5a3-964b-4806-8002-424619af02f2 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:37:11.153894 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2aa5a3-964b-4806-8002-424619af02f2 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:37:11.189707 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3419fce7-c7b1-4a3e-9bc1-6d78ee2aa6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:37:11.190439 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3419fce7-c7b1-4a3e-9bc1-6d78ee2aa6da None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:37:11.190728 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3419fce7-c7b1-4a3e-9bc1-6d78ee2aa6da None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:37:11.191007 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3419fce7-c7b1-4a3e-9bc1-6d78ee2aa6da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:37:11.201762 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3419fce7-c7b1-4a3e-9bc1-6d78ee2aa6da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:37:11.209439 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-3419fce7-c7b1-4a3e-9bc1-6d78ee2aa6da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:37:11.209439 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:37:11.209439 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:37:11.209439 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:37:11.209439 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:37:11.209439 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:37:11.209439 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:37:11.209439 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:37:11.209439 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:37:11.209439 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:37:11.209439 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:37:11.209439 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:37:11.209439 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:37:11.209439 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:37:11.209439 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:37:11.209439 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:37:11.211128 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:37:11.211128 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:37:11.211128 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:37:11.211128 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:37:11.211128 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:37:11.211128 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:37:11.211128 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:37:11.211128 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:37:11.211128 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:37:11.211128 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:37:11.211128 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:37:11.211128 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:37:11.211128 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:37:11.211128 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:37:11.211128 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:37:11.211128 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:37:11.212674 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:37:11.212674 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:37:11.212674 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:37:11.212674 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:37:11.212674 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:37:11.212674 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:37:11.212674 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:37:11.212674 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:37:11.212674 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:37:11.212674 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:37:11.212674 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:37:11.212674 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:37:11.214269 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 587/1180] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Jun 22 08:37:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:37:11.217673 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba77c6c8-74ea-456b-83c0-1be8bdbf7af4 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:37:11.334358 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba77c6c8-74ea-456b-83c0-1be8bdbf7af4 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:37:11.373439 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c7b1d-b466-417a-90e2-5ce48862d740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:37:11.374136 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c7b1d-b466-417a-90e2-5ce48862d740 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:37:11.374423 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c7b1d-b466-417a-90e2-5ce48862d740 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:37:11.374702 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c7b1d-b466-417a-90e2-5ce48862d740 None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:37:11.375465 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0c7b1d-b466-417a-90e2-5ce48862d740 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:37:11.375777 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0c7b1d-b466-417a-90e2-5ce48862d740 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:37:11.377163 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0c7b1d-b466-417a-90e2-5ce48862d740 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:37:11.386505 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 594/1181] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Jun 22 08:37:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:37:11.392878 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3419fce7-c7b1-4a3e-9bc1-6d78ee2aa6da None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:37:11.395940 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:37:11.505271 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3419fce7-c7b1-4a3e-9bc1-6d78ee2aa6da None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:37:11.543233 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6804c195-0959-4809-87d9-b3704d7c0533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:37:11.544119 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804c195-0959-4809-87d9-b3704d7c0533 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:37:11.544409 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804c195-0959-4809-87d9-b3704d7c0533 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:37:11.544690 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804c195-0959-4809-87d9-b3704d7c0533 None admin] PATH_INFO: `/v3/users/a8067f0026a34bdaab909a9b0e9560c6` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:37:11.560841 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6804c195-0959-4809-87d9-b3704d7c0533 None admin] RBAC: Authorizing `identity:get_user(user_id=a8067f0026a34bdaab909a9b0e9560c6)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:37:11.562381 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6804c195-0959-4809-87d9-b3704d7c0533 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:37:11.564300 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 588/1182] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Jun 22 08:37:11 2022] GET /identity/v3/users/a8067f0026a34bdaab909a9b0e9560c6 => generated 311 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:37:11.572286 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c7b1d-b466-417a-90e2-5ce48862d740 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:37:11.647231 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:37:11.691569 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c7b1d-b466-417a-90e2-5ce48862d740 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:37:11.728954 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f7484-29cb-47f2-975a-172597f37084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:37:11.729688 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f7484-29cb-47f2-975a-172597f37084 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:37:11.730594 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f7484-29cb-47f2-975a-172597f37084 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:37:11.731041 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f7484-29cb-47f2-975a-172597f37084 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:37:11.805871 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12f7484-29cb-47f2-975a-172597f37084 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:37:11.807369 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12f7484-29cb-47f2-975a-172597f37084 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:37:11.874243 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:37:11.918341 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 595/1183] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Jun 22 08:37:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 08:37:11.926422 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6804c195-0959-4809-87d9-b3704d7c0533 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:37:12.022021 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:37:12.066880 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6804c195-0959-4809-87d9-b3704d7c0533 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:37:12.103961 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5007e9-c888-42ce-a6f1-271df41cdc76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:37:12.104890 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5007e9-c888-42ce-a6f1-271df41cdc76 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:37:12.105805 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5007e9-c888-42ce-a6f1-271df41cdc76 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:37:12.106166 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5007e9-c888-42ce-a6f1-271df41cdc76 None admin] PATH_INFO: `/v3/projects/97d645c6c05f439480be301d389ae079` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:37:12.107451 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5007e9-c888-42ce-a6f1-271df41cdc76 None admin] RBAC: Authorizing `identity:get_project(project_id=97d645c6c05f439480be301d389ae079)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:37:12.108942 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5007e9-c888-42ce-a6f1-271df41cdc76 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:37:12.110764 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 589/1184] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Jun 22 08:37:11 2022] GET /identity/v3/projects/97d645c6c05f439480be301d389ae079 => generated 361 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:37:12.117172 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f7484-29cb-47f2-975a-172597f37084 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:37:12.226283 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f7484-29cb-47f2-975a-172597f37084 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:37:12.267632 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9756c121-0aa4-4b27-a88a-1e81ed7a17e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:37:12.268404 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9756c121-0aa4-4b27-a88a-1e81ed7a17e4 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:37:12.268725 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9756c121-0aa4-4b27-a88a-1e81ed7a17e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:37:12.269064 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9756c121-0aa4-4b27-a88a-1e81ed7a17e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:37:12.269936 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9756c121-0aa4-4b27-a88a-1e81ed7a17e4 None admin] RBAC: Adding query filter params (role.id=c7518e0f532945af80c33860f2ac506d, scope.project.id=97d645c6c05f439480be301d389ae079, user.id=a8067f0026a34bdaab909a9b0e9560c6) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:37:12.270312 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9756c121-0aa4-4b27-a88a-1e81ed7a17e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:37:12.271811 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9756c121-0aa4-4b27-a88a-1e81ed7a17e4 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:37:12.279059 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 596/1185] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Jun 22 08:37:12 2022] GET /identity/v3/role_assignments?user.id=a8067f0026a34bdaab909a9b0e9560c6&scope.project.id=97d645c6c05f439480be301d389ae079&role.id=c7518e0f532945af80c33860f2ac506d => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:37:14.389623 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896c5d9-edd8-4083-8ccc-e344a941ff23 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:37:14.390235 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896c5d9-edd8-4083-8ccc-e344a941ff23 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:37:14.390235 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896c5d9-edd8-4083-8ccc-e344a941ff23 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:37:14.391705 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 590/1186] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:37:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:37:14.398773 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8ac66-3a8c-4da0-80a3-e5594592ea89 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:37:14.399300 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8ac66-3a8c-4da0-80a3-e5594592ea89 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:37:14.399811 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8ac66-3a8c-4da0-80a3-e5594592ea89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:37:14.427932 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-57e8ac66-3a8c-4da0-80a3-e5594592ea89 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:37:14.430005 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-57e8ac66-3a8c-4da0-80a3-e5594592ea89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:37:14.467998 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:37:14.530515 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 597/1187] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:37:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:37:14.553406 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2896c5d9-edd8-4083-8ccc-e344a941ff23 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:37:14.659757 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2896c5d9-edd8-4083-8ccc-e344a941ff23 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:37:14.690291 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:37:14.699698 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a095280-19ca-44ac-848b-467931c4e9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:37:14.700497 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a095280-19ca-44ac-848b-467931c4e9b9 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:37:14.700779 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a095280-19ca-44ac-848b-467931c4e9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:37:14.701052 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a095280-19ca-44ac-848b-467931c4e9b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:37:14.713725 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a095280-19ca-44ac-848b-467931c4e9b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:37:14.722268 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-5a095280-19ca-44ac-848b-467931c4e9b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:37:14.722268 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:37:14.722268 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:37:14.722268 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:37:14.722268 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:37:14.722268 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:37:14.722268 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:37:14.722268 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:37:14.722268 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:37:14.722268 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:37:14.722268 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:37:14.722268 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:37:14.722268 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:37:14.722268 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:37:14.722268 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:37:14.722268 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:37:14.723489 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:37:14.723489 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:37:14.723489 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:37:14.723489 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:37:14.723489 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:37:14.723489 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:37:14.723489 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:37:14.723489 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:37:14.723489 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:37:14.723489 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:37:14.723489 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:37:14.723489 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:37:14.723489 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:37:14.723489 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:37:14.723489 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:37:14.723489 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:37:14.724537 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:37:14.724537 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:37:14.724537 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:37:14.724537 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:37:14.724537 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:37:14.724537 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:37:14.724537 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:37:14.724537 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:37:14.724537 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:37:14.724537 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:37:14.724537 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:37:14.724537 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:37:14.724537 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 591/1188] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Jun 22 08:37:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:37:14.730816 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e8ac66-3a8c-4da0-80a3-e5594592ea89 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:37:14.841270 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e8ac66-3a8c-4da0-80a3-e5594592ea89 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:37:14.876458 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96867318-89b1-44bd-aa9b-177b39e232d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:37:14.877127 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96867318-89b1-44bd-aa9b-177b39e232d5 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:37:14.877411 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96867318-89b1-44bd-aa9b-177b39e232d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:37:14.877687 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96867318-89b1-44bd-aa9b-177b39e232d5 None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:37:14.878467 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96867318-89b1-44bd-aa9b-177b39e232d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:37:14.878778 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96867318-89b1-44bd-aa9b-177b39e232d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:37:14.880155 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96867318-89b1-44bd-aa9b-177b39e232d5 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:37:14.890851 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 598/1189] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Jun 22 08:37:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:37:14.901178 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a095280-19ca-44ac-848b-467931c4e9b9 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:37:15.032428 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a095280-19ca-44ac-848b-467931c4e9b9 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:37:15.071083 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe60b2-5c4c-4441-bb2c-e0417717a22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:37:15.072019 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe60b2-5c4c-4441-bb2c-e0417717a22c None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:37:15.072341 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe60b2-5c4c-4441-bb2c-e0417717a22c None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:37:15.072660 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe60b2-5c4c-4441-bb2c-e0417717a22c None admin] PATH_INFO: `/v3/users/a8067f0026a34bdaab909a9b0e9560c6` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:37:15.074591 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fe60b2-5c4c-4441-bb2c-e0417717a22c None admin] RBAC: Authorizing `identity:get_user(user_id=a8067f0026a34bdaab909a9b0e9560c6)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:37:15.076093 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fe60b2-5c4c-4441-bb2c-e0417717a22c None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:37:15.077786 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 592/1190] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Jun 22 08:37:14 2022] GET /identity/v3/users/a8067f0026a34bdaab909a9b0e9560c6 => generated 311 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:37:15.084365 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96867318-89b1-44bd-aa9b-177b39e232d5 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:37:15.106237 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:37:15.193169 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96867318-89b1-44bd-aa9b-177b39e232d5 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:37:15.232548 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5fec8-8687-43de-bd91-9427a4ed7eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:37:15.233493 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5fec8-8687-43de-bd91-9427a4ed7eb2 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:37:15.233834 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5fec8-8687-43de-bd91-9427a4ed7eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:37:15.234183 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5fec8-8687-43de-bd91-9427a4ed7eb2 None admin] PATH_INFO: `/v3/projects/97d645c6c05f439480be301d389ae079` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:37:15.235617 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e5fec8-8687-43de-bd91-9427a4ed7eb2 None admin] RBAC: Authorizing `identity:get_project(project_id=97d645c6c05f439480be301d389ae079)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:37:15.237175 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e5fec8-8687-43de-bd91-9427a4ed7eb2 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:37:15.239089 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 599/1191] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Jun 22 08:37:15 2022] GET /identity/v3/projects/97d645c6c05f439480be301d389ae079 => generated 361 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:37:15.249283 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe60b2-5c4c-4441-bb2c-e0417717a22c None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:37:15.318476 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:37:15.369537 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe60b2-5c4c-4441-bb2c-e0417717a22c None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:37:15.407400 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9188017-1aed-4a8e-be70-eadc62714dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:37:15.408293 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9188017-1aed-4a8e-be70-eadc62714dee None admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:37:15.408578 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9188017-1aed-4a8e-be70-eadc62714dee None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:37:15.408855 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9188017-1aed-4a8e-be70-eadc62714dee None admin] PATH_INFO: `/v3/projects/97d645c6c05f439480be301d389ae079/users/a8067f0026a34bdaab909a9b0e9560c6/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:37:15.411005 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9188017-1aed-4a8e-be70-eadc62714dee None admin] RBAC: Authorizing `identity:create_grant(project_id=97d645c6c05f439480be301d389ae079, user_id=a8067f0026a34bdaab909a9b0e9560c6, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:37:15.412462 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9188017-1aed-4a8e-be70-eadc62714dee None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:37:15.432323 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 593/1192] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Jun 22 08:37:15 2022] PUT /identity/v3/projects/97d645c6c05f439480be301d389ae079/users/a8067f0026a34bdaab909a9b0e9560c6/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:37:17.531583 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ccaf3-444c-45ae-83e9-7506e7f97ba9 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:37:17.532114 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ccaf3-444c-45ae-83e9-7506e7f97ba9 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:37:17.532114 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ccaf3-444c-45ae-83e9-7506e7f97ba9 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:37:17.533436 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 600/1193] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:37:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:37:17.539129 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36140b3d-5c42-4d4b-98d7-54ee6ae35910 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:37:17.539862 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36140b3d-5c42-4d4b-98d7-54ee6ae35910 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:37:17.539862 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36140b3d-5c42-4d4b-98d7-54ee6ae35910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:37:17.557061 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-36140b3d-5c42-4d4b-98d7-54ee6ae35910 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:37:17.558920 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-36140b3d-5c42-4d4b-98d7-54ee6ae35910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:37:17.627701 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 594/1194] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:37:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 08:37:17.652915 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ccaf3-444c-45ae-83e9-7506e7f97ba9 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:37:17.748426 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:37:17.766691 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ccaf3-444c-45ae-83e9-7506e7f97ba9 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:37:17.805051 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c8c61-0914-4110-9acc-4f21eae7e5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:37:17.805767 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c8c61-0914-4110-9acc-4f21eae7e5a0 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:37:17.806055 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c8c61-0914-4110-9acc-4f21eae7e5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:37:17.806374 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c8c61-0914-4110-9acc-4f21eae7e5a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:37:17.818531 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917c8c61-0914-4110-9acc-4f21eae7e5a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:37:17.827014 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-917c8c61-0914-4110-9acc-4f21eae7e5a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:37:17.827014 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:37:17.827014 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:37:17.827014 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:37:17.827014 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:37:17.827014 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:37:17.827014 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:37:17.827014 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:37:17.827014 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:37:17.827014 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:37:17.827014 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:37:17.827014 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:37:17.827014 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:37:17.827014 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:37:17.827014 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:37:17.827014 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:37:17.828706 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:37:17.828706 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:37:17.828706 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:37:17.828706 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:37:17.828706 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:37:17.828706 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:37:17.828706 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:37:17.828706 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:37:17.828706 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:37:17.828706 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:37:17.828706 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:37:17.828706 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:37:17.828706 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:37:17.828706 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:37:17.828706 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:37:17.828706 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:37:17.830439 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:37:17.830439 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:37:17.830439 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:37:17.830439 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:37:17.830439 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:37:17.830439 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:37:17.830439 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:37:17.830439 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:37:17.830439 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:37:17.830439 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:37:17.830439 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:37:17.830439 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:37:17.830439 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 601/1195] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Jun 22 08:37:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:37:17.835910 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36140b3d-5c42-4d4b-98d7-54ee6ae35910 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:37:17.883711 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:37:17.941628 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36140b3d-5c42-4d4b-98d7-54ee6ae35910 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:37:17.977799 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdcc2c1-5234-448c-b151-0c1c65cb4d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:37:17.978490 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdcc2c1-5234-448c-b151-0c1c65cb4d86 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:37:17.978773 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdcc2c1-5234-448c-b151-0c1c65cb4d86 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:37:17.979046 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdcc2c1-5234-448c-b151-0c1c65cb4d86 None admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:37:17.980424 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdcc2c1-5234-448c-b151-0c1c65cb4d86 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:37:17.980729 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdcc2c1-5234-448c-b151-0c1c65cb4d86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:37:17.982158 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdcc2c1-5234-448c-b151-0c1c65cb4d86 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:37:17.990862 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 595/1196] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Jun 22 08:37:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:37:18.000776 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c8c61-0914-4110-9acc-4f21eae7e5a0 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:37:18.169418 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c8c61-0914-4110-9acc-4f21eae7e5a0 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:37:18.227172 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2713a62d-01ea-4c1e-b971-033c6fa98ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:37:18.228615 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713a62d-01ea-4c1e-b971-033c6fa98ce6 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:37:18.229125 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713a62d-01ea-4c1e-b971-033c6fa98ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:37:18.230225 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713a62d-01ea-4c1e-b971-033c6fa98ce6 None admin] PATH_INFO: `/v3/users/a8067f0026a34bdaab909a9b0e9560c6` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:37:18.232284 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2713a62d-01ea-4c1e-b971-033c6fa98ce6 None admin] RBAC: Authorizing `identity:get_user(user_id=a8067f0026a34bdaab909a9b0e9560c6)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:37:18.235019 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2713a62d-01ea-4c1e-b971-033c6fa98ce6 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:37:18.238057 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 602/1197] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Jun 22 08:37:17 2022] GET /identity/v3/users/a8067f0026a34bdaab909a9b0e9560c6 => generated 311 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:37:18.243919 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdcc2c1-5234-448c-b151-0c1c65cb4d86 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:37:18.353287 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdcc2c1-5234-448c-b151-0c1c65cb4d86 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:37:18.363068 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:37:18.389592 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840a0559-c128-4e8d-b37c-6065a054bc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:37:18.390275 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a0559-c128-4e8d-b37c-6065a054bc89 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:37:18.390566 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a0559-c128-4e8d-b37c-6065a054bc89 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:37:18.390849 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a0559-c128-4e8d-b37c-6065a054bc89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:37:18.461926 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840a0559-c128-4e8d-b37c-6065a054bc89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:37:18.463363 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840a0559-c128-4e8d-b37c-6065a054bc89 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:37:18.570165 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 596/1198] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Jun 22 08:37:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 22 08:37:18.577003 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2713a62d-01ea-4c1e-b971-033c6fa98ce6 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:37:18.603710 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:37:18.749403 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2713a62d-01ea-4c1e-b971-033c6fa98ce6 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:37:18.787325 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e8f0b4-0c61-40a2-b20b-f562417de626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:37:18.788254 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8f0b4-0c61-40a2-b20b-f562417de626 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:37:18.788581 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8f0b4-0c61-40a2-b20b-f562417de626 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:37:18.788902 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8f0b4-0c61-40a2-b20b-f562417de626 None admin] PATH_INFO: `/v3/projects/97d645c6c05f439480be301d389ae079` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:37:18.790173 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e8f0b4-0c61-40a2-b20b-f562417de626 None admin] RBAC: Authorizing `identity:get_project(project_id=97d645c6c05f439480be301d389ae079)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:37:18.791669 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e8f0b4-0c61-40a2-b20b-f562417de626 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:37:18.794046 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 603/1199] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Jun 22 08:37:18 2022] GET /identity/v3/projects/97d645c6c05f439480be301d389ae079 => generated 361 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:37:18.800398 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840a0559-c128-4e8d-b37c-6065a054bc89 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:37:18.811721 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:37:18.913359 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840a0559-c128-4e8d-b37c-6065a054bc89 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:37:18.952255 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52aad6e-f16f-434c-b697-cb5071a8c253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:37:18.952926 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52aad6e-f16f-434c-b697-cb5071a8c253 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:37:18.953215 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52aad6e-f16f-434c-b697-cb5071a8c253 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:37:18.953494 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52aad6e-f16f-434c-b697-cb5071a8c253 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:37:18.954366 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52aad6e-f16f-434c-b697-cb5071a8c253 None admin] RBAC: Adding query filter params (role.id=c7518e0f532945af80c33860f2ac506d, scope.project.id=97d645c6c05f439480be301d389ae079, user.id=a8067f0026a34bdaab909a9b0e9560c6) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:37:18.954683 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52aad6e-f16f-434c-b697-cb5071a8c253 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:37:18.956120 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52aad6e-f16f-434c-b697-cb5071a8c253 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:37:18.962940 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 597/1200] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Jun 22 08:37:18 2022] GET /identity/v3/role_assignments?user.id=a8067f0026a34bdaab909a9b0e9560c6&scope.project.id=97d645c6c05f439480be301d389ae079&role.id=c7518e0f532945af80c33860f2ac506d => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:37:28.783102 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=59 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:37:28.959757 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=64 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:38:19.675191 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c761f1-1deb-4d64-8156-e41ced08dc23 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:19.676207 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c761f1-1deb-4d64-8156-e41ced08dc23 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:19.676207 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c761f1-1deb-4d64-8156-e41ced08dc23 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:19.677312 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 604/1201] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:38:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:38:19.683346 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb8032-d6ba-4035-b7c6-6d99b5ba51c0 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:19.684152 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb8032-d6ba-4035-b7c6-6d99b5ba51c0 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:19.684152 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb8032-d6ba-4035-b7c6-6d99b5ba51c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:19.705602 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-a0eb8032-d6ba-4035-b7c6-6d99b5ba51c0 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:38:19.708198 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-a0eb8032-d6ba-4035-b7c6-6d99b5ba51c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:38:19.858102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 598/1202] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:38:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:38:19.872956 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c761f1-1deb-4d64-8156-e41ced08dc23 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:20.093269 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c761f1-1deb-4d64-8156-e41ced08dc23 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:20.172305 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eaf6bf-0451-4806-abce-c53dde9e0284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:20.174163 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eaf6bf-0451-4806-abce-c53dde9e0284 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:20.174899 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eaf6bf-0451-4806-abce-c53dde9e0284 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:20.175397 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eaf6bf-0451-4806-abce-c53dde9e0284 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:20.206139 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eaf6bf-0451-4806-abce-c53dde9e0284 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:20.206139 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eaf6bf-0451-4806-abce-c53dde9e0284 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:20.241916 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-97eaf6bf-0451-4806-abce-c53dde9e0284 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:38:20.241916 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:38:20.241916 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:38:20.241916 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:38:20.241916 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:38:20.241916 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:38:20.241916 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:38:20.241916 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:38:20.241916 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:38:20.241916 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:38:20.241916 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:38:20.241916 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:38:20.241916 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:38:20.241916 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:38:20.241916 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:38:20.243302 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:38:20.243302 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:38:20.243302 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:38:20.243302 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:38:20.243302 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:38:20.243302 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:38:20.243302 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:38:20.243302 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:38:20.243302 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:38:20.243302 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:38:20.243302 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:38:20.243302 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:38:20.243302 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:38:20.243302 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:38:20.243302 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:38:20.243302 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:38:20.243302 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:38:20.244390 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:38:20.244390 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:38:20.244390 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:38:20.244390 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:38:20.244947 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 605/1203] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:38:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:38:20.256808 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb8032-d6ba-4035-b7c6-6d99b5ba51c0 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:20.446537 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb8032-d6ba-4035-b7c6-6d99b5ba51c0 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:20.516872 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:38:20.528635 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb105d-73e3-4f60-926d-10c2cc757f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:20.529701 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb105d-73e3-4f60-926d-10c2cc757f8a None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:20.530203 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb105d-73e3-4f60-926d-10c2cc757f8a None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:20.530712 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb105d-73e3-4f60-926d-10c2cc757f8a None admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:20.532993 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeb105d-73e3-4f60-926d-10c2cc757f8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:38:20.533810 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeb105d-73e3-4f60-926d-10c2cc757f8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:20.536545 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeb105d-73e3-4f60-926d-10c2cc757f8a None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:20.567110 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 599/1204] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:38:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:38:20.575812 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eaf6bf-0451-4806-abce-c53dde9e0284 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:20.665148 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:38:20.756241 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eaf6bf-0451-4806-abce-c53dde9e0284 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:20.827592 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78395d74-622e-4b97-8d10-d17f31e98044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:20.828781 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78395d74-622e-4b97-8d10-d17f31e98044 None admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:20.829299 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78395d74-622e-4b97-8d10-d17f31e98044 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:20.829826 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78395d74-622e-4b97-8d10-d17f31e98044 None admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:20.831283 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78395d74-622e-4b97-8d10-d17f31e98044 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:20.834149 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78395d74-622e-4b97-8d10-d17f31e98044 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:20.872754 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 606/1205] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Jun 22 08:38:20 2022] POST /identity/v3/users => generated 251 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 08:38:24.076309 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f0269-91dc-4292-b473-1d7ab73f1e32 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:24.076961 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f0269-91dc-4292-b473-1d7ab73f1e32 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:24.077585 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f0269-91dc-4292-b473-1d7ab73f1e32 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:24.080239 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 600/1206] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:38:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:38:24.089546 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d238d8e-0f61-45c6-b3d8-513bcdd35998 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:24.090418 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d238d8e-0f61-45c6-b3d8-513bcdd35998 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:24.090418 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d238d8e-0f61-45c6-b3d8-513bcdd35998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:24.115387 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-0d238d8e-0f61-45c6-b3d8-513bcdd35998 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:38:24.118311 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-0d238d8e-0f61-45c6-b3d8-513bcdd35998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:38:24.244139 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 607/1207] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:38:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:38:24.271373 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f0269-91dc-4292-b473-1d7ab73f1e32 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:24.468887 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f0269-91dc-4292-b473-1d7ab73f1e32 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:24.532949 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e0a0b-ec2d-43d7-9b89-cf830c391ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:24.533741 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e0a0b-ec2d-43d7-9b89-cf830c391ba9 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:24.534035 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e0a0b-ec2d-43d7-9b89-cf830c391ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:24.534338 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e0a0b-ec2d-43d7-9b89-cf830c391ba9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:24.551081 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e0a0b-ec2d-43d7-9b89-cf830c391ba9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:38:24.566494 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-b18e0a0b-ec2d-43d7-9b89-cf830c391ba9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:38:24.566494 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:38:24.566494 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:38:24.566494 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:38:24.566494 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:38:24.566494 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:38:24.566494 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:38:24.566494 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:38:24.566494 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:38:24.566494 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:38:24.566494 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:38:24.566494 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:38:24.566494 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:38:24.566494 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:38:24.566494 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:38:24.566494 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:38:24.568721 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:38:24.568721 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:38:24.568721 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:38:24.568721 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:38:24.568721 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:38:24.568721 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:38:24.568721 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:38:24.568721 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:38:24.568721 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:38:24.568721 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:38:24.568721 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:38:24.568721 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:38:24.568721 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:38:24.568721 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:38:24.568721 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:38:24.568721 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:38:24.569956 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:38:24.569956 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:38:24.569956 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:38:24.569956 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:38:24.569956 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:38:24.569956 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:38:24.569956 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:38:24.569956 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:38:24.569956 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:38:24.569956 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:38:24.569956 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:38:24.569956 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:38:24.569956 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 601/1208] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Jun 22 08:38:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:38:24.583488 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d238d8e-0f61-45c6-b3d8-513bcdd35998 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:24.657539 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:38:24.773182 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d238d8e-0f61-45c6-b3d8-513bcdd35998 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:24.839343 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a9356-79c9-4edd-ab5b-9363ac486eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:24.840167 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a9356-79c9-4edd-ab5b-9363ac486eb2 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:24.840609 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a9356-79c9-4edd-ab5b-9363ac486eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:24.841432 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a9356-79c9-4edd-ab5b-9363ac486eb2 None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:24.842824 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a9356-79c9-4edd-ab5b-9363ac486eb2 None admin] RBAC: Adding query filter params (name=service) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:38:24.843441 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a9356-79c9-4edd-ab5b-9363ac486eb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:24.845928 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a9356-79c9-4edd-ab5b-9363ac486eb2 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:24.870127 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 608/1209] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Jun 22 08:38:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:38:24.872444 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e0a0b-ec2d-43d7-9b89-cf830c391ba9 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:24.965994 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:38:25.052804 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e0a0b-ec2d-43d7-9b89-cf830c391ba9 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:25.106673 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fc3fec-f0fc-4c17-829a-8250474d9bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:25.108103 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc3fec-f0fc-4c17-829a-8250474d9bfa None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:25.108539 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc3fec-f0fc-4c17-829a-8250474d9bfa None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:25.108994 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc3fec-f0fc-4c17-829a-8250474d9bfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:25.125762 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fc3fec-f0fc-4c17-829a-8250474d9bfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:25.128995 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fc3fec-f0fc-4c17-829a-8250474d9bfa None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:25.155194 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-93fc3fec-f0fc-4c17-829a-8250474d9bfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:38:25.155194 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:38:25.155194 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:38:25.155194 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:38:25.155194 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:38:25.155194 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:38:25.155194 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:38:25.155194 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:38:25.155194 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:38:25.155194 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:38:25.155194 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:38:25.155194 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:38:25.155194 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:38:25.155194 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:38:25.155194 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:38:25.157306 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:38:25.157306 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:38:25.157306 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:38:25.157306 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:38:25.157306 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:38:25.157306 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:38:25.157306 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:38:25.157306 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:38:25.157306 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:38:25.157306 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:38:25.157306 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:38:25.157306 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:38:25.157306 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:38:25.157306 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:38:25.157306 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:38:25.157306 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:38:25.157306 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:38:25.164705 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:38:25.164705 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:38:25.164705 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:38:25.164705 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:38:25.164705 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 602/1210] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:38:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:38:25.165275 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a9356-79c9-4edd-ab5b-9363ac486eb2 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:25.354846 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:38:25.358523 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a9356-79c9-4edd-ab5b-9363ac486eb2 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:25.402116 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67b59ce-c75e-4c27-bef4-095f9e6f1d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:25.402867 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b59ce-c75e-4c27-bef4-095f9e6f1d9e None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:25.403369 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b59ce-c75e-4c27-bef4-095f9e6f1d9e None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:25.403648 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b59ce-c75e-4c27-bef4-095f9e6f1d9e None admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:25.404533 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67b59ce-c75e-4c27-bef4-095f9e6f1d9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:38:25.404921 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67b59ce-c75e-4c27-bef4-095f9e6f1d9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:25.406474 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67b59ce-c75e-4c27-bef4-095f9e6f1d9e None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:25.426109 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 609/1211] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:38:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:38:25.430954 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fc3fec-f0fc-4c17-829a-8250474d9bfa None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:25.608929 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fc3fec-f0fc-4c17-829a-8250474d9bfa None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:25.611266 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:38:25.667804 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc248e-d01a-4830-a708-06d0ceb12772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:25.669585 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc248e-d01a-4830-a708-06d0ceb12772 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:25.670156 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc248e-d01a-4830-a708-06d0ceb12772 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:25.670565 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc248e-d01a-4830-a708-06d0ceb12772 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:25.684833 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cc248e-d01a-4830-a708-06d0ceb12772 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:25.687424 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cc248e-d01a-4830-a708-06d0ceb12772 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:25.712823 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-26cc248e-d01a-4830-a708-06d0ceb12772 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 22 08:38:25.712823 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:38:25.712823 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:38:25.712823 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:38:25.712823 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:38:25.712823 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:38:25.712823 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:38:25.712823 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:38:25.712823 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:38:25.712823 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:38:25.712823 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:38:25.712823 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:38:25.712823 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:38:25.712823 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:38:25.712823 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:38:25.712823 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:38:25.715218 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:38:25.715218 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:38:25.715218 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:38:25.715218 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:38:25.715218 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:38:25.715218 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:38:25.715218 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:38:25.715218 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:38:25.715218 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:38:25.715218 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:38:25.715218 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:38:25.715218 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:38:25.715218 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:38:25.715218 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:38:25.715218 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:38:25.715218 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:38:25.715218 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:38:25.715218 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:38:25.717194 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:38:25.717194 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:38:25.717194 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:38:25.717194 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:38:25.717194 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:38:25.717194 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:38:25.717194 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:38:25.717194 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:38:25.717194 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 22 08:38:25.717194 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:38:25.717194 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 603/1212] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:38:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:38:25.723360 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67b59ce-c75e-4c27-bef4-095f9e6f1d9e None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:25.926019 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67b59ce-c75e-4c27-bef4-095f9e6f1d9e None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:25.995383 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01589c2d-83e6-4867-a0c1-7f450ccaf846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:25.996731 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01589c2d-83e6-4867-a0c1-7f450ccaf846 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:25.997337 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01589c2d-83e6-4867-a0c1-7f450ccaf846 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:25.997846 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01589c2d-83e6-4867-a0c1-7f450ccaf846 None admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:25.999640 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01589c2d-83e6-4867-a0c1-7f450ccaf846 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:38:26.000194 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01589c2d-83e6-4867-a0c1-7f450ccaf846 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:26.003132 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01589c2d-83e6-4867-a0c1-7f450ccaf846 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:26.038439 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 610/1213] 10.222.0.42 () {56 vars in 1143 bytes} [Wed Jun 22 08:38:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:38:26.044736 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc248e-d01a-4830-a708-06d0ceb12772 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:26.210336 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc248e-d01a-4830-a708-06d0ceb12772 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:26.277581 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529adba8-0467-49f0-9e13-5364b0ed6e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:26.278748 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529adba8-0467-49f0-9e13-5364b0ed6e4a None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:26.279307 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529adba8-0467-49f0-9e13-5364b0ed6e4a None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:26.279752 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529adba8-0467-49f0-9e13-5364b0ed6e4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:26.338160 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:38:26.409557 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529adba8-0467-49f0-9e13-5364b0ed6e4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:26.412174 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529adba8-0467-49f0-9e13-5364b0ed6e4a None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:26.562198 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 604/1214] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Jun 22 08:38:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 08:38:26.571780 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01589c2d-83e6-4867-a0c1-7f450ccaf846 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:26.596316 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:38:26.718598 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01589c2d-83e6-4867-a0c1-7f450ccaf846 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:26.785033 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfba5f2-9987-41e8-a0e3-dfdb2125b466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:26.786499 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfba5f2-9987-41e8-a0e3-dfdb2125b466 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:26.787027 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfba5f2-9987-41e8-a0e3-dfdb2125b466 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:26.787553 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfba5f2-9987-41e8-a0e3-dfdb2125b466 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:26.810667 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfba5f2-9987-41e8-a0e3-dfdb2125b466 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:26.812158 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfba5f2-9987-41e8-a0e3-dfdb2125b466 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:26.849541 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-6cfba5f2-9987-41e8-a0e3-dfdb2125b466 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:38:26.849541 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:38:26.849541 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:38:26.849541 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:38:26.849541 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:38:26.849541 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:38:26.849541 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:38:26.849541 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:38:26.849541 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:38:26.849541 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:38:26.849541 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:38:26.849541 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:38:26.849541 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:38:26.849541 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:38:26.849541 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:38:26.850807 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:38:26.850807 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:38:26.850807 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:38:26.850807 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:38:26.850807 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:38:26.850807 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:38:26.850807 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:38:26.850807 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:38:26.850807 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:38:26.850807 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:38:26.850807 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:38:26.850807 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:38:26.850807 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:38:26.850807 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:38:26.850807 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:38:26.850807 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:38:26.850807 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:38:26.851957 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:38:26.851957 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:38:26.851957 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:38:26.851957 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:38:26.858549 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 611/1215] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:38:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:38:26.860262 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529adba8-0467-49f0-9e13-5364b0ed6e4a None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:27.004995 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:38:27.071353 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529adba8-0467-49f0-9e13-5364b0ed6e4a None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:27.124703 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615ba90-6464-40b1-acd4-c50e9e92cbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:27.125741 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615ba90-6464-40b1-acd4-c50e9e92cbd7 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:27.126287 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615ba90-6464-40b1-acd4-c50e9e92cbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:27.126784 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615ba90-6464-40b1-acd4-c50e9e92cbd7 None admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:27.128074 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1615ba90-6464-40b1-acd4-c50e9e92cbd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:38:27.128637 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1615ba90-6464-40b1-acd4-c50e9e92cbd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:27.130886 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1615ba90-6464-40b1-acd4-c50e9e92cbd7 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:27.153632 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 605/1216] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:38:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:38:27.160706 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfba5f2-9987-41e8-a0e3-dfdb2125b466 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:27.263545 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:38:27.311432 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfba5f2-9987-41e8-a0e3-dfdb2125b466 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:27.369122 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40dc91-7a53-475e-beaf-eba294bc0072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:27.370028 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40dc91-7a53-475e-beaf-eba294bc0072 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:27.370375 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40dc91-7a53-475e-beaf-eba294bc0072 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:27.370732 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40dc91-7a53-475e-beaf-eba294bc0072 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:27.380867 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40dc91-7a53-475e-beaf-eba294bc0072 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:27.384305 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40dc91-7a53-475e-beaf-eba294bc0072 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:27.412160 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-ed40dc91-7a53-475e-beaf-eba294bc0072 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:38:27.412160 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:38:27.412160 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:38:27.412160 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:38:27.412160 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:38:27.412160 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:38:27.412160 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:38:27.412160 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:38:27.412160 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:38:27.412160 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:38:27.412160 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:38:27.412160 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:38:27.412160 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:38:27.412160 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:38:27.412160 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:38:27.414428 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:38:27.414428 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:38:27.414428 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:38:27.414428 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:38:27.414428 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:38:27.414428 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:38:27.414428 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:38:27.414428 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:38:27.414428 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:38:27.414428 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:38:27.414428 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:38:27.414428 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:38:27.414428 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:38:27.414428 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:38:27.414428 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:38:27.414428 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:38:27.414428 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:38:27.416169 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:38:27.416169 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:38:27.416169 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:38:27.416169 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:38:27.416169 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:38:27.416169 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:38:27.416169 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:38:27.416169 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:38:27.416169 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 612/1217] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Jun 22 08:38:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:38:27.422574 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615ba90-6464-40b1-acd4-c50e9e92cbd7 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:27.563333 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615ba90-6464-40b1-acd4-c50e9e92cbd7 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:27.593822 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:38:27.609807 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a971d59-dc01-4093-bce3-af675a0ca64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:27.610653 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a971d59-dc01-4093-bce3-af675a0ca64d None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:27.611025 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a971d59-dc01-4093-bce3-af675a0ca64d None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:27.611403 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a971d59-dc01-4093-bce3-af675a0ca64d None admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:27.612332 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a971d59-dc01-4093-bce3-af675a0ca64d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:38:27.612760 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a971d59-dc01-4093-bce3-af675a0ca64d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:27.614384 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a971d59-dc01-4093-bce3-af675a0ca64d None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:27.628772 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 606/1218] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Jun 22 08:38:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:38:27.638789 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40dc91-7a53-475e-beaf-eba294bc0072 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:27.792720 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40dc91-7a53-475e-beaf-eba294bc0072 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:27.837467 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:38:27.845792 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec30fe0-8d93-4c6c-8626-99b89aa40b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:27.846663 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec30fe0-8d93-4c6c-8626-99b89aa40b48 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:27.847052 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec30fe0-8d93-4c6c-8626-99b89aa40b48 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:27.847455 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec30fe0-8d93-4c6c-8626-99b89aa40b48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:27.848479 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec30fe0-8d93-4c6c-8626-99b89aa40b48 None admin] RBAC: Adding query filter params (role.id=e67c237283fd404d9a2bdf1333109696, scope.project.id=e1f161193cb440fa8c4a9d23820a5c28, user.id=ec2627e3cdc94ec38d7cc3b1bc670ef1) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:38:27.848946 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec30fe0-8d93-4c6c-8626-99b89aa40b48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:27.851362 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec30fe0-8d93-4c6c-8626-99b89aa40b48 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:27.858986 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 613/1219] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Jun 22 08:38:27 2022] GET /identity/v3/role_assignments?user.id=ec2627e3cdc94ec38d7cc3b1bc670ef1&scope.project.id=e1f161193cb440fa8c4a9d23820a5c28&role.id=e67c237283fd404d9a2bdf1333109696 => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:38:30.366608 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555a486-5581-475d-ad6e-346362035938 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:30.367740 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555a486-5581-475d-ad6e-346362035938 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:30.367740 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555a486-5581-475d-ad6e-346362035938 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:30.368820 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 607/1220] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:38:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:38:30.376042 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66488712-ea5a-4b77-9344-ef0d9c1382e3 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:30.376961 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66488712-ea5a-4b77-9344-ef0d9c1382e3 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:30.376961 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66488712-ea5a-4b77-9344-ef0d9c1382e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:30.401454 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-66488712-ea5a-4b77-9344-ef0d9c1382e3 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:38:30.402823 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-66488712-ea5a-4b77-9344-ef0d9c1382e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:38:30.509525 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 614/1221] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:38:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:38:30.538665 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5555a486-5581-475d-ad6e-346362035938 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:30.678648 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5555a486-5581-475d-ad6e-346362035938 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:30.725985 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a445e-0c97-413e-b67a-a2ce7612e9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:30.726948 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a445e-0c97-413e-b67a-a2ce7612e9e3 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:30.727329 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a445e-0c97-413e-b67a-a2ce7612e9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:30.727702 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a445e-0c97-413e-b67a-a2ce7612e9e3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:30.741477 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a445e-0c97-413e-b67a-a2ce7612e9e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:38:30.749669 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-5b4a445e-0c97-413e-b67a-a2ce7612e9e3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:38:30.749669 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:38:30.749669 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:38:30.749669 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:38:30.749669 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:38:30.749669 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:38:30.749669 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:38:30.749669 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:38:30.749669 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:38:30.749669 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:38:30.749669 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:38:30.749669 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:38:30.749669 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:38:30.749669 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:38:30.749669 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:38:30.749669 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:38:30.751840 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:38:30.751840 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:38:30.751840 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:38:30.751840 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:38:30.751840 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:38:30.751840 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:38:30.751840 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:38:30.751840 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:38:30.751840 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:38:30.751840 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:38:30.751840 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:38:30.751840 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:38:30.751840 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:38:30.751840 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:38:30.751840 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:38:30.751840 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:38:30.753580 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:38:30.753580 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:38:30.753580 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:38:30.753580 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:38:30.753580 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:38:30.753580 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:38:30.753580 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:38:30.753580 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:38:30.753580 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:38:30.753580 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:38:30.753580 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:38:30.753580 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:38:30.753580 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 608/1222] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Jun 22 08:38:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:38:30.759018 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66488712-ea5a-4b77-9344-ef0d9c1382e3 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:30.916003 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66488712-ea5a-4b77-9344-ef0d9c1382e3 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:30.958786 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:38:30.972108 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51e75c0-10ee-4062-98c5-7c9d657cbf2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:30.972865 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e75c0-10ee-4062-98c5-7c9d657cbf2a None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:30.973223 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e75c0-10ee-4062-98c5-7c9d657cbf2a None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:30.973610 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e75c0-10ee-4062-98c5-7c9d657cbf2a None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:30.974568 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51e75c0-10ee-4062-98c5-7c9d657cbf2a None admin] RBAC: Adding query filter params (name=service) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:38:30.975662 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51e75c0-10ee-4062-98c5-7c9d657cbf2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:30.977670 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51e75c0-10ee-4062-98c5-7c9d657cbf2a None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:30.992746 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 615/1223] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Jun 22 08:38:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:38:31.000672 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a445e-0c97-413e-b67a-a2ce7612e9e3 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:31.070987 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:38:31.146510 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a445e-0c97-413e-b67a-a2ce7612e9e3 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:31.190409 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf7388-931b-4235-b675-e6079f0e1659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:31.191040 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf7388-931b-4235-b675-e6079f0e1659 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:31.191328 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf7388-931b-4235-b675-e6079f0e1659 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:31.191607 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf7388-931b-4235-b675-e6079f0e1659 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:31.208496 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaf7388-931b-4235-b675-e6079f0e1659 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:31.210585 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaf7388-931b-4235-b675-e6079f0e1659 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:31.228803 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-aeaf7388-931b-4235-b675-e6079f0e1659 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:38:31.228803 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:38:31.228803 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:38:31.228803 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:38:31.228803 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:38:31.228803 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:38:31.228803 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:38:31.228803 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:38:31.228803 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:38:31.228803 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:38:31.228803 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:38:31.228803 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:38:31.228803 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:38:31.228803 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:38:31.228803 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:38:31.230623 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:38:31.230623 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:38:31.230623 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:38:31.230623 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:38:31.230623 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:38:31.230623 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:38:31.230623 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:38:31.230623 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:38:31.230623 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:38:31.230623 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:38:31.230623 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:38:31.230623 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:38:31.230623 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:38:31.230623 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:38:31.230623 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:38:31.230623 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:38:31.230623 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:38:31.232352 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:38:31.232352 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:38:31.232352 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:38:31.232352 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:38:31.232352 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 609/1224] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:38:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:38:31.237307 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51e75c0-10ee-4062-98c5-7c9d657cbf2a None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:31.350522 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51e75c0-10ee-4062-98c5-7c9d657cbf2a None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:31.405055 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c02627b-cbc9-4183-9253-e6a728c61ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:31.406267 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02627b-cbc9-4183-9253-e6a728c61ac3 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:31.406799 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02627b-cbc9-4183-9253-e6a728c61ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:31.407269 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02627b-cbc9-4183-9253-e6a728c61ac3 None admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:31.408732 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c02627b-cbc9-4183-9253-e6a728c61ac3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:38:31.409306 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c02627b-cbc9-4183-9253-e6a728c61ac3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:31.412089 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c02627b-cbc9-4183-9253-e6a728c61ac3 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:31.442164 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 616/1225] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:38:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:38:31.443315 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf7388-931b-4235-b675-e6079f0e1659 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:31.583587 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:38:31.592979 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf7388-931b-4235-b675-e6079f0e1659 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:31.644674 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ff0ac-654d-43ec-be4e-5a165317059e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:31.646109 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ff0ac-654d-43ec-be4e-5a165317059e None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:31.646645 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ff0ac-654d-43ec-be4e-5a165317059e None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:31.647735 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ff0ac-654d-43ec-be4e-5a165317059e None admin] PATH_INFO: `/v3/users/placement` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:31.662904 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3ff0ac-654d-43ec-be4e-5a165317059e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:31.665755 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3ff0ac-654d-43ec-be4e-5a165317059e None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:31.683087 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-9b3ff0ac-654d-43ec-be4e-5a165317059e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 22 08:38:31.683087 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:38:31.683087 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:38:31.683087 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:38:31.683087 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:38:31.683087 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:38:31.683087 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:38:31.683087 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:38:31.683087 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:38:31.683087 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:38:31.683087 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:38:31.683087 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:38:31.683087 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:38:31.683087 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:38:31.683087 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:38:31.683087 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:38:31.691519 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:38:31.691519 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:38:31.691519 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:38:31.691519 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:38:31.691519 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:38:31.691519 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:38:31.691519 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:38:31.691519 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:38:31.691519 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:38:31.691519 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:38:31.691519 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:38:31.691519 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:38:31.691519 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:38:31.691519 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:38:31.691519 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:38:31.691519 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:38:31.691519 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:38:31.691519 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:38:31.693294 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:38:31.693294 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:38:31.693294 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:38:31.693294 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:38:31.693294 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:38:31.693294 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:38:31.693294 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:38:31.693294 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:38:31.693294 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 22 08:38:31.693294 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:38:31.693294 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 610/1226] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:38:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:38:31.694738 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c02627b-cbc9-4183-9253-e6a728c61ac3 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:31.751029 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:38:31.825899 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c02627b-cbc9-4183-9253-e6a728c61ac3 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:31.877768 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7a606-2693-448d-94e1-e868782955de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:31.879185 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7a606-2693-448d-94e1-e868782955de None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:31.879768 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7a606-2693-448d-94e1-e868782955de None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:31.880503 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7a606-2693-448d-94e1-e868782955de None admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:31.882107 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c7a606-2693-448d-94e1-e868782955de None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:38:31.882666 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c7a606-2693-448d-94e1-e868782955de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:31.885421 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c7a606-2693-448d-94e1-e868782955de None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:31.918845 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 617/1227] 10.222.0.42 () {56 vars in 1143 bytes} [Wed Jun 22 08:38:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:38:31.925027 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ff0ac-654d-43ec-be4e-5a165317059e None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:32.093647 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ff0ac-654d-43ec-be4e-5a165317059e None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:32.140138 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be926ace-bd1a-451a-b157-958ec6df6e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:32.141152 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be926ace-bd1a-451a-b157-958ec6df6e90 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:32.141607 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be926ace-bd1a-451a-b157-958ec6df6e90 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:32.142051 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be926ace-bd1a-451a-b157-958ec6df6e90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:32.162663 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be926ace-bd1a-451a-b157-958ec6df6e90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:32.165393 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be926ace-bd1a-451a-b157-958ec6df6e90 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:32.190115 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-be926ace-bd1a-451a-b157-958ec6df6e90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:38:32.190115 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:38:32.190115 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:38:32.190115 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:38:32.190115 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:38:32.190115 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:38:32.190115 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:38:32.190115 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:38:32.190115 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:38:32.190115 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:38:32.190115 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:38:32.190115 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:38:32.190115 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:38:32.190115 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:38:32.190115 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:38:32.192001 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:38:32.192001 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:38:32.192001 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:38:32.192001 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:38:32.192001 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:38:32.192001 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:38:32.192001 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:38:32.192001 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:38:32.192001 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:38:32.192001 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:38:32.192001 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:38:32.192001 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:38:32.192001 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:38:32.192001 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:38:32.192001 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:38:32.192001 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:38:32.192001 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:38:32.193415 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:38:32.193415 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:38:32.193415 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:38:32.193415 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:38:32.193415 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 611/1228] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:38:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:38:32.199781 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7a606-2693-448d-94e1-e868782955de None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:32.359394 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7a606-2693-448d-94e1-e868782955de None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:32.363169 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:38:32.414482 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d4753-7477-4e0d-9f7d-59766e927e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:32.415290 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d4753-7477-4e0d-9f7d-59766e927e96 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:32.415710 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d4753-7477-4e0d-9f7d-59766e927e96 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:32.416064 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d4753-7477-4e0d-9f7d-59766e927e96 None admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:32.417027 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541d4753-7477-4e0d-9f7d-59766e927e96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:38:32.417397 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541d4753-7477-4e0d-9f7d-59766e927e96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:32.419376 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541d4753-7477-4e0d-9f7d-59766e927e96 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:32.434520 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 618/1229] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:38:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:38:32.440769 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be926ace-bd1a-451a-b157-958ec6df6e90 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:32.452274 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:38:32.573936 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be926ace-bd1a-451a-b157-958ec6df6e90 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:32.616738 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a299384b-0e72-4fc5-a44e-a49108c9368b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:32.617738 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299384b-0e72-4fc5-a44e-a49108c9368b None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:32.618197 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299384b-0e72-4fc5-a44e-a49108c9368b None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:32.618636 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299384b-0e72-4fc5-a44e-a49108c9368b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:32.631862 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a299384b-0e72-4fc5-a44e-a49108c9368b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:32.634595 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a299384b-0e72-4fc5-a44e-a49108c9368b None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:32.662412 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-a299384b-0e72-4fc5-a44e-a49108c9368b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:38:32.662412 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:38:32.662412 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:38:32.662412 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:38:32.662412 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:38:32.662412 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:38:32.662412 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:38:32.662412 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:38:32.662412 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:38:32.662412 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:38:32.662412 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:38:32.662412 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:38:32.662412 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:38:32.662412 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:38:32.662412 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:38:32.663780 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:38:32.663780 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:38:32.663780 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:38:32.663780 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:38:32.663780 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:38:32.663780 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:38:32.663780 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:38:32.663780 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:38:32.663780 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:38:32.663780 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:38:32.663780 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:38:32.663780 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:38:32.663780 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:38:32.663780 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:38:32.663780 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:38:32.663780 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:38:32.663780 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:38:32.665242 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:38:32.665242 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:38:32.665242 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:38:32.665242 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:38:32.665242 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:38:32.665242 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:38:32.665242 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:38:32.665242 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:38:32.665242 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 612/1230] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Jun 22 08:38:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:38:32.671521 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d4753-7477-4e0d-9f7d-59766e927e96 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:32.813739 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d4753-7477-4e0d-9f7d-59766e927e96 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:32.868385 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd6666-dc7b-4c8d-818f-b39beca4f3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:32.869027 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd6666-dc7b-4c8d-818f-b39beca4f3ab None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:32.869258 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd6666-dc7b-4c8d-818f-b39beca4f3ab None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:32.869533 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd6666-dc7b-4c8d-818f-b39beca4f3ab None admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:32.870374 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bd6666-dc7b-4c8d-818f-b39beca4f3ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:38:32.870721 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bd6666-dc7b-4c8d-818f-b39beca4f3ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:32.872191 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bd6666-dc7b-4c8d-818f-b39beca4f3ab None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:32.886847 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 619/1231] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Jun 22 08:38:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:38:32.893397 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a299384b-0e72-4fc5-a44e-a49108c9368b None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:32.978411 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:38:33.024610 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a299384b-0e72-4fc5-a44e-a49108c9368b None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:33.071784 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a910bd-73f9-43ac-824f-c112d902a053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:33.072771 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a910bd-73f9-43ac-824f-c112d902a053 None admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:33.072996 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a910bd-73f9-43ac-824f-c112d902a053 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:33.073273 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a910bd-73f9-43ac-824f-c112d902a053 None admin] PATH_INFO: `/v3/projects/e1f161193cb440fa8c4a9d23820a5c28/users/ec2627e3cdc94ec38d7cc3b1bc670ef1/roles/e67c237283fd404d9a2bdf1333109696` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:33.103986 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a910bd-73f9-43ac-824f-c112d902a053 None admin] RBAC: Authorizing `identity:create_grant(project_id=e1f161193cb440fa8c4a9d23820a5c28, user_id=ec2627e3cdc94ec38d7cc3b1bc670ef1, role_id=e67c237283fd404d9a2bdf1333109696)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:33.106703 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a910bd-73f9-43ac-824f-c112d902a053 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:33.128877 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 613/1232] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Jun 22 08:38:32 2022] PUT /identity/v3/projects/e1f161193cb440fa8c4a9d23820a5c28/users/ec2627e3cdc94ec38d7cc3b1bc670ef1/roles/e67c237283fd404d9a2bdf1333109696 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 08:38:35.338938 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64879583-faec-45a7-bae9-f22a52de23ce None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:35.339685 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64879583-faec-45a7-bae9-f22a52de23ce None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:35.339910 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64879583-faec-45a7-bae9-f22a52de23ce None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:35.342659 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 620/1233] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:38:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:38:35.349546 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807beeec-b403-48b9-98ce-91083ca165e8 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:35.350960 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807beeec-b403-48b9-98ce-91083ca165e8 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:35.350960 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807beeec-b403-48b9-98ce-91083ca165e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:35.375191 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-807beeec-b403-48b9-98ce-91083ca165e8 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:38:35.376782 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-807beeec-b403-48b9-98ce-91083ca165e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:38:35.463475 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 614/1234] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:38:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 08:38:35.487851 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64879583-faec-45a7-bae9-f22a52de23ce None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:35.516251 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:38:35.611922 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64879583-faec-45a7-bae9-f22a52de23ce None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:35.654772 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc0dfe-8c42-45c2-98a8-284e889c8b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:35.655794 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc0dfe-8c42-45c2-98a8-284e889c8b81 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:35.656126 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc0dfe-8c42-45c2-98a8-284e889c8b81 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:35.656511 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc0dfe-8c42-45c2-98a8-284e889c8b81 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:35.670613 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fc0dfe-8c42-45c2-98a8-284e889c8b81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:38:35.678573 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-c0fc0dfe-8c42-45c2-98a8-284e889c8b81 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:38:35.678573 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:38:35.678573 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:38:35.678573 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:38:35.678573 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:38:35.678573 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:38:35.678573 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:38:35.678573 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:38:35.678573 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:38:35.678573 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:38:35.678573 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:38:35.678573 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:38:35.678573 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:38:35.678573 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:38:35.678573 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:38:35.678573 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:38:35.680592 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:38:35.680592 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:38:35.680592 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:38:35.680592 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:38:35.680592 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:38:35.680592 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:38:35.680592 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:38:35.680592 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:38:35.680592 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:38:35.680592 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:38:35.680592 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:38:35.680592 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:38:35.680592 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:38:35.680592 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:38:35.680592 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:38:35.680592 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:38:35.681486 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:38:35.681486 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:38:35.681486 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:38:35.681486 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:38:35.681486 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:38:35.681486 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:38:35.681486 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:38:35.681486 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:38:35.681486 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:38:35.681486 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:38:35.681486 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:38:35.681486 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:38:35.681486 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 621/1235] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Jun 22 08:38:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:38:35.687444 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807beeec-b403-48b9-98ce-91083ca165e8 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:35.745671 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:38:35.816842 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807beeec-b403-48b9-98ce-91083ca165e8 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:35.866441 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e3a244-1af2-4d92-8858-0b3186e90a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:35.867444 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e3a244-1af2-4d92-8858-0b3186e90a0a None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:35.867937 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e3a244-1af2-4d92-8858-0b3186e90a0a None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:35.868373 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e3a244-1af2-4d92-8858-0b3186e90a0a None admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:35.869270 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e3a244-1af2-4d92-8858-0b3186e90a0a None admin] RBAC: Adding query filter params (name=service) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:38:35.869681 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e3a244-1af2-4d92-8858-0b3186e90a0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:35.871284 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e3a244-1af2-4d92-8858-0b3186e90a0a None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:35.880930 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 615/1236] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Jun 22 08:38:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:38:35.888890 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc0dfe-8c42-45c2-98a8-284e889c8b81 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:36.015884 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:38:36.049410 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc0dfe-8c42-45c2-98a8-284e889c8b81 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:36.099599 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89bea6f-9f31-4fbf-bf45-83d0e53d24b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:36.101425 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89bea6f-9f31-4fbf-bf45-83d0e53d24b8 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:36.101859 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89bea6f-9f31-4fbf-bf45-83d0e53d24b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:36.102279 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89bea6f-9f31-4fbf-bf45-83d0e53d24b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:36.117556 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89bea6f-9f31-4fbf-bf45-83d0e53d24b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:36.119160 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89bea6f-9f31-4fbf-bf45-83d0e53d24b8 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:36.144472 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-c89bea6f-9f31-4fbf-bf45-83d0e53d24b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:38:36.144472 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:38:36.144472 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:38:36.144472 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:38:36.144472 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:38:36.144472 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:38:36.144472 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:38:36.144472 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:38:36.144472 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:38:36.144472 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:38:36.144472 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:38:36.144472 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:38:36.144472 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:38:36.144472 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:38:36.144472 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:38:36.145713 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:38:36.145713 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:38:36.145713 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:38:36.145713 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:38:36.145713 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:38:36.145713 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:38:36.145713 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:38:36.145713 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:38:36.145713 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:38:36.145713 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:38:36.145713 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:38:36.145713 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:38:36.145713 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:38:36.145713 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:38:36.145713 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:38:36.145713 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:38:36.145713 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:38:36.147518 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:38:36.147518 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:38:36.147518 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:38:36.147518 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:38:36.147518 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 622/1237] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:38:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:38:36.156661 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e3a244-1af2-4d92-8858-0b3186e90a0a None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:36.313304 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e3a244-1af2-4d92-8858-0b3186e90a0a None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:36.324697 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:38:36.366197 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09153e8-7331-4d8f-9365-1a5cc4ab99d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:36.367244 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09153e8-7331-4d8f-9365-1a5cc4ab99d3 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:36.367411 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09153e8-7331-4d8f-9365-1a5cc4ab99d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:36.367793 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09153e8-7331-4d8f-9365-1a5cc4ab99d3 None admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:36.368690 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09153e8-7331-4d8f-9365-1a5cc4ab99d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:38:36.369093 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09153e8-7331-4d8f-9365-1a5cc4ab99d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:36.370709 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09153e8-7331-4d8f-9365-1a5cc4ab99d3 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:36.389086 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 616/1238] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:38:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:38:36.396396 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89bea6f-9f31-4fbf-bf45-83d0e53d24b8 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:36.547715 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89bea6f-9f31-4fbf-bf45-83d0e53d24b8 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:36.587781 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c5b3b4-df0d-4d35-a23e-a1450530d743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:36.588601 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5b3b4-df0d-4d35-a23e-a1450530d743 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:36.588888 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5b3b4-df0d-4d35-a23e-a1450530d743 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:36.589169 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5b3b4-df0d-4d35-a23e-a1450530d743 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:36.592490 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:38:36.599972 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c5b3b4-df0d-4d35-a23e-a1450530d743 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:36.602956 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c5b3b4-df0d-4d35-a23e-a1450530d743 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:36.633016 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-b2c5b3b4-df0d-4d35-a23e-a1450530d743 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 22 08:38:36.633016 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:38:36.633016 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:38:36.633016 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:38:36.633016 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:38:36.633016 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:38:36.633016 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:38:36.633016 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:38:36.633016 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:38:36.633016 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:38:36.633016 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:38:36.633016 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:38:36.633016 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:38:36.633016 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:38:36.633016 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:38:36.633016 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:38:36.634327 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:38:36.634327 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:38:36.634327 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:38:36.634327 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:38:36.634327 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:38:36.634327 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:38:36.634327 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:38:36.634327 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:38:36.634327 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:38:36.634327 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:38:36.634327 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:38:36.634327 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:38:36.634327 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:38:36.634327 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:38:36.634327 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:38:36.634327 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:38:36.634327 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:38:36.634327 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:38:36.635583 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:38:36.635583 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:38:36.635583 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:38:36.635583 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:38:36.635583 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:38:36.635583 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:38:36.635583 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:38:36.635583 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:38:36.635583 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 22 08:38:36.635583 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:38:36.635583 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 623/1239] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:38:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:38:36.641463 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09153e8-7331-4d8f-9365-1a5cc4ab99d3 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:36.754027 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09153e8-7331-4d8f-9365-1a5cc4ab99d3 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:36.801108 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b18da49-9f0b-4a76-9937-c059e44a8c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:36.801792 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18da49-9f0b-4a76-9937-c059e44a8c71 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:36.802084 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18da49-9f0b-4a76-9937-c059e44a8c71 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:36.802384 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18da49-9f0b-4a76-9937-c059e44a8c71 None admin] PATH_INFO: `/v3/users` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:36.803807 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b18da49-9f0b-4a76-9937-c059e44a8c71 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:38:36.804140 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b18da49-9f0b-4a76-9937-c059e44a8c71 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:36.805597 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b18da49-9f0b-4a76-9937-c059e44a8c71 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:36.826579 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 617/1240] 10.222.0.42 () {56 vars in 1143 bytes} [Wed Jun 22 08:38:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:38:36.834231 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c5b3b4-df0d-4d35-a23e-a1450530d743 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:36.957236 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c5b3b4-df0d-4d35-a23e-a1450530d743 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:37.000026 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f62a85-f5fa-4f29-b58b-641276bdb0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:37.000857 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f62a85-f5fa-4f29-b58b-641276bdb0ef None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:37.001273 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f62a85-f5fa-4f29-b58b-641276bdb0ef None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:37.001655 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f62a85-f5fa-4f29-b58b-641276bdb0ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:37.093968 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:38:37.106627 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f62a85-f5fa-4f29-b58b-641276bdb0ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:37.108736 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f62a85-f5fa-4f29-b58b-641276bdb0ef None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:37.234388 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 624/1241] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Jun 22 08:38:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 22 08:38:37.241171 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b18da49-9f0b-4a76-9937-c059e44a8c71 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:37.273261 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:38:37.360915 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b18da49-9f0b-4a76-9937-c059e44a8c71 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:37.404043 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566a8d84-502b-4ef1-acd2-80766ab40b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:37.404935 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a8d84-502b-4ef1-acd2-80766ab40b2d None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:37.405095 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a8d84-502b-4ef1-acd2-80766ab40b2d None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:37.405419 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a8d84-502b-4ef1-acd2-80766ab40b2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:37.417696 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566a8d84-502b-4ef1-acd2-80766ab40b2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:37.419189 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566a8d84-502b-4ef1-acd2-80766ab40b2d None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:37.441131 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-566a8d84-502b-4ef1-acd2-80766ab40b2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:38:37.441131 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:38:37.441131 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:38:37.441131 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:38:37.441131 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:38:37.441131 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:38:37.441131 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:38:37.441131 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:38:37.441131 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:38:37.441131 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:38:37.441131 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:38:37.441131 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:38:37.441131 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:38:37.441131 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:38:37.441131 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:38:37.443149 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:38:37.443149 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:38:37.443149 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:38:37.443149 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:38:37.443149 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:38:37.443149 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:38:37.443149 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:38:37.443149 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:38:37.443149 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:38:37.443149 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:38:37.443149 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:38:37.443149 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:38:37.443149 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:38:37.443149 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:38:37.443149 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:38:37.443149 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:38:37.443149 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:38:37.446318 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:38:37.446318 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:38:37.446318 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:38:37.446318 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:38:37.446318 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 618/1242] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:38:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:38:37.449255 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f62a85-f5fa-4f29-b58b-641276bdb0ef None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:37.597515 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:38:37.606027 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f62a85-f5fa-4f29-b58b-641276bdb0ef None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:37.656888 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f9fd5-66bb-4398-97c1-4bb83f1f9772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:37.657832 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f9fd5-66bb-4398-97c1-4bb83f1f9772 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:37.658471 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f9fd5-66bb-4398-97c1-4bb83f1f9772 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:37.658838 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f9fd5-66bb-4398-97c1-4bb83f1f9772 None admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:37.659968 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43f9fd5-66bb-4398-97c1-4bb83f1f9772 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:38:37.660383 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43f9fd5-66bb-4398-97c1-4bb83f1f9772 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:37.662908 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43f9fd5-66bb-4398-97c1-4bb83f1f9772 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:37.680189 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 625/1243] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:38:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:38:37.688519 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566a8d84-502b-4ef1-acd2-80766ab40b2d None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:37.810496 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:38:37.833087 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566a8d84-502b-4ef1-acd2-80766ab40b2d None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:37.871621 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5114e3-6c5c-4714-b321-6b0e15d01fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:37.872514 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5114e3-6c5c-4714-b321-6b0e15d01fbc None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:37.872803 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5114e3-6c5c-4714-b321-6b0e15d01fbc None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:37.873133 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5114e3-6c5c-4714-b321-6b0e15d01fbc None admin] PATH_INFO: `/v3/projects/service` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:37.883457 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5114e3-6c5c-4714-b321-6b0e15d01fbc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:37.886042 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5114e3-6c5c-4714-b321-6b0e15d01fbc None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:37.908153 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-1a5114e3-6c5c-4714-b321-6b0e15d01fbc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:38:37.908153 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:38:37.908153 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:38:37.908153 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:38:37.908153 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:38:37.908153 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:38:37.908153 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:38:37.908153 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:38:37.908153 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:38:37.908153 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:38:37.908153 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:38:37.908153 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:38:37.908153 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:38:37.908153 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:38:37.908153 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:38:37.909985 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:38:37.909985 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:38:37.909985 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:38:37.909985 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:38:37.909985 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:38:37.909985 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:38:37.909985 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:38:37.909985 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:38:37.909985 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:38:37.909985 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:38:37.909985 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:38:37.909985 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:38:37.909985 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:38:37.909985 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:38:37.909985 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:38:37.909985 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:38:37.909985 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:38:37.911843 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:38:37.911843 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:38:37.911843 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:38:37.911843 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:38:37.911843 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:38:37.911843 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:38:37.911843 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:38:37.911843 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:38:37.911843 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 619/1244] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Jun 22 08:38:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:38:37.917930 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f9fd5-66bb-4398-97c1-4bb83f1f9772 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:38.044957 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f9fd5-66bb-4398-97c1-4bb83f1f9772 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:38.087981 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb42f9f-4b4c-4fd4-855e-620f404cdfb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:38.088662 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb42f9f-4b4c-4fd4-855e-620f404cdfb6 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:38.088948 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb42f9f-4b4c-4fd4-855e-620f404cdfb6 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:38.089226 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb42f9f-4b4c-4fd4-855e-620f404cdfb6 None admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:38.090040 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb42f9f-4b4c-4fd4-855e-620f404cdfb6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:38:38.090385 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb42f9f-4b4c-4fd4-855e-620f404cdfb6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:38.091991 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb42f9f-4b4c-4fd4-855e-620f404cdfb6 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:38.107045 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 626/1245] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Jun 22 08:38:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:38:38.114318 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5114e3-6c5c-4714-b321-6b0e15d01fbc None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:38.258417 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5114e3-6c5c-4714-b321-6b0e15d01fbc None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:38.305736 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917cef0f-4612-4ebe-a956-7bad158effc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:38.306634 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917cef0f-4612-4ebe-a956-7bad158effc7 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:38.307019 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917cef0f-4612-4ebe-a956-7bad158effc7 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:38.307452 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917cef0f-4612-4ebe-a956-7bad158effc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:38.308574 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917cef0f-4612-4ebe-a956-7bad158effc7 None admin] RBAC: Adding query filter params (role.id=e67c237283fd404d9a2bdf1333109696, scope.project.id=e1f161193cb440fa8c4a9d23820a5c28, user.id=ec2627e3cdc94ec38d7cc3b1bc670ef1) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:38:38.309073 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917cef0f-4612-4ebe-a956-7bad158effc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:38.310848 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917cef0f-4612-4ebe-a956-7bad158effc7 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:38.319588 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 620/1246] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Jun 22 08:38:38 2022] GET /identity/v3/role_assignments?user.id=ec2627e3cdc94ec38d7cc3b1bc670ef1&scope.project.id=e1f161193cb440fa8c4a9d23820a5c28&role.id=e67c237283fd404d9a2bdf1333109696 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:38:40.657750 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e21725-091a-413f-91b0-05016cddb465 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:40.658525 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e21725-091a-413f-91b0-05016cddb465 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:40.658525 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e21725-091a-413f-91b0-05016cddb465 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:40.659876 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 627/1247] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:38:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:38:40.665635 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e558e0-fe12-4866-ade0-0faa5f3b25fe None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:40.666386 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e558e0-fe12-4866-ade0-0faa5f3b25fe None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:40.666386 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e558e0-fe12-4866-ade0-0faa5f3b25fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:40.671667 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:38:40.685827 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-14e558e0-fe12-4866-ade0-0faa5f3b25fe None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:38:40.687086 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-14e558e0-fe12-4866-ade0-0faa5f3b25fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:38:40.770115 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 621/1248] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:38:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:38:40.799573 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e21725-091a-413f-91b0-05016cddb465 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:40.822019 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:38:40.937598 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e21725-091a-413f-91b0-05016cddb465 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:40.981683 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956d16ed-fcd4-4a7d-83d0-9d74b2a07d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:40.982790 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d16ed-fcd4-4a7d-83d0-9d74b2a07d67 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:40.983150 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d16ed-fcd4-4a7d-83d0-9d74b2a07d67 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:40.983536 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d16ed-fcd4-4a7d-83d0-9d74b2a07d67 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:40.998227 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956d16ed-fcd4-4a7d-83d0-9d74b2a07d67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:38:41.008792 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-956d16ed-fcd4-4a7d-83d0-9d74b2a07d67 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:38:41.008792 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:38:41.008792 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:38:41.008792 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:38:41.008792 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:38:41.008792 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:38:41.008792 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:38:41.008792 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:38:41.008792 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:38:41.008792 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:38:41.008792 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:38:41.008792 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:38:41.008792 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:38:41.008792 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:38:41.008792 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:38:41.008792 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:38:41.010646 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:38:41.010646 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:38:41.010646 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:38:41.010646 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:38:41.010646 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:38:41.010646 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:38:41.010646 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:38:41.010646 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:38:41.010646 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:38:41.010646 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:38:41.010646 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:38:41.010646 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:38:41.010646 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:38:41.010646 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:38:41.010646 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:38:41.010646 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:38:41.012353 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:38:41.012353 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:38:41.012353 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:38:41.012353 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:38:41.012353 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:38:41.012353 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:38:41.012353 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:38:41.012353 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:38:41.012353 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:38:41.012353 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:38:41.012353 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:38:41.012353 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:38:41.012353 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 628/1249] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Jun 22 08:38:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:38:41.021390 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e558e0-fe12-4866-ade0-0faa5f3b25fe None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:41.143197 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e558e0-fe12-4866-ade0-0faa5f3b25fe None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:41.183665 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:38:41.191705 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe01d51-8554-4241-9afa-1300ce71fc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:41.192555 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe01d51-8554-4241-9afa-1300ce71fc9d None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:41.192851 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe01d51-8554-4241-9afa-1300ce71fc9d None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:41.193134 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe01d51-8554-4241-9afa-1300ce71fc9d None admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:41.193952 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe01d51-8554-4241-9afa-1300ce71fc9d None admin] RBAC: Adding query filter params (name=admin) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:38:41.194336 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe01d51-8554-4241-9afa-1300ce71fc9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:41.196226 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe01d51-8554-4241-9afa-1300ce71fc9d None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:41.207813 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 622/1250] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Jun 22 08:38:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:38:41.216726 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956d16ed-fcd4-4a7d-83d0-9d74b2a07d67 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:41.316619 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:38:41.349102 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956d16ed-fcd4-4a7d-83d0-9d74b2a07d67 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:41.389263 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a012b1b7-95f6-425b-9e39-d79877ab1072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:41.390470 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a012b1b7-95f6-425b-9e39-d79877ab1072 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:41.390755 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a012b1b7-95f6-425b-9e39-d79877ab1072 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:41.391035 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a012b1b7-95f6-425b-9e39-d79877ab1072 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:41.404838 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a012b1b7-95f6-425b-9e39-d79877ab1072 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:41.406347 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a012b1b7-95f6-425b-9e39-d79877ab1072 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:41.426378 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-a012b1b7-95f6-425b-9e39-d79877ab1072 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:38:41.426378 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:38:41.426378 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:38:41.426378 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:38:41.426378 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:38:41.426378 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:38:41.426378 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:38:41.426378 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:38:41.426378 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:38:41.426378 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:38:41.426378 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:38:41.426378 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:38:41.426378 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:38:41.426378 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:38:41.426378 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:38:41.428395 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:38:41.428395 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:38:41.428395 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:38:41.428395 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:38:41.428395 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:38:41.428395 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:38:41.428395 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:38:41.428395 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:38:41.428395 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:38:41.428395 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:38:41.428395 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:38:41.428395 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:38:41.428395 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:38:41.428395 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:38:41.428395 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:38:41.428395 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:38:41.428395 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:38:41.429292 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:38:41.429292 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:38:41.429292 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:38:41.429292 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:38:41.429292 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 629/1251] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:38:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:38:41.435159 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe01d51-8554-4241-9afa-1300ce71fc9d None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:41.561390 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe01d51-8554-4241-9afa-1300ce71fc9d None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:41.604757 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffe7eb3-0213-4755-b0c9-a7294f79db63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:41.605545 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe7eb3-0213-4755-b0c9-a7294f79db63 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:41.605863 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe7eb3-0213-4755-b0c9-a7294f79db63 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:41.606134 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe7eb3-0213-4755-b0c9-a7294f79db63 None admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:41.607011 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffe7eb3-0213-4755-b0c9-a7294f79db63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:38:41.607327 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffe7eb3-0213-4755-b0c9-a7294f79db63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:41.608709 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffe7eb3-0213-4755-b0c9-a7294f79db63 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:41.623586 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 623/1252] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:38:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:38:41.630161 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a012b1b7-95f6-425b-9e39-d79877ab1072 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:41.767792 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a012b1b7-95f6-425b-9e39-d79877ab1072 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:41.795283 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:38:41.804911 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db89135-11cc-43e0-95b2-3abd0f0b981f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:41.806137 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db89135-11cc-43e0-95b2-3abd0f0b981f None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:41.806656 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db89135-11cc-43e0-95b2-3abd0f0b981f None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:41.807043 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db89135-11cc-43e0-95b2-3abd0f0b981f None admin] PATH_INFO: `/v3/users/placement` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:41.815920 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db89135-11cc-43e0-95b2-3abd0f0b981f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:41.817615 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db89135-11cc-43e0-95b2-3abd0f0b981f None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:41.835763 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-7db89135-11cc-43e0-95b2-3abd0f0b981f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 22 08:38:41.835763 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:38:41.835763 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:38:41.835763 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:38:41.835763 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:38:41.835763 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:38:41.835763 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:38:41.835763 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:38:41.835763 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:38:41.835763 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:38:41.835763 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:38:41.835763 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:38:41.835763 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:38:41.835763 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:38:41.835763 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:38:41.835763 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:38:41.836834 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:38:41.836834 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:38:41.836834 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:38:41.836834 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:38:41.836834 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:38:41.836834 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:38:41.836834 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:38:41.836834 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:38:41.836834 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:38:41.836834 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:38:41.836834 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:38:41.836834 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:38:41.836834 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:38:41.836834 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:38:41.836834 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:38:41.836834 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:38:41.836834 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:38:41.836834 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:38:41.837788 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:38:41.837788 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:38:41.837788 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:38:41.837788 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:38:41.837788 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:38:41.837788 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:38:41.837788 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:38:41.837788 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:38:41.837788 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 22 08:38:41.837788 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:38:41.837788 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 630/1253] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:38:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:38:41.845508 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffe7eb3-0213-4755-b0c9-a7294f79db63 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:41.928851 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:38:42.003495 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffe7eb3-0213-4755-b0c9-a7294f79db63 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:42.054906 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668989cb-16ce-4f71-8088-5c476e998bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:42.055857 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668989cb-16ce-4f71-8088-5c476e998bab None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:42.056211 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668989cb-16ce-4f71-8088-5c476e998bab None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:42.056564 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668989cb-16ce-4f71-8088-5c476e998bab None admin] PATH_INFO: `/v3/users` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:42.057665 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668989cb-16ce-4f71-8088-5c476e998bab None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:38:42.058137 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668989cb-16ce-4f71-8088-5c476e998bab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:42.059876 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668989cb-16ce-4f71-8088-5c476e998bab None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:42.082952 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 624/1254] 10.222.0.42 () {56 vars in 1143 bytes} [Wed Jun 22 08:38:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:38:42.089595 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db89135-11cc-43e0-95b2-3abd0f0b981f None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:42.212234 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db89135-11cc-43e0-95b2-3abd0f0b981f None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:42.263133 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab3a6f6-174d-4342-bca7-e4c6e018f5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:42.264024 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3a6f6-174d-4342-bca7-e4c6e018f5e1 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:42.264677 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3a6f6-174d-4342-bca7-e4c6e018f5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:42.264961 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3a6f6-174d-4342-bca7-e4c6e018f5e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:42.347537 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:38:42.366773 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab3a6f6-174d-4342-bca7-e4c6e018f5e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:42.368450 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab3a6f6-174d-4342-bca7-e4c6e018f5e1 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:42.527442 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 631/1255] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Jun 22 08:38:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 08:38:42.535591 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668989cb-16ce-4f71-8088-5c476e998bab None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:42.670308 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668989cb-16ce-4f71-8088-5c476e998bab None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:42.691294 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:38:42.730756 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca90bb59-b60f-45bd-b3bd-990d9d6e49ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:42.731680 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90bb59-b60f-45bd-b3bd-990d9d6e49ac None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:42.732020 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90bb59-b60f-45bd-b3bd-990d9d6e49ac None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:42.732352 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90bb59-b60f-45bd-b3bd-990d9d6e49ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:42.748305 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca90bb59-b60f-45bd-b3bd-990d9d6e49ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:42.749852 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca90bb59-b60f-45bd-b3bd-990d9d6e49ac None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:42.769456 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-ca90bb59-b60f-45bd-b3bd-990d9d6e49ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:38:42.769456 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:38:42.769456 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:38:42.769456 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:38:42.769456 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:38:42.769456 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:38:42.769456 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:38:42.769456 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:38:42.769456 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:38:42.769456 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:38:42.769456 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:38:42.769456 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:38:42.769456 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:38:42.769456 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:38:42.769456 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:38:42.771961 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:38:42.771961 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:38:42.771961 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:38:42.771961 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:38:42.771961 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:38:42.771961 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:38:42.771961 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:38:42.771961 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:38:42.771961 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:38:42.771961 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:38:42.771961 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:38:42.771961 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:38:42.771961 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:38:42.771961 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:38:42.771961 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:38:42.771961 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:38:42.771961 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:38:42.773841 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:38:42.773841 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:38:42.773841 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:38:42.773841 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:38:42.773841 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 625/1256] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:38:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:38:42.777506 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab3a6f6-174d-4342-bca7-e4c6e018f5e1 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:42.899426 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:38:42.915419 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab3a6f6-174d-4342-bca7-e4c6e018f5e1 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:42.956907 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ee2623-24f3-4229-b859-b0f8e14c4039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:42.957555 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee2623-24f3-4229-b859-b0f8e14c4039 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:42.957861 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee2623-24f3-4229-b859-b0f8e14c4039 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:42.958204 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee2623-24f3-4229-b859-b0f8e14c4039 None admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:42.959087 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ee2623-24f3-4229-b859-b0f8e14c4039 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:38:42.959536 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ee2623-24f3-4229-b859-b0f8e14c4039 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:42.961373 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ee2623-24f3-4229-b859-b0f8e14c4039 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:42.976468 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 632/1257] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:38:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:38:42.982612 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca90bb59-b60f-45bd-b3bd-990d9d6e49ac None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:43.117926 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca90bb59-b60f-45bd-b3bd-990d9d6e49ac None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:43.166580 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14412fc8-e9d5-4934-b20b-c42b17594769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:43.167926 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14412fc8-e9d5-4934-b20b-c42b17594769 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:43.168215 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14412fc8-e9d5-4934-b20b-c42b17594769 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:43.168537 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14412fc8-e9d5-4934-b20b-c42b17594769 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:43.179444 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14412fc8-e9d5-4934-b20b-c42b17594769 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:43.183669 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14412fc8-e9d5-4934-b20b-c42b17594769 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:43.202845 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-14412fc8-e9d5-4934-b20b-c42b17594769 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:38:43.202845 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:38:43.202845 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:38:43.202845 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:38:43.202845 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:38:43.202845 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:38:43.202845 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:38:43.202845 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:38:43.202845 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:38:43.202845 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:38:43.202845 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:38:43.202845 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:38:43.202845 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:38:43.202845 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:38:43.202845 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:38:43.204536 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:38:43.204536 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:38:43.204536 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:38:43.204536 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:38:43.204536 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:38:43.204536 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:38:43.204536 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:38:43.204536 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:38:43.204536 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:38:43.204536 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:38:43.204536 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:38:43.204536 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:38:43.204536 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:38:43.204536 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:38:43.204536 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:38:43.204536 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:38:43.204536 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:38:43.205960 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:38:43.205960 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:38:43.205960 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:38:43.205960 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:38:43.205960 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:38:43.205960 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:38:43.205960 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:38:43.205960 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:38:43.205960 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 626/1258] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Jun 22 08:38:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:38:43.211223 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ee2623-24f3-4229-b859-b0f8e14c4039 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:43.344886 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ee2623-24f3-4229-b859-b0f8e14c4039 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:43.383280 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ef035-21d3-4ff8-b4f4-d7b1c96b3e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:43.384009 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ef035-21d3-4ff8-b4f4-d7b1c96b3e38 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:43.384325 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ef035-21d3-4ff8-b4f4-d7b1c96b3e38 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:43.384599 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ef035-21d3-4ff8-b4f4-d7b1c96b3e38 None admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:43.385429 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74ef035-21d3-4ff8-b4f4-d7b1c96b3e38 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:38:43.385793 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74ef035-21d3-4ff8-b4f4-d7b1c96b3e38 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:43.387419 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74ef035-21d3-4ff8-b4f4-d7b1c96b3e38 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:43.407414 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 633/1259] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Jun 22 08:38:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:38:43.408725 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14412fc8-e9d5-4934-b20b-c42b17594769 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:43.438622 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:38:43.574456 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14412fc8-e9d5-4934-b20b-c42b17594769 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:43.620538 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f8132-7047-485e-a41b-00842d7392d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:43.621303 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f8132-7047-485e-a41b-00842d7392d0 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:43.621587 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f8132-7047-485e-a41b-00842d7392d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:43.621867 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f8132-7047-485e-a41b-00842d7392d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:43.622780 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8f8132-7047-485e-a41b-00842d7392d0 None admin] RBAC: Adding query filter params (role.id=c7518e0f532945af80c33860f2ac506d, scope.project.id=e1f161193cb440fa8c4a9d23820a5c28, user.id=ec2627e3cdc94ec38d7cc3b1bc670ef1) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:38:43.623091 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8f8132-7047-485e-a41b-00842d7392d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:43.624640 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8f8132-7047-485e-a41b-00842d7392d0 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:43.632537 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 627/1260] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Jun 22 08:38:43 2022] GET /identity/v3/role_assignments?user.id=ec2627e3cdc94ec38d7cc3b1bc670ef1&scope.project.id=e1f161193cb440fa8c4a9d23820a5c28&role.id=c7518e0f532945af80c33860f2ac506d => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:38:45.826858 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449a941-5908-44fc-9f48-a9bf9d4abdc1 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:45.827529 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449a941-5908-44fc-9f48-a9bf9d4abdc1 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:45.827529 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449a941-5908-44fc-9f48-a9bf9d4abdc1 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:45.828785 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 634/1261] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:38:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:38:45.835131 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4dedc4-e42b-4a83-a786-b33ebf99f75b None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:45.835634 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4dedc4-e42b-4a83-a786-b33ebf99f75b None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:45.835742 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4dedc4-e42b-4a83-a786-b33ebf99f75b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:45.853635 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-cf4dedc4-e42b-4a83-a786-b33ebf99f75b None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:38:45.854929 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-cf4dedc4-e42b-4a83-a786-b33ebf99f75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:38:45.922810 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 628/1262] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:38:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:38:45.946988 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8449a941-5908-44fc-9f48-a9bf9d4abdc1 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:45.961750 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:38:46.073675 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8449a941-5908-44fc-9f48-a9bf9d4abdc1 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:46.109127 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb14e2-8e2e-4152-bc95-976fcf8080c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:46.109837 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb14e2-8e2e-4152-bc95-976fcf8080c6 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:46.110145 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb14e2-8e2e-4152-bc95-976fcf8080c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:46.110423 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb14e2-8e2e-4152-bc95-976fcf8080c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:46.121226 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feb14e2-8e2e-4152-bc95-976fcf8080c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:38:46.128925 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-3feb14e2-8e2e-4152-bc95-976fcf8080c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:38:46.128925 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:38:46.128925 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:38:46.128925 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:38:46.128925 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:38:46.128925 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:38:46.128925 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:38:46.128925 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:38:46.128925 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:38:46.128925 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:38:46.128925 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:38:46.128925 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:38:46.128925 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:38:46.128925 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:38:46.128925 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:38:46.128925 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:38:46.130009 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:38:46.130009 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:38:46.130009 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:38:46.130009 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:38:46.130009 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:38:46.130009 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:38:46.130009 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:38:46.130009 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:38:46.130009 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:38:46.130009 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:38:46.130009 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:38:46.130009 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:38:46.130009 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:38:46.130009 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:38:46.130009 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:38:46.130009 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:38:46.131455 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:38:46.131455 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:38:46.131455 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:38:46.131455 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:38:46.131455 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:38:46.131455 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:38:46.131455 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:38:46.131455 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:38:46.131455 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:38:46.131455 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:38:46.131455 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:38:46.131455 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:38:46.131455 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 635/1263] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Jun 22 08:38:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:38:46.137090 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4dedc4-e42b-4a83-a786-b33ebf99f75b None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:46.155768 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:38:46.238175 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4dedc4-e42b-4a83-a786-b33ebf99f75b None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:46.275975 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb09e6-d8ed-4092-84c7-e6e95d62756a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:46.276653 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb09e6-d8ed-4092-84c7-e6e95d62756a None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:46.276937 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb09e6-d8ed-4092-84c7-e6e95d62756a None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:46.277214 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb09e6-d8ed-4092-84c7-e6e95d62756a None admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:46.277971 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cb09e6-d8ed-4092-84c7-e6e95d62756a None admin] RBAC: Adding query filter params (name=admin) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:38:46.278309 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cb09e6-d8ed-4092-84c7-e6e95d62756a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:46.279708 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cb09e6-d8ed-4092-84c7-e6e95d62756a None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:46.289662 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 629/1264] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Jun 22 08:38:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:38:46.296179 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb14e2-8e2e-4152-bc95-976fcf8080c6 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:46.397759 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:38:46.456757 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb14e2-8e2e-4152-bc95-976fcf8080c6 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:46.508484 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc71a97-a172-4d17-8ae2-51fd840600c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:46.509303 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc71a97-a172-4d17-8ae2-51fd840600c2 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:46.509585 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc71a97-a172-4d17-8ae2-51fd840600c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:46.509863 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc71a97-a172-4d17-8ae2-51fd840600c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:46.523465 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc71a97-a172-4d17-8ae2-51fd840600c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:46.524953 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc71a97-a172-4d17-8ae2-51fd840600c2 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:46.544451 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-9cc71a97-a172-4d17-8ae2-51fd840600c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:38:46.544451 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:38:46.544451 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:38:46.544451 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:38:46.544451 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:38:46.544451 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:38:46.544451 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:38:46.544451 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:38:46.544451 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:38:46.544451 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:38:46.544451 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:38:46.544451 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:38:46.544451 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:38:46.544451 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:38:46.544451 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:38:46.546289 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:38:46.546289 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:38:46.546289 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:38:46.546289 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:38:46.546289 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:38:46.546289 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:38:46.546289 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:38:46.546289 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:38:46.546289 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:38:46.546289 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:38:46.546289 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:38:46.546289 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:38:46.546289 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:38:46.546289 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:38:46.546289 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:38:46.546289 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:38:46.546289 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:38:46.547958 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:38:46.547958 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:38:46.547958 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:38:46.547958 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:38:46.547958 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 636/1265] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:38:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:38:46.552068 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb09e6-d8ed-4092-84c7-e6e95d62756a None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:46.646782 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:38:46.667635 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb09e6-d8ed-4092-84c7-e6e95d62756a None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:46.702968 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0768e687-afc0-45f2-91d7-3ebab596c711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:46.703630 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768e687-afc0-45f2-91d7-3ebab596c711 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:46.703914 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768e687-afc0-45f2-91d7-3ebab596c711 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:46.704191 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768e687-afc0-45f2-91d7-3ebab596c711 None admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:46.704917 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0768e687-afc0-45f2-91d7-3ebab596c711 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:38:46.705235 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0768e687-afc0-45f2-91d7-3ebab596c711 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:46.706629 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0768e687-afc0-45f2-91d7-3ebab596c711 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:46.719816 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 630/1266] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:38:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:38:46.726300 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc71a97-a172-4d17-8ae2-51fd840600c2 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:46.862769 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc71a97-a172-4d17-8ae2-51fd840600c2 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:46.883880 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:38:46.900098 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b6b97b-d6b0-4150-bfa5-3a741fd64d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:46.900913 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6b97b-d6b0-4150-bfa5-3a741fd64d5f None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:46.901199 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6b97b-d6b0-4150-bfa5-3a741fd64d5f None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:46.901479 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6b97b-d6b0-4150-bfa5-3a741fd64d5f None admin] PATH_INFO: `/v3/users/placement` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:46.909647 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b6b97b-d6b0-4150-bfa5-3a741fd64d5f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:46.911157 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b6b97b-d6b0-4150-bfa5-3a741fd64d5f None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:46.926583 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-c7b6b97b-d6b0-4150-bfa5-3a741fd64d5f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 22 08:38:46.926583 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:38:46.926583 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:38:46.926583 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:38:46.926583 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:38:46.926583 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:38:46.926583 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:38:46.926583 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:38:46.926583 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:38:46.926583 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:38:46.926583 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:38:46.926583 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:38:46.926583 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:38:46.926583 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:38:46.926583 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:38:46.926583 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:38:46.928199 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:38:46.928199 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:38:46.928199 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:38:46.928199 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:38:46.928199 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:38:46.928199 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:38:46.928199 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:38:46.928199 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:38:46.928199 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:38:46.928199 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:38:46.928199 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:38:46.928199 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:38:46.928199 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:38:46.928199 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:38:46.928199 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:38:46.928199 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:38:46.928199 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:38:46.928199 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:38:46.929124 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:38:46.929124 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:38:46.929124 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:38:46.929124 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:38:46.929124 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:38:46.929124 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:38:46.929124 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:38:46.929124 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:38:46.929124 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 22 08:38:46.929124 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:38:46.929124 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 637/1267] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:38:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:38:46.934212 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0768e687-afc0-45f2-91d7-3ebab596c711 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:47.051456 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0768e687-afc0-45f2-91d7-3ebab596c711 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:47.086709 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0f4897-50f8-43d3-b953-dad2d513b68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:47.087379 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f4897-50f8-43d3-b953-dad2d513b68f None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:47.087658 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f4897-50f8-43d3-b953-dad2d513b68f None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:47.087930 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f4897-50f8-43d3-b953-dad2d513b68f None admin] PATH_INFO: `/v3/users` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:47.088770 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0f4897-50f8-43d3-b953-dad2d513b68f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:38:47.089073 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0f4897-50f8-43d3-b953-dad2d513b68f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:47.090529 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0f4897-50f8-43d3-b953-dad2d513b68f None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:47.099941 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:38:47.109224 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 631/1268] 10.222.0.42 () {56 vars in 1143 bytes} [Wed Jun 22 08:38:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:38:47.115578 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b6b97b-d6b0-4150-bfa5-3a741fd64d5f None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:47.224774 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b6b97b-d6b0-4150-bfa5-3a741fd64d5f None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:47.261305 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d9bfb-5d27-4fdf-82b3-f79266c70992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:47.262141 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d9bfb-5d27-4fdf-82b3-f79266c70992 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:47.262430 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d9bfb-5d27-4fdf-82b3-f79266c70992 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:47.262709 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d9bfb-5d27-4fdf-82b3-f79266c70992 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:47.274272 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049d9bfb-5d27-4fdf-82b3-f79266c70992 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:47.275739 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049d9bfb-5d27-4fdf-82b3-f79266c70992 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:47.293006 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-049d9bfb-5d27-4fdf-82b3-f79266c70992 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:38:47.293006 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:38:47.293006 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:38:47.293006 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:38:47.293006 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:38:47.293006 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:38:47.293006 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:38:47.293006 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:38:47.293006 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:38:47.293006 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:38:47.293006 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:38:47.293006 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:38:47.293006 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:38:47.293006 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:38:47.293006 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:38:47.294228 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:38:47.294228 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:38:47.294228 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:38:47.294228 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:38:47.294228 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:38:47.294228 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:38:47.294228 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:38:47.294228 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:38:47.294228 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:38:47.294228 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:38:47.294228 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:38:47.294228 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:38:47.294228 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:38:47.294228 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:38:47.294228 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:38:47.294228 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:38:47.294228 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:38:47.295535 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:38:47.295535 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:38:47.295535 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:38:47.295535 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:38:47.295535 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 638/1269] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:38:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:38:47.300493 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0f4897-50f8-43d3-b953-dad2d513b68f None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:47.400743 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0f4897-50f8-43d3-b953-dad2d513b68f None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:47.435415 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0e4e7f-bed6-4025-8a0e-a5cdc9c945e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:47.436106 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e4e7f-bed6-4025-8a0e-a5cdc9c945e2 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:47.436390 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e4e7f-bed6-4025-8a0e-a5cdc9c945e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:47.436668 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e4e7f-bed6-4025-8a0e-a5cdc9c945e2 None admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:47.437434 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0e4e7f-bed6-4025-8a0e-a5cdc9c945e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:38:47.437742 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0e4e7f-bed6-4025-8a0e-a5cdc9c945e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:47.439204 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0e4e7f-bed6-4025-8a0e-a5cdc9c945e2 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:47.452228 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 632/1270] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:38:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:38:47.458025 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d9bfb-5d27-4fdf-82b3-f79266c70992 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:47.491221 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:38:47.561512 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d9bfb-5d27-4fdf-82b3-f79266c70992 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:47.595784 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78383b42-f2f3-4aba-b90b-5308a0dcddcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:47.596665 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78383b42-f2f3-4aba-b90b-5308a0dcddcb None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:47.597001 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78383b42-f2f3-4aba-b90b-5308a0dcddcb None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:47.597329 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78383b42-f2f3-4aba-b90b-5308a0dcddcb None admin] PATH_INFO: `/v3/projects/service` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:47.604465 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78383b42-f2f3-4aba-b90b-5308a0dcddcb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:47.605928 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78383b42-f2f3-4aba-b90b-5308a0dcddcb None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:47.620534 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-78383b42-f2f3-4aba-b90b-5308a0dcddcb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:38:47.620534 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:38:47.620534 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:38:47.620534 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:38:47.620534 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:38:47.620534 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:38:47.620534 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:38:47.620534 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:38:47.620534 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:38:47.620534 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:38:47.620534 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:38:47.620534 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:38:47.620534 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:38:47.620534 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:38:47.620534 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:38:47.622217 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:38:47.622217 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:38:47.622217 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:38:47.622217 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:38:47.622217 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:38:47.622217 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:38:47.622217 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:38:47.622217 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:38:47.622217 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:38:47.622217 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:38:47.622217 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:38:47.622217 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:38:47.622217 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:38:47.622217 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:38:47.622217 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:38:47.622217 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:38:47.622217 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:38:47.623586 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:38:47.623586 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:38:47.623586 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:38:47.623586 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:38:47.623586 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:38:47.623586 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:38:47.623586 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:38:47.623586 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:38:47.623586 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 639/1271] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Jun 22 08:38:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:38:47.627995 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0e4e7f-bed6-4025-8a0e-a5cdc9c945e2 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:47.699887 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:38:47.744687 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0e4e7f-bed6-4025-8a0e-a5cdc9c945e2 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:47.778638 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4724d06-7848-417a-877a-c699e6069306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:47.779293 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4724d06-7848-417a-877a-c699e6069306 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:47.779576 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4724d06-7848-417a-877a-c699e6069306 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:47.779851 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4724d06-7848-417a-877a-c699e6069306 None admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:47.780633 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4724d06-7848-417a-877a-c699e6069306 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:38:47.780940 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4724d06-7848-417a-877a-c699e6069306 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:47.782389 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4724d06-7848-417a-877a-c699e6069306 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:47.796038 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 633/1272] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Jun 22 08:38:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:38:47.803752 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78383b42-f2f3-4aba-b90b-5308a0dcddcb None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:47.906314 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:38:47.915375 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78383b42-f2f3-4aba-b90b-5308a0dcddcb None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:47.950683 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd7e9d3-7cdc-4de2-93e5-9a622873f22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:47.951569 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7e9d3-7cdc-4de2-93e5-9a622873f22b None admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:47.951850 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7e9d3-7cdc-4de2-93e5-9a622873f22b None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:47.952120 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7e9d3-7cdc-4de2-93e5-9a622873f22b None admin] PATH_INFO: `/v3/projects/e1f161193cb440fa8c4a9d23820a5c28/users/ec2627e3cdc94ec38d7cc3b1bc670ef1/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:47.954133 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd7e9d3-7cdc-4de2-93e5-9a622873f22b None admin] RBAC: Authorizing `identity:create_grant(project_id=e1f161193cb440fa8c4a9d23820a5c28, user_id=ec2627e3cdc94ec38d7cc3b1bc670ef1, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:47.955575 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd7e9d3-7cdc-4de2-93e5-9a622873f22b None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:47.972890 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 640/1273] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Jun 22 08:38:47 2022] PUT /identity/v3/projects/e1f161193cb440fa8c4a9d23820a5c28/users/ec2627e3cdc94ec38d7cc3b1bc670ef1/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:38:50.078107 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b7a02-a91c-4452-9724-e90cc6400c42 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:50.078713 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b7a02-a91c-4452-9724-e90cc6400c42 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:50.078713 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b7a02-a91c-4452-9724-e90cc6400c42 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:50.080082 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 634/1274] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:38:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:38:50.086002 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e76099-60e2-4458-a0e2-0cccce499ff0 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:50.086472 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e76099-60e2-4458-a0e2-0cccce499ff0 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:50.086589 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e76099-60e2-4458-a0e2-0cccce499ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:50.103800 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-c8e76099-60e2-4458-a0e2-0cccce499ff0 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:38:50.105043 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-c8e76099-60e2-4458-a0e2-0cccce499ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:38:50.174186 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 641/1275] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:38:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:38:50.197804 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8b7a02-a91c-4452-9724-e90cc6400c42 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:50.300929 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8b7a02-a91c-4452-9724-e90cc6400c42 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:50.319402 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:38:50.337206 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d66cc0-54dd-4176-84c2-365909bf2b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:50.337914 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d66cc0-54dd-4176-84c2-365909bf2b1d None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:50.338237 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d66cc0-54dd-4176-84c2-365909bf2b1d None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:50.338516 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d66cc0-54dd-4176-84c2-365909bf2b1d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:50.348774 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d66cc0-54dd-4176-84c2-365909bf2b1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:38:50.357190 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-70d66cc0-54dd-4176-84c2-365909bf2b1d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:38:50.357190 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:38:50.357190 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:38:50.357190 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:38:50.357190 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:38:50.357190 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:38:50.357190 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:38:50.357190 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:38:50.357190 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:38:50.357190 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:38:50.357190 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:38:50.357190 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:38:50.357190 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:38:50.357190 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:38:50.357190 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:38:50.357190 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:38:50.359067 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:38:50.359067 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:38:50.359067 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:38:50.359067 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:38:50.359067 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:38:50.359067 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:38:50.359067 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:38:50.359067 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:38:50.359067 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:38:50.359067 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:38:50.359067 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:38:50.359067 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:38:50.359067 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:38:50.359067 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:38:50.359067 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:38:50.359067 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:38:50.360712 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:38:50.360712 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:38:50.360712 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:38:50.360712 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:38:50.360712 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:38:50.360712 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:38:50.360712 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:38:50.360712 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:38:50.360712 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:38:50.360712 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:38:50.360712 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:38:50.360712 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:38:50.360712 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 635/1276] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Jun 22 08:38:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:38:50.365497 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e76099-60e2-4458-a0e2-0cccce499ff0 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:50.451446 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:38:50.471904 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e76099-60e2-4458-a0e2-0cccce499ff0 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:50.507586 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a58714c-9c63-4919-b006-4d04e700a4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:50.508275 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58714c-9c63-4919-b006-4d04e700a4b2 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:50.508553 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58714c-9c63-4919-b006-4d04e700a4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:50.508833 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58714c-9c63-4919-b006-4d04e700a4b2 None admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:50.509595 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a58714c-9c63-4919-b006-4d04e700a4b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:38:50.509903 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a58714c-9c63-4919-b006-4d04e700a4b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:50.511318 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a58714c-9c63-4919-b006-4d04e700a4b2 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:50.520109 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 642/1277] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Jun 22 08:38:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:38:50.526044 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d66cc0-54dd-4176-84c2-365909bf2b1d None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:50.639216 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d66cc0-54dd-4176-84c2-365909bf2b1d None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:50.672994 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271feee8-a4f4-4349-b009-6a83038ff52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:50.673787 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271feee8-a4f4-4349-b009-6a83038ff52b None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:50.674101 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271feee8-a4f4-4349-b009-6a83038ff52b None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:50.674386 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271feee8-a4f4-4349-b009-6a83038ff52b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:50.685960 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271feee8-a4f4-4349-b009-6a83038ff52b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:50.687880 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271feee8-a4f4-4349-b009-6a83038ff52b None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:50.708229 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-271feee8-a4f4-4349-b009-6a83038ff52b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:38:50.708229 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:38:50.708229 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:38:50.708229 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:38:50.708229 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:38:50.708229 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:38:50.708229 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:38:50.708229 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:38:50.708229 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:38:50.708229 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:38:50.708229 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:38:50.708229 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:38:50.708229 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:38:50.708229 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:38:50.708229 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:38:50.709892 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:38:50.709892 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:38:50.709892 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:38:50.709892 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:38:50.709892 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:38:50.709892 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:38:50.709892 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:38:50.709892 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:38:50.709892 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:38:50.709892 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:38:50.709892 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:38:50.709892 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:38:50.709892 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:38:50.709892 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:38:50.709892 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:38:50.709892 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:38:50.709892 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:38:50.711692 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:38:50.711692 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:38:50.711692 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:38:50.711692 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:38:50.711692 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 636/1278] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:38:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:38:50.716770 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a58714c-9c63-4919-b006-4d04e700a4b2 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:50.840862 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a58714c-9c63-4919-b006-4d04e700a4b2 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:50.878589 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7a9206-e6f2-466f-9917-bd7ff43a7252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:50.879262 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a9206-e6f2-466f-9917-bd7ff43a7252 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:50.879553 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a9206-e6f2-466f-9917-bd7ff43a7252 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:50.879838 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a9206-e6f2-466f-9917-bd7ff43a7252 None admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:50.881138 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7a9206-e6f2-466f-9917-bd7ff43a7252 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:38:50.881450 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7a9206-e6f2-466f-9917-bd7ff43a7252 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:50.882859 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7a9206-e6f2-466f-9917-bd7ff43a7252 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:50.896318 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 643/1279] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:38:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:38:50.902146 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271feee8-a4f4-4349-b009-6a83038ff52b None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:50.934270 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:38:51.009391 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271feee8-a4f4-4349-b009-6a83038ff52b None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:51.058622 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00168c99-9c69-4176-ba7d-7f7519a20fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:51.059431 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00168c99-9c69-4176-ba7d-7f7519a20fa8 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:51.059738 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00168c99-9c69-4176-ba7d-7f7519a20fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:51.060033 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00168c99-9c69-4176-ba7d-7f7519a20fa8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:51.068985 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00168c99-9c69-4176-ba7d-7f7519a20fa8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:51.070474 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00168c99-9c69-4176-ba7d-7f7519a20fa8 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:51.086252 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-00168c99-9c69-4176-ba7d-7f7519a20fa8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 22 08:38:51.086252 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:38:51.086252 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:38:51.086252 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:38:51.086252 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:38:51.086252 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:38:51.086252 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:38:51.086252 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:38:51.086252 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:38:51.086252 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:38:51.086252 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:38:51.086252 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:38:51.086252 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:38:51.086252 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:38:51.086252 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:38:51.086252 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:38:51.088478 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:38:51.088478 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:38:51.088478 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:38:51.088478 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:38:51.088478 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:38:51.088478 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:38:51.088478 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:38:51.088478 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:38:51.088478 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:38:51.088478 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:38:51.088478 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:38:51.088478 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:38:51.088478 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:38:51.088478 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:38:51.088478 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:38:51.088478 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:38:51.088478 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:38:51.088478 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:38:51.090336 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:38:51.090336 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:38:51.090336 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:38:51.090336 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:38:51.090336 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:38:51.090336 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:38:51.090336 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:38:51.090336 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:38:51.090336 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 22 08:38:51.090336 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:38:51.090336 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 637/1280] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:38:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:38:51.093515 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7a9206-e6f2-466f-9917-bd7ff43a7252 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:51.097578 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:38:51.199254 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7a9206-e6f2-466f-9917-bd7ff43a7252 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:51.235517 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5099d5b-8f82-41c0-9469-0afcfd9b264f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:51.236186 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5099d5b-8f82-41c0-9469-0afcfd9b264f None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:51.236466 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5099d5b-8f82-41c0-9469-0afcfd9b264f None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:51.236748 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5099d5b-8f82-41c0-9469-0afcfd9b264f None admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:51.237596 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5099d5b-8f82-41c0-9469-0afcfd9b264f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:38:51.237905 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5099d5b-8f82-41c0-9469-0afcfd9b264f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:51.239382 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5099d5b-8f82-41c0-9469-0afcfd9b264f None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:51.261388 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 644/1281] 10.222.0.42 () {56 vars in 1143 bytes} [Wed Jun 22 08:38:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:38:51.267837 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00168c99-9c69-4176-ba7d-7f7519a20fa8 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:51.362174 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:38:51.372981 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00168c99-9c69-4176-ba7d-7f7519a20fa8 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:51.408028 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73f2b40-efb2-447c-a5c8-adeec5192e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:51.408685 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f2b40-efb2-447c-a5c8-adeec5192e03 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:51.408971 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f2b40-efb2-447c-a5c8-adeec5192e03 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:51.409251 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f2b40-efb2-447c-a5c8-adeec5192e03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:51.481512 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73f2b40-efb2-447c-a5c8-adeec5192e03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:51.482911 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73f2b40-efb2-447c-a5c8-adeec5192e03 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:51.577809 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:38:51.588793 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 638/1282] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Jun 22 08:38:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 08:38:51.594600 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5099d5b-8f82-41c0-9469-0afcfd9b264f None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:51.657826 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:38:51.697753 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5099d5b-8f82-41c0-9469-0afcfd9b264f None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:51.732238 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e7f61f-49e4-4af4-be1f-c4791f51f80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:51.732926 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e7f61f-49e4-4af4-be1f-c4791f51f80d None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:51.733207 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e7f61f-49e4-4af4-be1f-c4791f51f80d None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:51.733481 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e7f61f-49e4-4af4-be1f-c4791f51f80d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:51.744846 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e7f61f-49e4-4af4-be1f-c4791f51f80d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:51.746359 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e7f61f-49e4-4af4-be1f-c4791f51f80d None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:51.765198 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-a7e7f61f-49e4-4af4-be1f-c4791f51f80d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:38:51.765198 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:38:51.765198 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:38:51.765198 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:38:51.765198 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:38:51.765198 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:38:51.765198 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:38:51.765198 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:38:51.765198 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:38:51.765198 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:38:51.765198 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:38:51.765198 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:38:51.765198 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:38:51.765198 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:38:51.765198 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:38:51.766382 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:38:51.766382 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:38:51.766382 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:38:51.766382 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:38:51.766382 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:38:51.766382 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:38:51.766382 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:38:51.766382 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:38:51.766382 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:38:51.766382 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:38:51.766382 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:38:51.766382 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:38:51.766382 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:38:51.766382 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:38:51.766382 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:38:51.766382 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:38:51.766382 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:38:51.767302 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:38:51.767302 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:38:51.767302 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:38:51.767302 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:38:51.767302 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 645/1283] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:38:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:38:51.772741 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73f2b40-efb2-447c-a5c8-adeec5192e03 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:51.876304 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73f2b40-efb2-447c-a5c8-adeec5192e03 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:51.914185 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a34f283-a6bc-480a-ade5-5ea0070a1b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:51.914851 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34f283-a6bc-480a-ade5-5ea0070a1b12 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:51.915136 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34f283-a6bc-480a-ade5-5ea0070a1b12 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:51.915413 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34f283-a6bc-480a-ade5-5ea0070a1b12 None admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:51.916140 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a34f283-a6bc-480a-ade5-5ea0070a1b12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:38:51.916446 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a34f283-a6bc-480a-ade5-5ea0070a1b12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:51.917806 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a34f283-a6bc-480a-ade5-5ea0070a1b12 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:51.930407 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 639/1284] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Jun 22 08:38:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:38:51.936159 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e7f61f-49e4-4af4-be1f-c4791f51f80d None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:52.041181 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e7f61f-49e4-4af4-be1f-c4791f51f80d None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:52.055800 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:38:52.077750 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd38e2e9-9711-405e-9121-3f57db231513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:52.078608 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd38e2e9-9711-405e-9121-3f57db231513 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:52.078889 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd38e2e9-9711-405e-9121-3f57db231513 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:52.079161 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd38e2e9-9711-405e-9121-3f57db231513 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:52.088215 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd38e2e9-9711-405e-9121-3f57db231513 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:52.089774 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd38e2e9-9711-405e-9121-3f57db231513 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:52.104315 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-fd38e2e9-9711-405e-9121-3f57db231513 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:38:52.104315 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:38:52.104315 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:38:52.104315 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:38:52.104315 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:38:52.104315 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:38:52.104315 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:38:52.104315 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:38:52.104315 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:38:52.104315 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:38:52.104315 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:38:52.104315 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:38:52.104315 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:38:52.104315 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:38:52.104315 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:38:52.105898 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:38:52.105898 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:38:52.105898 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:38:52.105898 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:38:52.105898 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:38:52.105898 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:38:52.105898 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:38:52.105898 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:38:52.105898 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 08:38:52.105898 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:38:52.105898 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:38:52.105898 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:38:52.105898 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:38:52.105898 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:38:52.105898 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:38:52.105898 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:38:52.105898 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:38:52.107062 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:38:52.107062 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:38:52.107062 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:38:52.107062 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:38:52.107062 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:38:52.107062 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:38:52.107062 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:38:52.107062 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 08:38:52.107062 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 646/1285] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Jun 22 08:38:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:38:52.111457 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a34f283-a6bc-480a-ade5-5ea0070a1b12 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:52.170738 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:38:52.225515 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a34f283-a6bc-480a-ade5-5ea0070a1b12 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:52.267785 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed779e7-5544-4e8f-aafc-14bce2391909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:52.268444 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed779e7-5544-4e8f-aafc-14bce2391909 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:52.268726 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed779e7-5544-4e8f-aafc-14bce2391909 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:52.269007 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed779e7-5544-4e8f-aafc-14bce2391909 None admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:52.269791 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed779e7-5544-4e8f-aafc-14bce2391909 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:38:52.270120 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed779e7-5544-4e8f-aafc-14bce2391909 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:52.272963 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed779e7-5544-4e8f-aafc-14bce2391909 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:52.285824 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 640/1286] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Jun 22 08:38:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:38:52.295876 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd38e2e9-9711-405e-9121-3f57db231513 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:52.399349 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd38e2e9-9711-405e-9121-3f57db231513 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:52.434357 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f10b61b-509b-4567-b43f-789d01f56226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:52.435003 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10b61b-509b-4567-b43f-789d01f56226 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:52.435287 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10b61b-509b-4567-b43f-789d01f56226 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:52.435566 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10b61b-509b-4567-b43f-789d01f56226 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:52.436412 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f10b61b-509b-4567-b43f-789d01f56226 None admin] RBAC: Adding query filter params (role.id=c7518e0f532945af80c33860f2ac506d, scope.project.id=e1f161193cb440fa8c4a9d23820a5c28, user.id=ec2627e3cdc94ec38d7cc3b1bc670ef1) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:38:52.436726 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f10b61b-509b-4567-b43f-789d01f56226 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:52.438192 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f10b61b-509b-4567-b43f-789d01f56226 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:52.445351 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 647/1287] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Jun 22 08:38:52 2022] GET /identity/v3/role_assignments?user.id=ec2627e3cdc94ec38d7cc3b1bc670ef1&scope.project.id=e1f161193cb440fa8c4a9d23820a5c28&role.id=c7518e0f532945af80c33860f2ac506d => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:38:54.544486 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a17eeb-5fcf-4611-a6f1-39add75c4366 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:54.545035 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a17eeb-5fcf-4611-a6f1-39add75c4366 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:54.545035 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a17eeb-5fcf-4611-a6f1-39add75c4366 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:54.546373 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 641/1288] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:38:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:38:54.551959 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48df671-5ebf-46ba-852a-c950aef4662a None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:54.552444 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48df671-5ebf-46ba-852a-c950aef4662a None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:54.552568 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48df671-5ebf-46ba-852a-c950aef4662a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:54.569156 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-e48df671-5ebf-46ba-852a-c950aef4662a None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:38:54.570411 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-e48df671-5ebf-46ba-852a-c950aef4662a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:38:54.601460 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:38:54.640717 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 648/1289] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:38:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:38:54.663126 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a17eeb-5fcf-4611-a6f1-39add75c4366 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:54.765474 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a17eeb-5fcf-4611-a6f1-39add75c4366 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:54.776905 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:38:54.800580 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb9be30-6dc5-4cf7-a23f-00707afb8c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:54.801297 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9be30-6dc5-4cf7-a23f-00707afb8c12 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:54.801582 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9be30-6dc5-4cf7-a23f-00707afb8c12 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:54.802493 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9be30-6dc5-4cf7-a23f-00707afb8c12 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:54.803150 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb9be30-6dc5-4cf7-a23f-00707afb8c12 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:54.804514 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb9be30-6dc5-4cf7-a23f-00707afb8c12 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:54.816333 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-afb9be30-6dc5-4cf7-a23f-00707afb8c12 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 08:38:54.816333 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:38:54.816333 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:38:54.816333 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:38:54.816333 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:38:54.816333 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:38:54.816333 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:38:54.816333 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:38:54.816333 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 08:38:54.816333 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:38:54.816333 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:38:54.816333 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:38:54.816333 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:38:54.816333 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:38:54.816333 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:38:54.816333 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:38:54.816333 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:38:54.818213 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:38:54.818213 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:38:54.818213 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:38:54.818213 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:38:54.818213 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:38:54.818213 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:38:54.818213 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:38:54.818213 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:38:54.818213 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:38:54.818213 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:38:54.818213 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:38:54.818213 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:38:54.818213 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:38:54.818213 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:38:54.818213 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:38:54.818213 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:38:54.819360 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:38:54.819360 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:38:54.819360 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:38:54.819360 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:38:54.819360 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:38:54.819360 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:38:54.819360 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:38:54.819360 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:38:54.819360 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:38:54.819360 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:38:54.819360 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:38:54.819360 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:38:54.819360 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 08:38:54.819360 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:38:54.819360 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 642/1290] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Jun 22 08:38:54 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:38:54.824888 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48df671-5ebf-46ba-852a-c950aef4662a None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:54.926706 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48df671-5ebf-46ba-852a-c950aef4662a None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:54.964515 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da763e24-e3d0-4d36-94a5-c5cb380e260a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:54.965188 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da763e24-e3d0-4d36-94a5-c5cb380e260a None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:54.965477 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da763e24-e3d0-4d36-94a5-c5cb380e260a None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:54.965759 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da763e24-e3d0-4d36-94a5-c5cb380e260a None admin] PATH_INFO: `/v3/services` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:54.966516 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da763e24-e3d0-4d36-94a5-c5cb380e260a None admin] RBAC: Adding query filter params (name=placement) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:38:54.966831 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da763e24-e3d0-4d36-94a5-c5cb380e260a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:54.968221 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da763e24-e3d0-4d36-94a5-c5cb380e260a None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:54.973468 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 649/1291] 10.222.0.42 () {56 vars in 1116 bytes} [Wed Jun 22 08:38:54 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:38:54.979578 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb9be30-6dc5-4cf7-a23f-00707afb8c12 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:55.103749 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb9be30-6dc5-4cf7-a23f-00707afb8c12 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:55.138321 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c3ac5-b013-4ba5-8e1e-756089ac603d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:55.139243 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c3ac5-b013-4ba5-8e1e-756089ac603d None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:55.139530 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c3ac5-b013-4ba5-8e1e-756089ac603d None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:55.139807 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c3ac5-b013-4ba5-8e1e-756089ac603d None admin] PATH_INFO: `/v3/services` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:55.140523 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89c3ac5-b013-4ba5-8e1e-756089ac603d None admin] RBAC: Adding query filter params (type=placement) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:38:55.140830 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89c3ac5-b013-4ba5-8e1e-756089ac603d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:55.142218 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89c3ac5-b013-4ba5-8e1e-756089ac603d None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:55.147424 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 643/1292] 10.222.0.42 () {56 vars in 1116 bytes} [Wed Jun 22 08:38:54 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:38:57.194185 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e552e9d0-805d-48c5-9194-c0a69db9d150 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:57.194759 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e552e9d0-805d-48c5-9194-c0a69db9d150 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:57.194759 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e552e9d0-805d-48c5-9194-c0a69db9d150 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:57.196118 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 650/1293] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:38:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:38:57.201575 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11915ed5-a1de-4887-bb79-4020b4c4b7fe None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:57.202031 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11915ed5-a1de-4887-bb79-4020b4c4b7fe None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:57.202179 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11915ed5-a1de-4887-bb79-4020b4c4b7fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:57.219720 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-11915ed5-a1de-4887-bb79-4020b4c4b7fe None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:38:57.220943 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-11915ed5-a1de-4887-bb79-4020b4c4b7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:38:57.250979 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:38:57.290974 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 644/1294] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:38:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:38:57.313648 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e552e9d0-805d-48c5-9194-c0a69db9d150 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:57.345859 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:38:57.420556 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e552e9d0-805d-48c5-9194-c0a69db9d150 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:57.461914 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ca3cc-8981-4890-8465-361c5a605742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:57.462539 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ca3cc-8981-4890-8465-361c5a605742 None admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:57.462826 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ca3cc-8981-4890-8465-361c5a605742 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:57.463102 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ca3cc-8981-4890-8465-361c5a605742 None admin] PATH_INFO: `/v3/services` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:57.463856 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23ca3cc-8981-4890-8465-361c5a605742 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:57.465279 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23ca3cc-8981-4890-8465-361c5a605742 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:57.480491 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 651/1295] 10.222.0.42 () {60 vars in 1141 bytes} [Wed Jun 22 08:38:57 2022] POST /identity/v3/services => generated 246 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:38:59.581989 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd1db0-4310-49e5-aeb8-47264190a2ad None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:59.582648 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd1db0-4310-49e5-aeb8-47264190a2ad None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:59.582648 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd1db0-4310-49e5-aeb8-47264190a2ad None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:59.583931 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 645/1296] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:38:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:38:59.590203 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c819d-fc23-4701-adb1-35c2d8f7fd5f None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:59.590699 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c819d-fc23-4701-adb1-35c2d8f7fd5f None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:59.590803 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c819d-fc23-4701-adb1-35c2d8f7fd5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:59.608564 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-ba1c819d-fc23-4701-adb1-35c2d8f7fd5f None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:38:59.610809 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-ba1c819d-fc23-4701-adb1-35c2d8f7fd5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:38:59.684171 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 652/1297] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:38:59 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 08:38:59.707556 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd1db0-4310-49e5-aeb8-47264190a2ad None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:59.815937 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd1db0-4310-49e5-aeb8-47264190a2ad None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:38:59.851326 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e05d5f9-3afd-4404-9df3-348be06a1386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:38:59.852040 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e05d5f9-3afd-4404-9df3-348be06a1386 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:38:59.852320 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e05d5f9-3afd-4404-9df3-348be06a1386 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:38:59.852590 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e05d5f9-3afd-4404-9df3-348be06a1386 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:38:59.853240 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e05d5f9-3afd-4404-9df3-348be06a1386 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:38:59.854639 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e05d5f9-3afd-4404-9df3-348be06a1386 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:38:59.867177 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-0e05d5f9-3afd-4404-9df3-348be06a1386 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 08:38:59.867177 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:38:59.867177 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:38:59.867177 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:38:59.867177 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:38:59.867177 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:38:59.867177 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:38:59.867177 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:38:59.867177 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 08:38:59.867177 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:38:59.867177 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:38:59.867177 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:38:59.867177 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:38:59.867177 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:38:59.867177 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:38:59.867177 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:38:59.867177 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:38:59.868437 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:38:59.868437 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:38:59.868437 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:38:59.868437 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:38:59.868437 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:38:59.868437 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:38:59.868437 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:38:59.868437 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:38:59.868437 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:38:59.868437 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:38:59.868437 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:38:59.868437 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:38:59.868437 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:38:59.868437 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:38:59.868437 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:38:59.868437 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:38:59.869347 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:38:59.869347 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:38:59.869347 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:38:59.869347 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:38:59.869347 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:38:59.869347 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:38:59.869347 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:38:59.869347 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:38:59.869347 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:38:59.869347 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:38:59.869347 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:38:59.869347 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:38:59.869347 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 08:38:59.869347 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:38:59.869347 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 646/1298] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Jun 22 08:38:59 2022] GET /identity/v3/services/placement => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:38:59.874469 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c819d-fc23-4701-adb1-35c2d8f7fd5f None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:38:59.897199 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:38:59.979838 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c819d-fc23-4701-adb1-35c2d8f7fd5f None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:39:00.023599 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f670d9-66d1-47ba-8fef-b5cd5ea45fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:39:00.024266 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f670d9-66d1-47ba-8fef-b5cd5ea45fd5 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:39:00.024555 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f670d9-66d1-47ba-8fef-b5cd5ea45fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:39:00.024829 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f670d9-66d1-47ba-8fef-b5cd5ea45fd5 None admin] PATH_INFO: `/v3/services` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:39:00.025540 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f670d9-66d1-47ba-8fef-b5cd5ea45fd5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:39:00.025851 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f670d9-66d1-47ba-8fef-b5cd5ea45fd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:39:00.027269 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f670d9-66d1-47ba-8fef-b5cd5ea45fd5 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:39:00.032833 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 653/1299] 10.222.0.42 () {56 vars in 1116 bytes} [Wed Jun 22 08:38:59 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:39:00.038840 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e05d5f9-3afd-4404-9df3-348be06a1386 None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:39:00.073359 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:39:00.141031 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e05d5f9-3afd-4404-9df3-348be06a1386 None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:39:00.173126 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370d078-93d0-4b2d-a9df-d366e6eba1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:39:00.173773 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370d078-93d0-4b2d-a9df-d366e6eba1a2 None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:39:00.174056 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370d078-93d0-4b2d-a9df-d366e6eba1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:39:00.174435 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370d078-93d0-4b2d-a9df-d366e6eba1a2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:39:00.175213 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9370d078-93d0-4b2d-a9df-d366e6eba1a2 None admin] RBAC: Adding query filter params (interface=public, service_id=580a036221c94ae3a7b18f6ecc9c7e73, region_id=RegionOne) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:39:00.175523 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9370d078-93d0-4b2d-a9df-d366e6eba1a2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:39:00.176920 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9370d078-93d0-4b2d-a9df-d366e6eba1a2 None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:39:00.181907 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 647/1300] 10.222.0.42 () {56 vars in 1251 bytes} [Wed Jun 22 08:39:00 2022] GET /identity/v3/endpoints?service_id=580a036221c94ae3a7b18f6ecc9c7e73&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:39:00.187758 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f670d9-66d1-47ba-8fef-b5cd5ea45fd5 None admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:39:00.269870 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:39:00.289064 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f670d9-66d1-47ba-8fef-b5cd5ea45fd5 None admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:39:00.323437 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff514230-b7df-4076-bf8f-9139ccf8c529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:39:00.324088 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff514230-b7df-4076-bf8f-9139ccf8c529 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:39:00.324368 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff514230-b7df-4076-bf8f-9139ccf8c529 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:39:00.324643 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff514230-b7df-4076-bf8f-9139ccf8c529 None admin] PATH_INFO: `/v3/services` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:39:00.325423 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff514230-b7df-4076-bf8f-9139ccf8c529 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:39:00.327006 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff514230-b7df-4076-bf8f-9139ccf8c529 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:39:00.336890 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 654/1301] 10.222.0.42 () {56 vars in 1087 bytes} [Wed Jun 22 08:39:00 2022] GET /identity/v3/services => generated 2191 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:39:02.361752 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83608e36-42f8-4c15-8e16-7dad92fdb2ec None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:39:02.362354 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83608e36-42f8-4c15-8e16-7dad92fdb2ec None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:39:02.362354 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83608e36-42f8-4c15-8e16-7dad92fdb2ec None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:39:02.363718 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 648/1302] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:39:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:39:02.369897 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f94dbe-161e-4986-8cb5-8057c36e5afe None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:39:02.370409 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f94dbe-161e-4986-8cb5-8057c36e5afe None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:39:02.370502 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f94dbe-161e-4986-8cb5-8057c36e5afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:39:02.389008 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-52f94dbe-161e-4986-8cb5-8057c36e5afe None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:39:02.390235 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-52f94dbe-161e-4986-8cb5-8057c36e5afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:39:02.457139 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 655/1303] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:39:02 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:39:02.481264 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83608e36-42f8-4c15-8e16-7dad92fdb2ec None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:39:02.574804 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:39:02.581726 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83608e36-42f8-4c15-8e16-7dad92fdb2ec None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:39:02.615820 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c66de-a6da-4d3b-a374-eb36c25513fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:39:02.616605 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c66de-a6da-4d3b-a374-eb36c25513fd None admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:39:02.616885 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c66de-a6da-4d3b-a374-eb36c25513fd None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:39:02.617159 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c66de-a6da-4d3b-a374-eb36c25513fd None admin] PATH_INFO: `/v3/services/placement` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:39:02.617807 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8c66de-a6da-4d3b-a374-eb36c25513fd None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:39:02.619182 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8c66de-a6da-4d3b-a374-eb36c25513fd None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:39:02.630728 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-cc8c66de-a6da-4d3b-a374-eb36c25513fd None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 08:39:02.630728 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:39:02.630728 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:39:02.630728 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:39:02.630728 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:39:02.630728 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:39:02.630728 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:39:02.630728 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:39:02.630728 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 08:39:02.630728 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:39:02.630728 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:39:02.630728 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:39:02.630728 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:39:02.630728 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:39:02.630728 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:39:02.630728 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:39:02.630728 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:39:02.631906 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:39:02.631906 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:39:02.631906 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:39:02.631906 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:39:02.631906 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:39:02.631906 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:39:02.631906 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:39:02.631906 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:39:02.631906 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:39:02.631906 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:39:02.631906 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:39:02.631906 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:39:02.631906 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:39:02.631906 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:39:02.631906 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:39:02.631906 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:39:02.632902 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:39:02.632902 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 08:39:02.632902 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:39:02.632902 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:39:02.632902 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:39:02.632902 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:39:02.632902 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:39:02.632902 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:39:02.632902 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:39:02.632902 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:39:02.632902 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:39:02.632902 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:39:02.632902 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 08:39:02.632902 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 08:39:02.632902 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 649/1304] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Jun 22 08:39:02 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:39:02.638094 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f94dbe-161e-4986-8cb5-8057c36e5afe None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:39:02.712606 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:39:02.736049 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f94dbe-161e-4986-8cb5-8057c36e5afe None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:39:02.770658 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be67f6-71b0-41be-bacb-7130c04248e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:39:02.771310 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be67f6-71b0-41be-bacb-7130c04248e5 None admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:39:02.771591 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be67f6-71b0-41be-bacb-7130c04248e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:39:02.771863 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be67f6-71b0-41be-bacb-7130c04248e5 None admin] PATH_INFO: `/v3/services` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:39:02.772564 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39be67f6-71b0-41be-bacb-7130c04248e5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:39:02.772869 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39be67f6-71b0-41be-bacb-7130c04248e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:39:02.774258 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39be67f6-71b0-41be-bacb-7130c04248e5 None admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:39:02.779277 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 656/1305] 10.222.0.42 () {56 vars in 1116 bytes} [Wed Jun 22 08:39:02 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:39:02.785110 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c66de-a6da-4d3b-a374-eb36c25513fd None admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:39:02.882448 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c66de-a6da-4d3b-a374-eb36c25513fd None admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:39:02.915012 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e18b825-e359-431d-bd62-a4bd5174826d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:39:02.915665 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18b825-e359-431d-bd62-a4bd5174826d None admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:39:02.915953 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18b825-e359-431d-bd62-a4bd5174826d None admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:39:02.916234 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18b825-e359-431d-bd62-a4bd5174826d None admin] PATH_INFO: `/v3/endpoints` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:39:02.916980 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e18b825-e359-431d-bd62-a4bd5174826d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:39:02.918377 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e18b825-e359-431d-bd62-a4bd5174826d None admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:39:02.936520 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 650/1306] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Jun 22 08:39:02 2022] POST /identity/v3/endpoints => generated 331 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:39:12.776317 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=30 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:39:12.932230 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:40:06.611087 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e2e3ad-554c-469d-8fa8-556736031894 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:40:06.611642 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e2e3ad-554c-469d-8fa8-556736031894 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:40:06.611642 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e2e3ad-554c-469d-8fa8-556736031894 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:40:06.612936 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 657/1307] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:40:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:40:06.618390 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8400c1-a760-4399-a11d-419696d33c32 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:40:06.618856 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8400c1-a760-4399-a11d-419696d33c32 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:40:06.619068 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8400c1-a760-4399-a11d-419696d33c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:40:06.708444 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-fc8400c1-a760-4399-a11d-419696d33c32 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:40:06.709772 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-fc8400c1-a760-4399-a11d-419696d33c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:40:06.924322 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 651/1308] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:40:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:40:06.977083 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43b0d5-e9a7-4f97-9b78-bd8384e13069 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:40:06.977522 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43b0d5-e9a7-4f97-9b78-bd8384e13069 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:40:06.977939 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43b0d5-e9a7-4f97-9b78-bd8384e13069 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:40:06.980115 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 658/1309] 10.222.0.42 () {54 vars in 964 bytes} [Wed Jun 22 08:40:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:40:06.987800 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a6ac7-c51e-4cbd-bedc-fc3193475c28 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:40:06.988521 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a6ac7-c51e-4cbd-bedc-fc3193475c28 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:40:06.989210 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a6ac7-c51e-4cbd-bedc-fc3193475c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:40:07.100296 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-559a6ac7-c51e-4cbd-bedc-fc3193475c28 None None] MFA Rules not processed for user `751f037ff70d4eb8acb4e8d4c5c487ad`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:40:07.101534 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-559a6ac7-c51e-4cbd-bedc-fc3193475c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:40:07.134440 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:40:07.202979 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 652/1310] 10.222.0.42 () {58 vars in 1061 bytes} [Wed Jun 22 08:40:06 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:40:07.212208 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d43b0d5-e9a7-4f97-9b78-bd8384e13069 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:40:07.214169 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-8d43b0d5-e9a7-4f97-9b78-bd8384e13069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:40:07.341182 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d43b0d5-e9a7-4f97-9b78-bd8384e13069 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:40:07.420343 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0172006d-3f49-4cc6-a3cf-6d1634464e02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:40:07.420904 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172006d-3f49-4cc6-a3cf-6d1634464e02 service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:40:07.421184 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172006d-3f49-4cc6-a3cf-6d1634464e02 service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:40:07.421455 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172006d-3f49-4cc6-a3cf-6d1634464e02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:40:07.423779 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-0172006d-3f49-4cc6-a3cf-6d1634464e02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:40:07.481534 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:40:07.543285 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0172006d-3f49-4cc6-a3cf-6d1634464e02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:40:07.544753 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0172006d-3f49-4cc6-a3cf-6d1634464e02 service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:40:07.565133 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 659/1311] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:40:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:40:09.878313 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e9320-77fb-4339-ab98-a00757d92bf7 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:40:09.878855 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e9320-77fb-4339-ab98-a00757d92bf7 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:40:09.878855 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e9320-77fb-4339-ab98-a00757d92bf7 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:40:09.880303 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 653/1312] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:40:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:40:09.885755 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f91de8-323d-4bb5-b1b9-5f89707a7fac None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:40:09.886503 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f91de8-323d-4bb5-b1b9-5f89707a7fac None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:40:09.886646 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f91de8-323d-4bb5-b1b9-5f89707a7fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:40:09.959643 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-43f91de8-323d-4bb5-b1b9-5f89707a7fac None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:40:09.960873 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-43f91de8-323d-4bb5-b1b9-5f89707a7fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:40:10.069845 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 660/1313] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:40:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:40:10.109722 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e9320-77fb-4339-ab98-a00757d92bf7 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:40:10.111411 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-de3e9320-77fb-4339-ab98-a00757d92bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:40:10.225660 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e9320-77fb-4339-ab98-a00757d92bf7 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:40:10.311009 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:40:10.314041 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e81430-e167-464d-9691-e7358570783f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:40:10.315025 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e81430-e167-464d-9691-e7358570783f service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:40:10.315626 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e81430-e167-464d-9691-e7358570783f service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:40:10.315949 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e81430-e167-464d-9691-e7358570783f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:40:10.318008 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-70e81430-e167-464d-9691-e7358570783f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:40:10.441839 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e81430-e167-464d-9691-e7358570783f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:40:10.443361 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e81430-e167-464d-9691-e7358570783f service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:40:10.465465 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 654/1314] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:40:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:40:12.799561 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6948b-80ee-4a17-b6fd-dfb21ca67f70 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:40:12.800163 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6948b-80ee-4a17-b6fd-dfb21ca67f70 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:40:12.800163 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6948b-80ee-4a17-b6fd-dfb21ca67f70 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:40:12.801521 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 661/1315] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:40:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:40:12.808087 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edd9f5-9471-422a-95fa-4d44d5968aea None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:40:12.808644 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edd9f5-9471-422a-95fa-4d44d5968aea None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:40:12.808644 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edd9f5-9471-422a-95fa-4d44d5968aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:40:12.882097 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-41edd9f5-9471-422a-95fa-4d44d5968aea None None] MFA Rules not processed for user `df27ddfb34374fed99b8b5d643046079`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:40:12.883319 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-41edd9f5-9471-422a-95fa-4d44d5968aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:40:12.934726 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:40:12.979920 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 655/1316] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:40:12 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:40:13.034714 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8817f4-e142-4a9d-92a7-09e181338d44 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:40:13.034999 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8817f4-e142-4a9d-92a7-09e181338d44 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:40:13.035279 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8817f4-e142-4a9d-92a7-09e181338d44 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:40:13.036633 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 662/1317] 10.222.0.42 () {54 vars in 964 bytes} [Wed Jun 22 08:40:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:40:13.042695 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4369a-c172-4e25-af0b-4db31c603532 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:40:13.042986 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4369a-c172-4e25-af0b-4db31c603532 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:40:13.043262 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4369a-c172-4e25-af0b-4db31c603532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:40:13.120156 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-3ae4369a-c172-4e25-af0b-4db31c603532 None None] MFA Rules not processed for user `751f037ff70d4eb8acb4e8d4c5c487ad`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:40:13.121372 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-3ae4369a-c172-4e25-af0b-4db31c603532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:40:13.196632 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 656/1318] 10.222.0.42 () {58 vars in 1061 bytes} [Wed Jun 22 08:40:13 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 08:40:13.206328 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8817f4-e142-4a9d-92a7-09e181338d44 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:40:13.207854 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-bf8817f4-e142-4a9d-92a7-09e181338d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:40:13.217633 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:40:13.312001 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8817f4-e142-4a9d-92a7-09e181338d44 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:40:13.384685 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd37238-a20e-4a08-b336-58f7be721586 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:40:13.385331 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd37238-a20e-4a08-b336-58f7be721586 service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:40:13.385614 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd37238-a20e-4a08-b336-58f7be721586 service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:40:13.385886 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd37238-a20e-4a08-b336-58f7be721586 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:40:13.387879 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-fdd37238-a20e-4a08-b336-58f7be721586 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:40:13.451661 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:40:13.500065 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd37238-a20e-4a08-b336-58f7be721586 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:40:13.502191 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd37238-a20e-4a08-b336-58f7be721586 service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:40:13.523510 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 663/1319] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:40:13 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:40:16.514385 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c02c79-7ebc-47e1-94d8-cdb5ab16dd63 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:40:16.514884 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c02c79-7ebc-47e1-94d8-cdb5ab16dd63 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:40:16.514884 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c02c79-7ebc-47e1-94d8-cdb5ab16dd63 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:40:16.516259 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 657/1320] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:40:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:40:16.521612 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f71c3-4b3f-4a94-b1bc-c17465acfea4 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:40:16.522100 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f71c3-4b3f-4a94-b1bc-c17465acfea4 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:40:16.522196 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f71c3-4b3f-4a94-b1bc-c17465acfea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:40:16.586302 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-b52f71c3-4b3f-4a94-b1bc-c17465acfea4 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:40:16.587523 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-b52f71c3-4b3f-4a94-b1bc-c17465acfea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:40:16.682699 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 664/1321] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:40:16 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:40:16.722518 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c02c79-7ebc-47e1-94d8-cdb5ab16dd63 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:40:16.724055 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-b1c02c79-7ebc-47e1-94d8-cdb5ab16dd63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:40:16.776410 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:40:16.831680 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c02c79-7ebc-47e1-94d8-cdb5ab16dd63 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:40:16.904369 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2903e592-1849-4c19-9434-7fac051978bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:40:16.905018 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903e592-1849-4c19-9434-7fac051978bc service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:40:16.905303 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903e592-1849-4c19-9434-7fac051978bc service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:40:16.905579 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903e592-1849-4c19-9434-7fac051978bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:40:16.907306 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-2903e592-1849-4c19-9434-7fac051978bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:40:17.003593 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:40:17.017796 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2903e592-1849-4c19-9434-7fac051978bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:40:17.019309 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2903e592-1849-4c19-9434-7fac051978bc service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:40:17.038290 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 658/1322] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:40:16 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:40:19.788077 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f69608-52dd-4e62-bb2e-42eb88898c74 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:40:19.788707 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f69608-52dd-4e62-bb2e-42eb88898c74 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:40:19.788707 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f69608-52dd-4e62-bb2e-42eb88898c74 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:40:19.790038 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 665/1323] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:40:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:40:19.795985 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f146f-8f20-4def-9ebb-09dd1829a588 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:40:19.796519 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f146f-8f20-4def-9ebb-09dd1829a588 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:40:19.796519 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f146f-8f20-4def-9ebb-09dd1829a588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:40:19.870508 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-168f146f-8f20-4def-9ebb-09dd1829a588 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:40:19.871764 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-168f146f-8f20-4def-9ebb-09dd1829a588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:40:19.981215 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 659/1324] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:40:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:40:20.020482 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f69608-52dd-4e62-bb2e-42eb88898c74 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:40:20.022219 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-28f69608-52dd-4e62-bb2e-42eb88898c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:40:20.042964 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:40:20.137961 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f69608-52dd-4e62-bb2e-42eb88898c74 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:40:20.213691 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ace26-0bac-4fd9-8529-bf591d99b9d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:40:20.214366 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ace26-0bac-4fd9-8529-bf591d99b9d5 service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:40:20.214648 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ace26-0bac-4fd9-8529-bf591d99b9d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:40:20.214921 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ace26-0bac-4fd9-8529-bf591d99b9d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:40:20.216564 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-9c3ace26-0bac-4fd9-8529-bf591d99b9d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:40:20.294638 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:40:20.333338 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ace26-0bac-4fd9-8529-bf591d99b9d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:40:20.334947 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ace26-0bac-4fd9-8529-bf591d99b9d5 service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:40:20.355268 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 666/1325] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:40:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:40:22.468106 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac165bf1-9f1f-4233-ac7c-a5171b180dd0 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:40:22.469157 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac165bf1-9f1f-4233-ac7c-a5171b180dd0 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:40:22.469518 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac165bf1-9f1f-4233-ac7c-a5171b180dd0 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:40:22.470965 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 660/1326] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:40:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:40:22.476483 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65eba62-50b3-48e2-981b-4882fae2fa55 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:40:22.476927 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65eba62-50b3-48e2-981b-4882fae2fa55 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:40:22.477022 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65eba62-50b3-48e2-981b-4882fae2fa55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:40:22.544310 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-f65eba62-50b3-48e2-981b-4882fae2fa55 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:40:22.545533 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-f65eba62-50b3-48e2-981b-4882fae2fa55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:40:22.647425 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 667/1327] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:40:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:40:22.683385 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac165bf1-9f1f-4233-ac7c-a5171b180dd0 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:40:22.685012 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-ac165bf1-9f1f-4233-ac7c-a5171b180dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:40:22.746952 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:40:22.791366 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac165bf1-9f1f-4233-ac7c-a5171b180dd0 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:40:22.875749 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97f0942-fd6f-41e1-a43f-b9e9f9cf6d85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:40:22.876422 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f0942-fd6f-41e1-a43f-b9e9f9cf6d85 service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:40:22.876708 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f0942-fd6f-41e1-a43f-b9e9f9cf6d85 service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:40:22.876987 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f0942-fd6f-41e1-a43f-b9e9f9cf6d85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:40:22.878851 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-f97f0942-fd6f-41e1-a43f-b9e9f9cf6d85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:40:23.008208 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:40:23.011481 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97f0942-fd6f-41e1-a43f-b9e9f9cf6d85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:40:23.013377 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97f0942-fd6f-41e1-a43f-b9e9f9cf6d85 service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:40:23.035413 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 661/1328] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:40:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:40:25.142991 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71f899-26d8-49a9-b948-a3e6ecdf379b None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:40:25.143554 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71f899-26d8-49a9-b948-a3e6ecdf379b None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:40:25.143554 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71f899-26d8-49a9-b948-a3e6ecdf379b None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:40:25.144921 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 668/1329] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:40:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:40:25.150466 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0705a2f-9826-4863-a5ce-6dee7174c6d4 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:40:25.150950 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0705a2f-9826-4863-a5ce-6dee7174c6d4 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:40:25.151039 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0705a2f-9826-4863-a5ce-6dee7174c6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:40:25.220456 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-d0705a2f-9826-4863-a5ce-6dee7174c6d4 None None] MFA Rules not processed for user `df27ddfb34374fed99b8b5d643046079`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:40:25.221686 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-d0705a2f-9826-4863-a5ce-6dee7174c6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:40:25.338440 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 662/1330] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:40:25 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 08:40:25.375247 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71f899-26d8-49a9-b948-a3e6ecdf379b None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:40:25.376828 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-1c71f899-26d8-49a9-b948-a3e6ecdf379b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:40:25.409291 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:40:25.485375 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71f899-26d8-49a9-b948-a3e6ecdf379b None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:40:25.572017 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256c6ab5-c7d4-4a22-945d-a15dd09de8f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:40:25.572686 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c6ab5-c7d4-4a22-945d-a15dd09de8f8 service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:40:25.572974 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c6ab5-c7d4-4a22-945d-a15dd09de8f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:40:25.573255 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c6ab5-c7d4-4a22-945d-a15dd09de8f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:40:25.575030 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-256c6ab5-c7d4-4a22-945d-a15dd09de8f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:40:25.660343 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:40:25.694716 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256c6ab5-c7d4-4a22-945d-a15dd09de8f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:40:25.696155 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256c6ab5-c7d4-4a22-945d-a15dd09de8f8 service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:40:25.716160 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 669/1331] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:40:25 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 08:40:28.043570 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb07716-2ebb-4ea0-a530-21c659520e79 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:40:28.044148 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb07716-2ebb-4ea0-a530-21c659520e79 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:40:28.044148 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb07716-2ebb-4ea0-a530-21c659520e79 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:40:28.045506 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 663/1332] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:40:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:40:28.050763 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef48807-d415-42ac-8ad9-0034fe9aa88b None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:40:28.051183 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef48807-d415-42ac-8ad9-0034fe9aa88b None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:40:28.051320 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef48807-d415-42ac-8ad9-0034fe9aa88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:40:28.116371 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-1ef48807-d415-42ac-8ad9-0034fe9aa88b None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:40:28.117588 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-1ef48807-d415-42ac-8ad9-0034fe9aa88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:40:28.212990 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 670/1333] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:40:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:40:28.249263 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb07716-2ebb-4ea0-a530-21c659520e79 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:40:28.251195 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-abb07716-2ebb-4ea0-a530-21c659520e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:40:28.319801 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:40:28.353434 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb07716-2ebb-4ea0-a530-21c659520e79 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:40:28.427671 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cfae1c-5c10-4f48-8b40-6a078506d9b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:40:28.428254 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfae1c-5c10-4f48-8b40-6a078506d9b0 service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:40:28.428459 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfae1c-5c10-4f48-8b40-6a078506d9b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:40:28.428734 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfae1c-5c10-4f48-8b40-6a078506d9b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:40:28.430424 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-74cfae1c-5c10-4f48-8b40-6a078506d9b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:40:28.543889 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cfae1c-5c10-4f48-8b40-6a078506d9b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:40:28.545337 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cfae1c-5c10-4f48-8b40-6a078506d9b0 service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:40:28.556404 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:40:28.567259 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 664/1334] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:40:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:40:30.705969 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c02899-b67a-4f9f-a228-3a880ec2aaa0 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:40:30.706646 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c02899-b67a-4f9f-a228-3a880ec2aaa0 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:40:30.706646 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c02899-b67a-4f9f-a228-3a880ec2aaa0 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:40:30.707976 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 671/1335] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:40:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:40:30.714117 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b53fb4e-64b4-4f51-8d0e-2d8ceee5baf5 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:40:30.714961 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b53fb4e-64b4-4f51-8d0e-2d8ceee5baf5 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:40:30.715123 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b53fb4e-64b4-4f51-8d0e-2d8ceee5baf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:40:30.780625 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-7b53fb4e-64b4-4f51-8d0e-2d8ceee5baf5 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:40:30.781949 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-7b53fb4e-64b4-4f51-8d0e-2d8ceee5baf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:40:30.882849 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 665/1336] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:40:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:40:30.924247 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c02899-b67a-4f9f-a228-3a880ec2aaa0 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:40:30.925886 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-10c02899-b67a-4f9f-a228-3a880ec2aaa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:40:30.966260 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:40:31.035050 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c02899-b67a-4f9f-a228-3a880ec2aaa0 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:40:31.109653 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b99821-7939-488f-bd72-ae20cc00ca35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:40:31.110328 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b99821-7939-488f-bd72-ae20cc00ca35 service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:40:31.110614 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b99821-7939-488f-bd72-ae20cc00ca35 service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:40:31.110889 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b99821-7939-488f-bd72-ae20cc00ca35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:40:31.112553 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-94b99821-7939-488f-bd72-ae20cc00ca35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:40:31.196284 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:40:31.225257 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b99821-7939-488f-bd72-ae20cc00ca35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:40:31.226667 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b99821-7939-488f-bd72-ae20cc00ca35 service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:40:31.244775 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 672/1337] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:40:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 08:40:33.791352 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d3be5-bb88-49d8-a95d-07756a2a42fd None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:40:33.791950 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d3be5-bb88-49d8-a95d-07756a2a42fd None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:40:33.791950 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d3be5-bb88-49d8-a95d-07756a2a42fd None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:40:33.793300 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 666/1338] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:40:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:40:33.799005 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a458c-ff20-4059-9a0f-d0efda029ee4 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:40:33.799433 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a458c-ff20-4059-9a0f-d0efda029ee4 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:40:33.799591 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a458c-ff20-4059-9a0f-d0efda029ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:40:33.863861 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-cf6a458c-ff20-4059-9a0f-d0efda029ee4 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:40:33.865081 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-cf6a458c-ff20-4059-9a0f-d0efda029ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:40:33.961789 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 673/1339] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:40:33 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:40:33.998715 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0d3be5-bb88-49d8-a95d-07756a2a42fd None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:40:34.000841 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-de0d3be5-bb88-49d8-a95d-07756a2a42fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:40:34.076679 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:40:34.106226 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0d3be5-bb88-49d8-a95d-07756a2a42fd None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:40:34.180648 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf1f42e-471a-4132-9032-fb1d94f18fc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:40:34.181302 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1f42e-471a-4132-9032-fb1d94f18fc4 service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:40:34.181587 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1f42e-471a-4132-9032-fb1d94f18fc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:40:34.181865 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1f42e-471a-4132-9032-fb1d94f18fc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:40:34.183542 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-cdf1f42e-471a-4132-9032-fb1d94f18fc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:40:34.293582 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf1f42e-471a-4132-9032-fb1d94f18fc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:40:34.295050 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf1f42e-471a-4132-9032-fb1d94f18fc4 service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:40:34.313778 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 667/1340] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:40:33 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:40:38.456229 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b230f1-5a13-4fef-bd33-8e60765cf3a0 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:40:38.456918 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b230f1-5a13-4fef-bd33-8e60765cf3a0 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:40:38.456918 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b230f1-5a13-4fef-bd33-8e60765cf3a0 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:40:38.458518 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 674/1341] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:40:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:40:38.466267 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360db063-b538-42f7-b5b6-104961a40a2e None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:40:38.467049 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360db063-b538-42f7-b5b6-104961a40a2e None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:40:38.467214 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360db063-b538-42f7-b5b6-104961a40a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:40:38.475263 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:40:38.574764 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-360db063-b538-42f7-b5b6-104961a40a2e None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:40:38.577317 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-360db063-b538-42f7-b5b6-104961a40a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:40:38.732760 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 668/1342] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:40:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:40:38.779712 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b230f1-5a13-4fef-bd33-8e60765cf3a0 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:40:38.783654 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-69b230f1-5a13-4fef-bd33-8e60765cf3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:40:38.853883 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:40:38.921293 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b230f1-5a13-4fef-bd33-8e60765cf3a0 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:40:38.925221 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b63f4b-521c-4d2d-85b4-edf6d407766e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:40:38.925940 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b63f4b-521c-4d2d-85b4-edf6d407766e service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:40:38.926474 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b63f4b-521c-4d2d-85b4-edf6d407766e service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:40:38.926817 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b63f4b-521c-4d2d-85b4-edf6d407766e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:40:38.938317 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b63f4b-521c-4d2d-85b4-edf6d407766e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:40:38.939877 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b63f4b-521c-4d2d-85b4-edf6d407766e service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:40:38.951156 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 675/1343] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:40:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:40:41.901187 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2ddc5-810c-4e50-8caa-bf67cf6e9dd2 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:40:41.902021 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2ddc5-810c-4e50-8caa-bf67cf6e9dd2 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:40:41.902021 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2ddc5-810c-4e50-8caa-bf67cf6e9dd2 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:40:41.903229 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 669/1344] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:40:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:40:41.910570 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb67e7-fd22-4376-9641-aa1f62d1af24 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:40:41.911170 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb67e7-fd22-4376-9641-aa1f62d1af24 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:40:41.911364 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb67e7-fd22-4376-9641-aa1f62d1af24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:40:41.943401 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-6bdb67e7-fd22-4376-9641-aa1f62d1af24 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:40:41.944644 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-6bdb67e7-fd22-4376-9641-aa1f62d1af24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:40:42.054218 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 676/1345] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:40:41 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:40:42.122723 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d2ddc5-810c-4e50-8caa-bf67cf6e9dd2 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:40:42.125556 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-50d2ddc5-810c-4e50-8caa-bf67cf6e9dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:40:42.144884 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d2ddc5-810c-4e50-8caa-bf67cf6e9dd2 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:40:42.149468 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb7faa2-280f-4f9f-a91c-f8571837c955 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:40:42.150288 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7faa2-280f-4f9f-a91c-f8571837c955 service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:40:42.150647 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7faa2-280f-4f9f-a91c-f8571837c955 service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:40:42.151077 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7faa2-280f-4f9f-a91c-f8571837c955 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:40:42.162679 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb7faa2-280f-4f9f-a91c-f8571837c955 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:40:42.164070 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb7faa2-280f-4f9f-a91c-f8571837c955 service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:40:42.176113 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 670/1346] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:40:42 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:40:46.853204 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13026e1-54af-4a37-af03-64388e99a085 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:40:46.853756 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13026e1-54af-4a37-af03-64388e99a085 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:40:46.853756 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13026e1-54af-4a37-af03-64388e99a085 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:40:46.855178 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 677/1347] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:40:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:40:46.861242 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7decbb-5818-4618-8117-e437fed01bb7 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:40:46.861775 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7decbb-5818-4618-8117-e437fed01bb7 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:40:46.861925 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7decbb-5818-4618-8117-e437fed01bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:40:46.881028 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-8b7decbb-5818-4618-8117-e437fed01bb7 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:40:46.882289 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-8b7decbb-5818-4618-8117-e437fed01bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:40:46.891399 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 671/1348] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:40:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 08:40:46.932101 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13026e1-54af-4a37-af03-64388e99a085 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:40:46.949097 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13026e1-54af-4a37-af03-64388e99a085 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:40:46.955405 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a4862c-f2ba-4c92-b402-9bdae4b7fe17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:40:46.956518 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4862c-f2ba-4c92-b402-9bdae4b7fe17 service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:40:46.957023 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4862c-f2ba-4c92-b402-9bdae4b7fe17 service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:40:46.957517 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4862c-f2ba-4c92-b402-9bdae4b7fe17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:40:46.975518 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a4862c-f2ba-4c92-b402-9bdae4b7fe17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:40:46.977130 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a4862c-f2ba-4c92-b402-9bdae4b7fe17 service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:40:46.993709 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 678/1349] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:40:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:40:52.608554 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242a164-6f86-487f-a2db-9550b2a6b597 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:40:52.609159 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242a164-6f86-487f-a2db-9550b2a6b597 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:40:52.609159 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242a164-6f86-487f-a2db-9550b2a6b597 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:40:52.611002 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 672/1350] 10.222.0.42 () {54 vars in 921 bytes} [Wed Jun 22 08:40:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:40:52.617785 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91997cfd-9937-4d2f-afbb-5593d6860b9f None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:40:52.620546 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91997cfd-9937-4d2f-afbb-5593d6860b9f None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:40:52.621127 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91997cfd-9937-4d2f-afbb-5593d6860b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:40:52.731505 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-91997cfd-9937-4d2f-afbb-5593d6860b9f None None] MFA Rules not processed for user `ec2627e3cdc94ec38d7cc3b1bc670ef1`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:40:52.732754 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-91997cfd-9937-4d2f-afbb-5593d6860b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:40:52.767877 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:40:52.829818 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 679/1351] 10.222.0.42 () {58 vars in 1018 bytes} [Wed Jun 22 08:40:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:40:56.875799 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=72 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:40:57.980633 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ff78d-7729-4082-9662-5e12adaa1956 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:40:57.983082 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ff78d-7729-4082-9662-5e12adaa1956 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:40:57.983082 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ff78d-7729-4082-9662-5e12adaa1956 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:40:57.983082 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 673/1352] 10.222.0.42 () {54 vars in 921 bytes} [Wed Jun 22 08:40:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:40:57.989202 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f583eb-7497-452b-b473-f4ce041a193c None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:40:57.990317 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f583eb-7497-452b-b473-f4ce041a193c None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:40:57.990832 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f583eb-7497-452b-b473-f4ce041a193c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:40:58.011465 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-73f583eb-7497-452b-b473-f4ce041a193c None None] MFA Rules not processed for user `ec2627e3cdc94ec38d7cc3b1bc670ef1`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:40:58.013000 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-73f583eb-7497-452b-b473-f4ce041a193c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:40:58.023914 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 680/1353] 10.222.0.42 () {58 vars in 1018 bytes} [Wed Jun 22 08:40:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:40:59.296015 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728961c5-965d-4fe4-ab60-ff17ae024ff0 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:40:59.296815 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728961c5-965d-4fe4-ab60-ff17ae024ff0 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:40:59.296815 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728961c5-965d-4fe4-ab60-ff17ae024ff0 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:40:59.298010 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 674/1354] 10.222.0.42 () {54 vars in 921 bytes} [Wed Jun 22 08:40:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:40:59.305381 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d2782-1b9c-4a96-8831-552d077ed9c8 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:40:59.305891 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d2782-1b9c-4a96-8831-552d077ed9c8 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:40:59.305998 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d2782-1b9c-4a96-8831-552d077ed9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:40:59.326791 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-788d2782-1b9c-4a96-8831-552d077ed9c8 None None] MFA Rules not processed for user `ec2627e3cdc94ec38d7cc3b1bc670ef1`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:40:59.328123 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-788d2782-1b9c-4a96-8831-552d077ed9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:40:59.337991 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 681/1355] 10.222.0.42 () {58 vars in 1018 bytes} [Wed Jun 22 08:40:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 08:41:03.114913 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff586465-7812-47b5-916e-94b1965d9789 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:03.115524 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff586465-7812-47b5-916e-94b1965d9789 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:03.115524 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff586465-7812-47b5-916e-94b1965d9789 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:03.119378 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 675/1356] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:41:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:41:03.122707 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eefe2a4-caef-4350-b4cf-a8dab5631755 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:03.123437 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eefe2a4-caef-4350-b4cf-a8dab5631755 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:03.123610 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eefe2a4-caef-4350-b4cf-a8dab5631755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:03.147346 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-4eefe2a4-caef-4350-b4cf-a8dab5631755 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:41:03.148769 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-4eefe2a4-caef-4350-b4cf-a8dab5631755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:41:03.158686 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 682/1357] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:41:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:41:03.232272 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ba76e-7515-4284-8a8b-f97345f5158a None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:03.232674 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ba76e-7515-4284-8a8b-f97345f5158a None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:03.232995 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ba76e-7515-4284-8a8b-f97345f5158a None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:03.234818 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 676/1358] 10.222.0.42 () {54 vars in 961 bytes} [Wed Jun 22 08:41:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:41:03.245831 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a18ace-ffcc-43f3-bd1f-ca1f7d918320 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:03.246541 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a18ace-ffcc-43f3-bd1f-ca1f7d918320 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:03.247179 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a18ace-ffcc-43f3-bd1f-ca1f7d918320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:03.329451 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-d9a18ace-ffcc-43f3-bd1f-ca1f7d918320 None None] MFA Rules not processed for user `4f1809a35b244c1db7a185d82859369e`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:41:03.331039 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-d9a18ace-ffcc-43f3-bd1f-ca1f7d918320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:41:03.462448 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 683/1359] 10.222.0.42 () {58 vars in 1058 bytes} [Wed Jun 22 08:41:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 08:41:03.473901 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6ba76e-7515-4284-8a8b-f97345f5158a None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:03.497334 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6ba76e-7515-4284-8a8b-f97345f5158a None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:03.505687 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86ba08-ccaa-4074-8f28-27d48bb6fbcd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f1809a35b244c1db7a185d82859369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:03.506379 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86ba08-ccaa-4074-8f28-27d48bb6fbcd service nova] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:03.506677 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86ba08-ccaa-4074-8f28-27d48bb6fbcd service nova] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:03.506954 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86ba08-ccaa-4074-8f28-27d48bb6fbcd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:03.517692 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c86ba08-ccaa-4074-8f28-27d48bb6fbcd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:03.519356 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c86ba08-ccaa-4074-8f28-27d48bb6fbcd service nova] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:03.531454 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 677/1360] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:41:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:41:06.097876 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5ec12-065a-44f7-8c50-0442454b87ad None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:06.099347 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5ec12-065a-44f7-8c50-0442454b87ad None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:06.099889 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5ec12-065a-44f7-8c50-0442454b87ad None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:06.102189 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 684/1361] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:41:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:41:06.108180 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcaa924-3290-4323-8950-18fc159a55e0 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:06.108976 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcaa924-3290-4323-8950-18fc159a55e0 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:06.108976 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcaa924-3290-4323-8950-18fc159a55e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:06.129332 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-afcaa924-3290-4323-8950-18fc159a55e0 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:41:06.130506 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-afcaa924-3290-4323-8950-18fc159a55e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:41:06.140344 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 678/1362] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:41:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:41:06.193807 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a5ec12-065a-44f7-8c50-0442454b87ad None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:06.210418 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a5ec12-065a-44f7-8c50-0442454b87ad None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:06.216710 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a43b035-7ba0-4505-b4a6-5ddd6d73b399 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f1809a35b244c1db7a185d82859369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:06.218716 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43b035-7ba0-4505-b4a6-5ddd6d73b399 service nova] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:06.218993 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43b035-7ba0-4505-b4a6-5ddd6d73b399 service nova] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:06.219458 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43b035-7ba0-4505-b4a6-5ddd6d73b399 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:06.229133 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a43b035-7ba0-4505-b4a6-5ddd6d73b399 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:06.230792 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a43b035-7ba0-4505-b4a6-5ddd6d73b399 service nova] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:06.242216 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 685/1363] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:41:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 08:41:08.787052 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63506e8-3673-432a-bc06-a3a24cefbf44 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:08.787871 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63506e8-3673-432a-bc06-a3a24cefbf44 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:08.787871 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63506e8-3673-432a-bc06-a3a24cefbf44 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:08.789075 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 679/1364] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:41:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:41:08.796923 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcddcfc-eb64-4aac-a95e-274ff4e0caf4 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:08.797626 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcddcfc-eb64-4aac-a95e-274ff4e0caf4 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:08.799013 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcddcfc-eb64-4aac-a95e-274ff4e0caf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:08.823729 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-bfcddcfc-eb64-4aac-a95e-274ff4e0caf4 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:41:08.825133 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-bfcddcfc-eb64-4aac-a95e-274ff4e0caf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:41:08.833531 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 686/1365] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:41:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:41:08.887151 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cedc30e-da47-4a35-b3cf-aea2b7071e51 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:08.887440 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cedc30e-da47-4a35-b3cf-aea2b7071e51 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:08.887718 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cedc30e-da47-4a35-b3cf-aea2b7071e51 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:08.889296 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 680/1366] 10.222.0.42 () {54 vars in 961 bytes} [Wed Jun 22 08:41:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:41:08.895524 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5fd721-5e9d-4331-9960-00663459cb45 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:08.896061 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5fd721-5e9d-4331-9960-00663459cb45 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:08.896374 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5fd721-5e9d-4331-9960-00663459cb45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:08.916261 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-ea5fd721-5e9d-4331-9960-00663459cb45 None None] MFA Rules not processed for user `4f1809a35b244c1db7a185d82859369e`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:41:08.917414 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-ea5fd721-5e9d-4331-9960-00663459cb45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:41:08.927718 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 687/1367] 10.222.0.42 () {58 vars in 1058 bytes} [Wed Jun 22 08:41:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:41:08.941101 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cedc30e-da47-4a35-b3cf-aea2b7071e51 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:08.959479 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cedc30e-da47-4a35-b3cf-aea2b7071e51 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:08.965270 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0169ba77-4fa8-427b-8512-074725bf253d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f1809a35b244c1db7a185d82859369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:08.965923 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0169ba77-4fa8-427b-8512-074725bf253d service nova] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:08.968006 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0169ba77-4fa8-427b-8512-074725bf253d service nova] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:08.969329 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0169ba77-4fa8-427b-8512-074725bf253d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:08.991488 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0169ba77-4fa8-427b-8512-074725bf253d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:08.993151 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0169ba77-4fa8-427b-8512-074725bf253d service nova] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:09.007538 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 681/1368] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:41:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:41:11.164845 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027cbd6-e422-4445-9b65-8cadcf051940 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:11.165732 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027cbd6-e422-4445-9b65-8cadcf051940 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:11.166105 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027cbd6-e422-4445-9b65-8cadcf051940 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:11.167786 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 688/1369] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:41:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:41:11.175161 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d048f-dff8-4ac0-9446-ab9aa0e08fae None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:11.175664 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d048f-dff8-4ac0-9446-ab9aa0e08fae None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:11.176254 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d048f-dff8-4ac0-9446-ab9aa0e08fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:11.197288 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-e87d048f-dff8-4ac0-9446-ab9aa0e08fae None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:41:11.199282 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-e87d048f-dff8-4ac0-9446-ab9aa0e08fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:41:11.208521 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 682/1370] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:41:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:41:11.257228 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4027cbd6-e422-4445-9b65-8cadcf051940 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:11.273760 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4027cbd6-e422-4445-9b65-8cadcf051940 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:11.279717 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c4c0a1-3095-4e58-b622-e9bfdd0ac5a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f1809a35b244c1db7a185d82859369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:11.280397 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4c0a1-3095-4e58-b622-e9bfdd0ac5a3 service nova] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:11.280683 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4c0a1-3095-4e58-b622-e9bfdd0ac5a3 service nova] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:11.280965 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4c0a1-3095-4e58-b622-e9bfdd0ac5a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:11.290614 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c4c0a1-3095-4e58-b622-e9bfdd0ac5a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:11.292282 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c4c0a1-3095-4e58-b622-e9bfdd0ac5a3 service nova] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:11.303761 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 689/1371] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:41:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:41:12.039051 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f04396-3634-4c3d-ae95-bd06043afaec None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:12.039348 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f04396-3634-4c3d-ae95-bd06043afaec None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:12.039826 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f04396-3634-4c3d-ae95-bd06043afaec None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:12.041223 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 683/1372] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:41:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:41:12.047358 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f659e-1d49-4e71-a09c-4b0f2133498a None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:12.047649 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f659e-1d49-4e71-a09c-4b0f2133498a None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:12.048114 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f659e-1d49-4e71-a09c-4b0f2133498a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:12.066928 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-184f659e-1d49-4e71-a09c-4b0f2133498a None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:41:12.068150 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-184f659e-1d49-4e71-a09c-4b0f2133498a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:41:12.076805 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 690/1373] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:41:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:41:12.386186 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff66689-d404-4b09-83cc-4d81198766bc None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:12.386630 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff66689-d404-4b09-83cc-4d81198766bc None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:12.386741 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff66689-d404-4b09-83cc-4d81198766bc None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:12.388316 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 684/1374] 10.222.0.42 () {54 vars in 963 bytes} [Wed Jun 22 08:41:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:41:12.393937 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249bf46a-74da-4e8c-84e6-de06eb475f15 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:12.394753 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249bf46a-74da-4e8c-84e6-de06eb475f15 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:12.395045 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249bf46a-74da-4e8c-84e6-de06eb475f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:12.402777 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:12.449924 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-249bf46a-74da-4e8c-84e6-de06eb475f15 None None] MFA Rules not processed for user `b4a2701c65144851ad87ac77fccb686f`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:41:12.451312 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-249bf46a-74da-4e8c-84e6-de06eb475f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:41:12.520732 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 691/1375] 10.222.0.42 () {58 vars in 1060 bytes} [Wed Jun 22 08:41:12 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:41:12.528244 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff66689-d404-4b09-83cc-4d81198766bc None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:12.539324 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff66689-d404-4b09-83cc-4d81198766bc None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:12.542878 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c82c22-916c-47f7-9c90-3be2dc46a4e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:12.543523 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c82c22-916c-47f7-9c90-3be2dc46a4e5 service cinder] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:12.543809 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c82c22-916c-47f7-9c90-3be2dc46a4e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:12.544092 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c82c22-916c-47f7-9c90-3be2dc46a4e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:12.553769 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c82c22-916c-47f7-9c90-3be2dc46a4e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:12.555241 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c82c22-916c-47f7-9c90-3be2dc46a4e5 service cinder] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:12.565838 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 685/1376] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:41:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:41:13.421104 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a92483-8e83-4d33-8a80-63441237ba45 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:13.421766 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a92483-8e83-4d33-8a80-63441237ba45 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:13.421766 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a92483-8e83-4d33-8a80-63441237ba45 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:13.423387 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 692/1377] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:41:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:41:13.430698 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c5e97b-ed18-40ce-b8e4-432567fc85e1 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:13.430698 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c5e97b-ed18-40ce-b8e4-432567fc85e1 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:13.430698 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c5e97b-ed18-40ce-b8e4-432567fc85e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:13.453045 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-b1c5e97b-ed18-40ce-b8e4-432567fc85e1 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:41:13.454554 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-b1c5e97b-ed18-40ce-b8e4-432567fc85e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:41:13.464151 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 686/1378] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:41:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:41:13.510444 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a92483-8e83-4d33-8a80-63441237ba45 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:13.528801 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a92483-8e83-4d33-8a80-63441237ba45 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:13.536325 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c36a8-09cf-47e9-ad1e-88df9c2fcc69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f1809a35b244c1db7a185d82859369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:13.538777 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c36a8-09cf-47e9-ad1e-88df9c2fcc69 service nova] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:13.538777 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c36a8-09cf-47e9-ad1e-88df9c2fcc69 service nova] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:13.538777 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c36a8-09cf-47e9-ad1e-88df9c2fcc69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:13.556838 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56c36a8-09cf-47e9-ad1e-88df9c2fcc69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:13.560328 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56c36a8-09cf-47e9-ad1e-88df9c2fcc69 service nova] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:13.575590 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 693/1379] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:41:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:41:15.707180 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a984865-491d-41d5-8c7a-17bbc5a3fbe2 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:15.708569 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a984865-491d-41d5-8c7a-17bbc5a3fbe2 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:15.709011 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a984865-491d-41d5-8c7a-17bbc5a3fbe2 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:15.711697 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 687/1380] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:41:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:41:15.717544 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5c1c9-0a5b-4c1f-bf75-30fd3599d069 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:15.718021 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5c1c9-0a5b-4c1f-bf75-30fd3599d069 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:15.718144 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5c1c9-0a5b-4c1f-bf75-30fd3599d069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:15.739292 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-6fd5c1c9-0a5b-4c1f-bf75-30fd3599d069 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:41:15.739818 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-6fd5c1c9-0a5b-4c1f-bf75-30fd3599d069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:41:15.754375 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 694/1381] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:41:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:41:15.801733 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a984865-491d-41d5-8c7a-17bbc5a3fbe2 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:15.819068 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a984865-491d-41d5-8c7a-17bbc5a3fbe2 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:15.824681 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e86973-3c85-4595-8c55-289cff452cef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f1809a35b244c1db7a185d82859369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:15.825342 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e86973-3c85-4595-8c55-289cff452cef service nova] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:15.825630 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e86973-3c85-4595-8c55-289cff452cef service nova] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:15.825911 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e86973-3c85-4595-8c55-289cff452cef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:15.835087 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e86973-3c85-4595-8c55-289cff452cef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:15.836697 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e86973-3c85-4595-8c55-289cff452cef service nova] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:15.847307 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 688/1382] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:41:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:41:17.959315 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b8fd7-6085-4b58-a946-10e543547972 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:17.959934 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b8fd7-6085-4b58-a946-10e543547972 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:17.959934 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b8fd7-6085-4b58-a946-10e543547972 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:17.961247 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 695/1383] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:41:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:41:17.967257 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26304563-9c05-4b07-9a06-7f7e8ead5cde None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:17.968113 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26304563-9c05-4b07-9a06-7f7e8ead5cde None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:17.968405 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26304563-9c05-4b07-9a06-7f7e8ead5cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:17.987244 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-26304563-9c05-4b07-9a06-7f7e8ead5cde None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:41:17.988448 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-26304563-9c05-4b07-9a06-7f7e8ead5cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:41:17.996444 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 689/1384] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:41:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:41:18.040099 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b8fd7-6085-4b58-a946-10e543547972 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:18.056222 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b8fd7-6085-4b58-a946-10e543547972 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:18.062183 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf3785-3838-4e86-b643-fc828bf4a5b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f1809a35b244c1db7a185d82859369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:18.062967 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf3785-3838-4e86-b643-fc828bf4a5b0 service nova] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:18.063385 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf3785-3838-4e86-b643-fc828bf4a5b0 service nova] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:18.063762 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf3785-3838-4e86-b643-fc828bf4a5b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:18.073007 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf3785-3838-4e86-b643-fc828bf4a5b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:18.074770 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf3785-3838-4e86-b643-fc828bf4a5b0 service nova] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:18.085190 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 696/1385] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:41:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:41:20.209273 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285525e-d7a1-424d-9a35-d284a1aa9f11 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:20.209697 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285525e-d7a1-424d-9a35-d284a1aa9f11 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:20.209939 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285525e-d7a1-424d-9a35-d284a1aa9f11 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:20.211193 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 690/1386] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:41:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:41:20.217617 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ed702-5bc0-4205-8b77-899eac15bf0d None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:20.218321 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ed702-5bc0-4205-8b77-899eac15bf0d None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:20.218321 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ed702-5bc0-4205-8b77-899eac15bf0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:20.242661 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-f63ed702-5bc0-4205-8b77-899eac15bf0d None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:41:20.244433 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-f63ed702-5bc0-4205-8b77-899eac15bf0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:41:20.271218 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 697/1387] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:41:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:41:20.306475 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c285525e-d7a1-424d-9a35-d284a1aa9f11 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:20.323917 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c285525e-d7a1-424d-9a35-d284a1aa9f11 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:20.331766 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d9137e-31ce-4099-aa05-b3ac5840f93d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f1809a35b244c1db7a185d82859369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:20.332490 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d9137e-31ce-4099-aa05-b3ac5840f93d service nova] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:20.332838 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d9137e-31ce-4099-aa05-b3ac5840f93d service nova] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:20.333184 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d9137e-31ce-4099-aa05-b3ac5840f93d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:20.343036 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d9137e-31ce-4099-aa05-b3ac5840f93d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:20.344692 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d9137e-31ce-4099-aa05-b3ac5840f93d service nova] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:20.354744 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 691/1388] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:41:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:41:22.919543 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a0f9a-58b8-4794-96aa-bb262f07df64 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:22.920690 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a0f9a-58b8-4794-96aa-bb262f07df64 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:22.920690 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a0f9a-58b8-4794-96aa-bb262f07df64 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:22.922053 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 698/1389] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:41:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:41:22.932098 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14449ff9-49bf-4285-b47e-dd3adacb445d None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:22.932663 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14449ff9-49bf-4285-b47e-dd3adacb445d None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:22.933142 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14449ff9-49bf-4285-b47e-dd3adacb445d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:22.961035 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-14449ff9-49bf-4285-b47e-dd3adacb445d None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:41:22.962274 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-14449ff9-49bf-4285-b47e-dd3adacb445d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:41:22.971015 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 692/1390] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:41:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:41:23.017465 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56a0f9a-58b8-4794-96aa-bb262f07df64 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:23.033878 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56a0f9a-58b8-4794-96aa-bb262f07df64 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:23.039404 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b2353b-569e-4ca3-bb98-aa3b791b0cb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f1809a35b244c1db7a185d82859369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:23.040066 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2353b-569e-4ca3-bb98-aa3b791b0cb9 service nova] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:23.040330 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2353b-569e-4ca3-bb98-aa3b791b0cb9 service nova] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:23.040602 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2353b-569e-4ca3-bb98-aa3b791b0cb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:23.049387 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b2353b-569e-4ca3-bb98-aa3b791b0cb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:23.051015 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b2353b-569e-4ca3-bb98-aa3b791b0cb9 service nova] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:23.061668 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 699/1391] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:41:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:41:25.199725 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34923fd-794a-4d92-9d33-824bd12683f3 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:25.200290 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34923fd-794a-4d92-9d33-824bd12683f3 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:25.200290 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34923fd-794a-4d92-9d33-824bd12683f3 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:25.202243 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 693/1392] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:41:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:41:25.207573 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2e566-a9a8-4769-b329-ce7df490d852 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:25.208005 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2e566-a9a8-4769-b329-ce7df490d852 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:25.208124 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2e566-a9a8-4769-b329-ce7df490d852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:25.226575 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-55b2e566-a9a8-4769-b329-ce7df490d852 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:41:25.227786 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-55b2e566-a9a8-4769-b329-ce7df490d852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:41:25.235741 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 700/1393] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:41:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:41:25.284673 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34923fd-794a-4d92-9d33-824bd12683f3 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:25.303231 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34923fd-794a-4d92-9d33-824bd12683f3 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:25.308776 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0587d6dc-5951-4e65-a4ea-01bf36ce7894 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f1809a35b244c1db7a185d82859369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:25.309433 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0587d6dc-5951-4e65-a4ea-01bf36ce7894 service nova] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:25.309720 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0587d6dc-5951-4e65-a4ea-01bf36ce7894 service nova] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:25.310119 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0587d6dc-5951-4e65-a4ea-01bf36ce7894 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:25.319619 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0587d6dc-5951-4e65-a4ea-01bf36ce7894 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:25.321225 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0587d6dc-5951-4e65-a4ea-01bf36ce7894 service nova] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:25.335255 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 694/1394] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:41:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 08:41:27.413020 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db102165-7b57-4e18-83a9-7eb6b60daf80 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:27.413600 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db102165-7b57-4e18-83a9-7eb6b60daf80 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:27.413835 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db102165-7b57-4e18-83a9-7eb6b60daf80 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:27.415880 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 701/1395] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:41:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:41:27.424945 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691918f4-0d49-483a-afd9-1e7cc00d9476 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:27.424945 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691918f4-0d49-483a-afd9-1e7cc00d9476 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:27.427194 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691918f4-0d49-483a-afd9-1e7cc00d9476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:27.434238 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=52 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:27.447964 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-691918f4-0d49-483a-afd9-1e7cc00d9476 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:41:27.449221 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-691918f4-0d49-483a-afd9-1e7cc00d9476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:41:27.460067 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 695/1396] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:41:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:41:27.510644 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db102165-7b57-4e18-83a9-7eb6b60daf80 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:27.531046 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db102165-7b57-4e18-83a9-7eb6b60daf80 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:27.537510 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f4a54-6018-427b-b460-4ad9ea903daf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f1809a35b244c1db7a185d82859369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:27.538197 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f4a54-6018-427b-b460-4ad9ea903daf service nova] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:27.538484 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f4a54-6018-427b-b460-4ad9ea903daf service nova] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:27.538763 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f4a54-6018-427b-b460-4ad9ea903daf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:27.547985 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f4a54-6018-427b-b460-4ad9ea903daf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:27.549590 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f4a54-6018-427b-b460-4ad9ea903daf service nova] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:27.560105 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 702/1397] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:41:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 08:41:28.147606 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ae2db-77b4-4597-89f8-c77e58e31e3a None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:28.147903 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ae2db-77b4-4597-89f8-c77e58e31e3a None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:28.148186 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ae2db-77b4-4597-89f8-c77e58e31e3a None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:28.149593 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 696/1398] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:41:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:41:28.155521 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67221513-447c-484c-a08c-10b6ee92c028 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:28.155909 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67221513-447c-484c-a08c-10b6ee92c028 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:28.156282 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67221513-447c-484c-a08c-10b6ee92c028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:28.175350 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-67221513-447c-484c-a08c-10b6ee92c028 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:41:28.176544 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-67221513-447c-484c-a08c-10b6ee92c028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:41:28.184335 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 703/1399] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:41:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:41:28.244336 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a538997-f936-4b32-aeac-c442cb8ff59b None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:28.244703 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a538997-f936-4b32-aeac-c442cb8ff59b None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:28.245067 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a538997-f936-4b32-aeac-c442cb8ff59b None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:28.246771 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 697/1400] 10.222.0.42 () {54 vars in 962 bytes} [Wed Jun 22 08:41:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:41:28.253169 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e846f9d-872b-4d5a-bb95-44de1a5fc963 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:28.253677 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e846f9d-872b-4d5a-bb95-44de1a5fc963 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:28.254120 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e846f9d-872b-4d5a-bb95-44de1a5fc963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:28.310001 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-0e846f9d-872b-4d5a-bb95-44de1a5fc963 None None] MFA Rules not processed for user `589eb8cc97714580840ac7a48ea38ee8`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:41:28.311807 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-0e846f9d-872b-4d5a-bb95-44de1a5fc963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:41:28.351945 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:28.387583 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 704/1401] 10.222.0.42 () {58 vars in 1059 bytes} [Wed Jun 22 08:41:28 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:41:28.396297 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a538997-f936-4b32-aeac-c442cb8ff59b None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:28.407891 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a538997-f936-4b32-aeac-c442cb8ff59b None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:28.411719 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dadab5-2079-4a38-b5ae-1bb04bd6caea service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589eb8cc97714580840ac7a48ea38ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:28.413055 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dadab5-2079-4a38-b5ae-1bb04bd6caea service glance] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:28.413055 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dadab5-2079-4a38-b5ae-1bb04bd6caea service glance] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:28.413326 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dadab5-2079-4a38-b5ae-1bb04bd6caea service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:28.423966 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dadab5-2079-4a38-b5ae-1bb04bd6caea service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:28.425702 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dadab5-2079-4a38-b5ae-1bb04bd6caea service glance] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:28.437547 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 698/1402] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:41:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:41:29.218338 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831859f9-20ba-4080-8635-91faa7fa8b67 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:29.218853 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831859f9-20ba-4080-8635-91faa7fa8b67 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:29.219177 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831859f9-20ba-4080-8635-91faa7fa8b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:29.284536 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-831859f9-20ba-4080-8635-91faa7fa8b67 None None] MFA Rules not processed for user `2bf91272d78b4e8f854c760622465af9`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:41:29.285923 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-831859f9-20ba-4080-8635-91faa7fa8b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:41:29.364831 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 705/1403] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Jun 22 08:41:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 08:41:29.413277 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca7a05-c5ca-4181-a1fd-eb0e125dd96a None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:29.413594 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca7a05-c5ca-4181-a1fd-eb0e125dd96a None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:29.413912 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca7a05-c5ca-4181-a1fd-eb0e125dd96a None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:29.415574 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 699/1404] 10.222.0.42 () {54 vars in 942 bytes} [Wed Jun 22 08:41:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:41:29.422442 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e79549-f641-42c2-b5be-70cfba2f22c1 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:29.422738 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e79549-f641-42c2-b5be-70cfba2f22c1 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:29.423016 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e79549-f641-42c2-b5be-70cfba2f22c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:29.478035 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-77e79549-f641-42c2-b5be-70cfba2f22c1 None None] MFA Rules not processed for user `4403cea84ff646b88cdb785975b20346`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:41:29.479201 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-77e79549-f641-42c2-b5be-70cfba2f22c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:41:29.562973 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 706/1405] 10.222.0.42 () {58 vars in 1039 bytes} [Wed Jun 22 08:41:29 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:41:29.573017 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca7a05-c5ca-4181-a1fd-eb0e125dd96a None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:29.587993 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca7a05-c5ca-4181-a1fd-eb0e125dd96a None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:29.593623 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2297c494-4b44-492e-baa8-4d5a787373dd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4403cea84ff646b88cdb785975b20346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:29.594298 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297c494-4b44-492e-baa8-4d5a787373dd service swift] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:29.594589 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297c494-4b44-492e-baa8-4d5a787373dd service swift] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:29.594873 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297c494-4b44-492e-baa8-4d5a787373dd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:29.603811 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2297c494-4b44-492e-baa8-4d5a787373dd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:29.605506 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2297c494-4b44-492e-baa8-4d5a787373dd service swift] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:29.615307 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 700/1406] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Jun 22 08:41:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 08:41:29.703314 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbaeb6a-eb56-4e3c-9e5e-5d6ed9a3fd92 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:29.703605 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbaeb6a-eb56-4e3c-9e5e-5d6ed9a3fd92 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:29.703884 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbaeb6a-eb56-4e3c-9e5e-5d6ed9a3fd92 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:29.705340 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 707/1407] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:41:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:41:29.711643 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccaaffa-72fb-4623-9cfe-ae28462874c5 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:29.712159 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccaaffa-72fb-4623-9cfe-ae28462874c5 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:29.712987 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccaaffa-72fb-4623-9cfe-ae28462874c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:29.743186 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-cccaaffa-72fb-4623-9cfe-ae28462874c5 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:41:29.745964 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-cccaaffa-72fb-4623-9cfe-ae28462874c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:41:29.758649 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 701/1408] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:41:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:41:29.819613 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbaeb6a-eb56-4e3c-9e5e-5d6ed9a3fd92 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:29.835650 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbaeb6a-eb56-4e3c-9e5e-5d6ed9a3fd92 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:29.842488 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b91603-1b3c-4b41-a351-ea2d2e690fa2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f1809a35b244c1db7a185d82859369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:29.845625 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b91603-1b3c-4b41-a351-ea2d2e690fa2 service nova] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:29.845625 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b91603-1b3c-4b41-a351-ea2d2e690fa2 service nova] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:29.845625 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b91603-1b3c-4b41-a351-ea2d2e690fa2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:29.855635 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b91603-1b3c-4b41-a351-ea2d2e690fa2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:29.858067 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b91603-1b3c-4b41-a351-ea2d2e690fa2 service nova] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:29.864862 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:29.872124 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 708/1409] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:41:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:41:39.734716 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=17 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:52.637086 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637ef66-fe40-4717-bd65-76c75eb0f6d2 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:52.637764 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637ef66-fe40-4717-bd65-76c75eb0f6d2 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:52.637764 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637ef66-fe40-4717-bd65-76c75eb0f6d2 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:52.639628 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 702/1410] 10.222.0.42 () {54 vars in 918 bytes} [Wed Jun 22 08:41:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:41:52.644976 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c4227-d750-44d3-8103-d6d700d2b97e None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:52.645422 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c4227-d750-44d3-8103-d6d700d2b97e None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:52.645535 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c4227-d750-44d3-8103-d6d700d2b97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:52.664152 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-c75c4227-d750-44d3-8103-d6d700d2b97e None None] MFA Rules not processed for user `ec2627e3cdc94ec38d7cc3b1bc670ef1`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:41:52.665376 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-c75c4227-d750-44d3-8103-d6d700d2b97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:41:52.673934 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 709/1411] 10.222.0.42 () {58 vars in 1015 bytes} [Wed Jun 22 08:41:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:41:52.688506 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3ca66-69da-4256-a748-a67def82ef92 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:52.688831 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3ca66-69da-4256-a748-a67def82ef92 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:52.689093 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3ca66-69da-4256-a748-a67def82ef92 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:52.691437 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 703/1412] 10.222.0.42 () {54 vars in 918 bytes} [Wed Jun 22 08:41:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:41:52.695471 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c484cb-da8e-4d19-8c87-cbd7e325de27 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:52.695802 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c484cb-da8e-4d19-8c87-cbd7e325de27 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:52.696120 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c484cb-da8e-4d19-8c87-cbd7e325de27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:52.716264 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-95c484cb-da8e-4d19-8c87-cbd7e325de27 None None] MFA Rules not processed for user `4f1809a35b244c1db7a185d82859369e`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:41:52.718120 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-95c484cb-da8e-4d19-8c87-cbd7e325de27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:41:52.727272 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 710/1413] 10.222.0.42 () {58 vars in 1015 bytes} [Wed Jun 22 08:41:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:41:55.308791 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bcf8d3-23e9-4ac9-9222-9de33b41b32f None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:55.309373 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bcf8d3-23e9-4ac9-9222-9de33b41b32f None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:55.309373 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bcf8d3-23e9-4ac9-9222-9de33b41b32f None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:55.310794 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 704/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 08:41:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:41:55.316953 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe7d1ad-e631-479b-b100-7db9674df844 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:55.317429 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe7d1ad-e631-479b-b100-7db9674df844 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:55.317813 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe7d1ad-e631-479b-b100-7db9674df844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:55.339494 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-9fe7d1ad-e631-479b-b100-7db9674df844 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:41:55.340710 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-9fe7d1ad-e631-479b-b100-7db9674df844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:41:55.349128 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 711/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 08:41:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:41:55.394300 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bcf8d3-23e9-4ac9-9222-9de33b41b32f None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:55.410394 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bcf8d3-23e9-4ac9-9222-9de33b41b32f None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:55.416828 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75141463-7b77-483b-82a9-070a7acec534 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f1809a35b244c1db7a185d82859369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:55.417477 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75141463-7b77-483b-82a9-070a7acec534 service nova] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:55.417761 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75141463-7b77-483b-82a9-070a7acec534 service nova] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:55.418040 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75141463-7b77-483b-82a9-070a7acec534 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:55.428145 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75141463-7b77-483b-82a9-070a7acec534 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:55.429768 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75141463-7b77-483b-82a9-070a7acec534 service nova] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:55.440077 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 705/1416] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:41:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:41:56.359069 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1ed65-1d77-499e-a578-05bc0120bb1a None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:56.359617 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1ed65-1d77-499e-a578-05bc0120bb1a None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:56.359710 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1ed65-1d77-499e-a578-05bc0120bb1a None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:56.361034 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 712/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 08:41:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:41:56.369878 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e37505-edc7-4fff-a045-9125f8dc2bd6 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:56.370417 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e37505-edc7-4fff-a045-9125f8dc2bd6 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:56.370513 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e37505-edc7-4fff-a045-9125f8dc2bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:56.391016 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-c3e37505-edc7-4fff-a045-9125f8dc2bd6 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:41:56.392229 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-c3e37505-edc7-4fff-a045-9125f8dc2bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:41:56.400154 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 706/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 08:41:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:41:56.552798 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1ed65-1d77-499e-a578-05bc0120bb1a None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:56.568859 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1ed65-1d77-499e-a578-05bc0120bb1a None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:56.574244 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad30d93-b6de-479f-8d96-8f21be94b4af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f1809a35b244c1db7a185d82859369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:56.574889 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad30d93-b6de-479f-8d96-8f21be94b4af service nova] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:56.575171 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad30d93-b6de-479f-8d96-8f21be94b4af service nova] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:56.575445 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad30d93-b6de-479f-8d96-8f21be94b4af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:56.584234 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad30d93-b6de-479f-8d96-8f21be94b4af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:56.585839 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad30d93-b6de-479f-8d96-8f21be94b4af service nova] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:56.596027 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 713/1419] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:41:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:41:57.491454 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa531129-2f4d-41a7-9b71-63f229f8846f None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:57.492024 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa531129-2f4d-41a7-9b71-63f229f8846f None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:57.492024 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa531129-2f4d-41a7-9b71-63f229f8846f None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:57.493401 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 707/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 08:41:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:41:57.499138 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855beab-e017-48e0-ae05-3a86ebe20c27 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:57.499711 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855beab-e017-48e0-ae05-3a86ebe20c27 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:57.499711 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855beab-e017-48e0-ae05-3a86ebe20c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:57.519943 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-c855beab-e017-48e0-ae05-3a86ebe20c27 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:41:57.521081 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-c855beab-e017-48e0-ae05-3a86ebe20c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:41:57.533873 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 714/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 08:41:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:41:57.681881 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa531129-2f4d-41a7-9b71-63f229f8846f None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:57.696666 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa531129-2f4d-41a7-9b71-63f229f8846f None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:57.702752 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b3f99-2b07-4b9c-929e-032859543d53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f1809a35b244c1db7a185d82859369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:57.703395 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b3f99-2b07-4b9c-929e-032859543d53 service nova] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:57.703679 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b3f99-2b07-4b9c-929e-032859543d53 service nova] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:57.703957 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b3f99-2b07-4b9c-929e-032859543d53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:57.712370 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425b3f99-2b07-4b9c-929e-032859543d53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:57.713944 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425b3f99-2b07-4b9c-929e-032859543d53 service nova] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:57.723322 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 708/1422] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:41:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:41:58.598209 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db60f682-69be-4f08-8534-5422646b70af None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:58.598746 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db60f682-69be-4f08-8534-5422646b70af None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:58.598746 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db60f682-69be-4f08-8534-5422646b70af None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:58.600103 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 715/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 08:41:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:41:58.605058 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ec8bc-5486-4bd6-bb87-2cd0ee9a7c17 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:58.605520 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ec8bc-5486-4bd6-bb87-2cd0ee9a7c17 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:58.605626 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ec8bc-5486-4bd6-bb87-2cd0ee9a7c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:58.624335 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-261ec8bc-5486-4bd6-bb87-2cd0ee9a7c17 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:41:58.625563 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-261ec8bc-5486-4bd6-bb87-2cd0ee9a7c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:41:58.633295 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 709/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 08:41:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:41:58.782929 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db60f682-69be-4f08-8534-5422646b70af None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:58.797662 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db60f682-69be-4f08-8534-5422646b70af None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:58.803269 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead4342-bd04-48c9-a61c-e0f1c2303ce7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f1809a35b244c1db7a185d82859369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:58.803911 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead4342-bd04-48c9-a61c-e0f1c2303ce7 service nova] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:58.804191 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead4342-bd04-48c9-a61c-e0f1c2303ce7 service nova] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:58.804464 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead4342-bd04-48c9-a61c-e0f1c2303ce7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:58.813852 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fead4342-bd04-48c9-a61c-e0f1c2303ce7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:58.815753 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fead4342-bd04-48c9-a61c-e0f1c2303ce7 service nova] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:58.826133 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 716/1425] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:41:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:41:59.698844 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d2443-1589-490b-87dd-e63ab2c0b4dc None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:59.699435 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d2443-1589-490b-87dd-e63ab2c0b4dc None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:59.699435 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d2443-1589-490b-87dd-e63ab2c0b4dc None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:59.700821 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 710/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 08:41:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:41:59.705793 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca3976-d4c6-4bf9-ac73-e41447402673 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:59.706265 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca3976-d4c6-4bf9-ac73-e41447402673 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:59.706367 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca3976-d4c6-4bf9-ac73-e41447402673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:59.724999 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-16ca3976-d4c6-4bf9-ac73-e41447402673 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:41:59.726226 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-16ca3976-d4c6-4bf9-ac73-e41447402673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:41:59.734586 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 717/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 08:41:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:41:59.884596 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d2443-1589-490b-87dd-e63ab2c0b4dc None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:59.899827 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d2443-1589-490b-87dd-e63ab2c0b4dc None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:59.905144 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b645360-fb1e-4d81-9a52-7d0430349639 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f1809a35b244c1db7a185d82859369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:59.905777 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b645360-fb1e-4d81-9a52-7d0430349639 service nova] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:59.906068 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b645360-fb1e-4d81-9a52-7d0430349639 service nova] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:59.906374 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b645360-fb1e-4d81-9a52-7d0430349639 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:59.914759 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b645360-fb1e-4d81-9a52-7d0430349639 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:59.916339 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b645360-fb1e-4d81-9a52-7d0430349639 service nova] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:59.925905 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 711/1428] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:41:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:42:00.735141 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cdcf2b-473a-4049-91e6-559fbc0f2929 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:00.735719 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cdcf2b-473a-4049-91e6-559fbc0f2929 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:00.735719 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cdcf2b-473a-4049-91e6-559fbc0f2929 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:00.737052 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 718/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 08:42:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:00.742153 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1ebe7-130f-4bb2-b63f-5fbf1bff3dc8 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:00.742553 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1ebe7-130f-4bb2-b63f-5fbf1bff3dc8 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:00.742721 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1ebe7-130f-4bb2-b63f-5fbf1bff3dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:00.760925 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-dfb1ebe7-130f-4bb2-b63f-5fbf1bff3dc8 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:00.762422 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-dfb1ebe7-130f-4bb2-b63f-5fbf1bff3dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:00.770844 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 712/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 08:42:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:42:00.918928 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cdcf2b-473a-4049-91e6-559fbc0f2929 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:00.933894 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cdcf2b-473a-4049-91e6-559fbc0f2929 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:00.940082 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a543b2d-1ccf-411a-9d59-ee42dfb949b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f1809a35b244c1db7a185d82859369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:00.940728 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a543b2d-1ccf-411a-9d59-ee42dfb949b9 service nova] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:00.941012 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a543b2d-1ccf-411a-9d59-ee42dfb949b9 service nova] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:00.941288 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a543b2d-1ccf-411a-9d59-ee42dfb949b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:00.949603 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a543b2d-1ccf-411a-9d59-ee42dfb949b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:00.951749 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a543b2d-1ccf-411a-9d59-ee42dfb949b9 service nova] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:00.961348 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 719/1431] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:42:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:42:01.770962 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fcee3e-f184-49ed-968d-3a5b14be19b1 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:01.771535 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fcee3e-f184-49ed-968d-3a5b14be19b1 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:01.771535 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fcee3e-f184-49ed-968d-3a5b14be19b1 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:01.772896 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 713/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 08:42:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:01.777875 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d9f22-a040-4e31-9b05-90595f750b70 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:01.778334 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d9f22-a040-4e31-9b05-90595f750b70 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:01.778514 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d9f22-a040-4e31-9b05-90595f750b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:01.796557 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-af0d9f22-a040-4e31-9b05-90595f750b70 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:01.797734 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-af0d9f22-a040-4e31-9b05-90595f750b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:01.805342 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 720/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 08:42:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:42:01.954492 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fcee3e-f184-49ed-968d-3a5b14be19b1 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:01.972302 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fcee3e-f184-49ed-968d-3a5b14be19b1 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:01.977915 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d96872-50ea-4c12-8bfc-11103f743f31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f1809a35b244c1db7a185d82859369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:01.978595 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d96872-50ea-4c12-8bfc-11103f743f31 service nova] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:01.978882 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d96872-50ea-4c12-8bfc-11103f743f31 service nova] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:01.979163 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d96872-50ea-4c12-8bfc-11103f743f31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:01.987728 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d96872-50ea-4c12-8bfc-11103f743f31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:01.989300 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d96872-50ea-4c12-8bfc-11103f743f31 service nova] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:01.999021 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 714/1434] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:42:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:42:02.805903 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d1d91-7263-45cc-bc25-eb998aa72ae5 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:02.806519 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d1d91-7263-45cc-bc25-eb998aa72ae5 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:02.806519 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d1d91-7263-45cc-bc25-eb998aa72ae5 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:02.807854 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 721/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 08:42:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:02.813857 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17ecf0-61bb-4cff-aaf0-fc4876ac3a86 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:02.814348 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17ecf0-61bb-4cff-aaf0-fc4876ac3a86 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:02.814451 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17ecf0-61bb-4cff-aaf0-fc4876ac3a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:02.833266 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-5f17ecf0-61bb-4cff-aaf0-fc4876ac3a86 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:02.834518 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-5f17ecf0-61bb-4cff-aaf0-fc4876ac3a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:02.843074 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 715/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 08:42:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:42:02.992615 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1d1d91-7263-45cc-bc25-eb998aa72ae5 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:03.007969 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1d1d91-7263-45cc-bc25-eb998aa72ae5 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:03.014282 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610a81d-ec7d-439b-85ce-839340be0bb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f1809a35b244c1db7a185d82859369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:03.014928 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610a81d-ec7d-439b-85ce-839340be0bb5 service nova] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:03.015211 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610a81d-ec7d-439b-85ce-839340be0bb5 service nova] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:03.015488 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610a81d-ec7d-439b-85ce-839340be0bb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:03.024153 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e610a81d-ec7d-439b-85ce-839340be0bb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:03.025757 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e610a81d-ec7d-439b-85ce-839340be0bb5 service nova] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:03.035559 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 722/1437] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:42:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:42:03.865466 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a21a83-3cd0-4163-8039-7dc13f7a5eb9 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:03.866023 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a21a83-3cd0-4163-8039-7dc13f7a5eb9 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:03.866023 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a21a83-3cd0-4163-8039-7dc13f7a5eb9 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:03.867327 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 716/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 08:42:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:03.872161 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf422eea-0a0e-4259-98f0-e084ce8c8f93 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:03.872601 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf422eea-0a0e-4259-98f0-e084ce8c8f93 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:03.872713 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf422eea-0a0e-4259-98f0-e084ce8c8f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:03.891230 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-cf422eea-0a0e-4259-98f0-e084ce8c8f93 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:03.892415 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-cf422eea-0a0e-4259-98f0-e084ce8c8f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:03.900610 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 723/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 08:42:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:42:04.054332 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a21a83-3cd0-4163-8039-7dc13f7a5eb9 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:04.070466 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a21a83-3cd0-4163-8039-7dc13f7a5eb9 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:04.076104 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08516e25-6a6b-4515-9dde-66b1445638cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f1809a35b244c1db7a185d82859369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:04.076769 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08516e25-6a6b-4515-9dde-66b1445638cd service nova] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:04.077052 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08516e25-6a6b-4515-9dde-66b1445638cd service nova] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:04.077332 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08516e25-6a6b-4515-9dde-66b1445638cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:04.086326 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08516e25-6a6b-4515-9dde-66b1445638cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:04.087918 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08516e25-6a6b-4515-9dde-66b1445638cd service nova] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:04.098753 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 717/1440] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:42:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:42:06.084373 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5082bc9e-006c-4d13-afcb-3c6fc28dbb68 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:06.084934 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5082bc9e-006c-4d13-afcb-3c6fc28dbb68 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:06.084934 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5082bc9e-006c-4d13-afcb-3c6fc28dbb68 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:06.086386 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 724/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 08:42:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:06.091705 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeec893-9f1d-4afc-8f48-21015eb3dec1 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:06.092185 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeec893-9f1d-4afc-8f48-21015eb3dec1 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:06.092309 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeec893-9f1d-4afc-8f48-21015eb3dec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:06.110887 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-7aeec893-9f1d-4afc-8f48-21015eb3dec1 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:06.112013 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-7aeec893-9f1d-4afc-8f48-21015eb3dec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:06.119772 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 718/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 08:42:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:42:06.158417 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5082bc9e-006c-4d13-afcb-3c6fc28dbb68 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:06.169155 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5082bc9e-006c-4d13-afcb-3c6fc28dbb68 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:06.173167 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec663c39-b02a-4d66-8d05-c24ec60ed8cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:06.173798 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec663c39-b02a-4d66-8d05-c24ec60ed8cc service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:06.174108 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec663c39-b02a-4d66-8d05-c24ec60ed8cc service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:06.174388 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec663c39-b02a-4d66-8d05-c24ec60ed8cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:06.183307 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec663c39-b02a-4d66-8d05-c24ec60ed8cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:06.184744 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec663c39-b02a-4d66-8d05-c24ec60ed8cc service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:06.194737 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 725/1443] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:42:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:42:08.466626 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16c355-724c-430b-ab2e-4b36467689de None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:08.467206 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16c355-724c-430b-ab2e-4b36467689de None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:08.467206 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16c355-724c-430b-ab2e-4b36467689de None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:08.468584 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 719/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 08:42:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:08.474204 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc125b8-1101-400c-b88d-9a873c825863 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:08.474678 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc125b8-1101-400c-b88d-9a873c825863 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:08.474775 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc125b8-1101-400c-b88d-9a873c825863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:08.493903 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-0dc125b8-1101-400c-b88d-9a873c825863 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:08.495156 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-0dc125b8-1101-400c-b88d-9a873c825863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:08.504034 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 726/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 08:42:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:42:08.543574 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c16c355-724c-430b-ab2e-4b36467689de None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:08.554625 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c16c355-724c-430b-ab2e-4b36467689de None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:08.558261 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea323654-36fe-42c6-b54e-0809d8c6090e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:08.558896 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea323654-36fe-42c6-b54e-0809d8c6090e service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:08.559184 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea323654-36fe-42c6-b54e-0809d8c6090e service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:08.559467 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea323654-36fe-42c6-b54e-0809d8c6090e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:08.569141 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea323654-36fe-42c6-b54e-0809d8c6090e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:08.570685 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea323654-36fe-42c6-b54e-0809d8c6090e service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:08.580859 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 720/1446] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:42:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:42:11.083737 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d859e04-48b5-4442-a499-8cf2952c322e None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:11.084321 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d859e04-48b5-4442-a499-8cf2952c322e None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:11.084321 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d859e04-48b5-4442-a499-8cf2952c322e None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:11.085894 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 727/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 08:42:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:11.092550 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653de093-58f9-4236-b686-f5682b149ba1 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:11.093306 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653de093-58f9-4236-b686-f5682b149ba1 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:11.093306 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653de093-58f9-4236-b686-f5682b149ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:11.112482 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-653de093-58f9-4236-b686-f5682b149ba1 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:11.113811 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-653de093-58f9-4236-b686-f5682b149ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:11.122283 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 721/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 08:42:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 08:42:11.166257 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d859e04-48b5-4442-a499-8cf2952c322e None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:11.177584 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d859e04-48b5-4442-a499-8cf2952c322e None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:11.181070 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987ec635-ae6a-4171-bfbc-b4843b86e202 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:11.181694 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ec635-ae6a-4171-bfbc-b4843b86e202 service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:11.181979 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ec635-ae6a-4171-bfbc-b4843b86e202 service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:11.182292 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ec635-ae6a-4171-bfbc-b4843b86e202 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:11.191166 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987ec635-ae6a-4171-bfbc-b4843b86e202 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:11.192605 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987ec635-ae6a-4171-bfbc-b4843b86e202 service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:11.202022 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 728/1449] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:42:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:42:13.379646 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f526d1-6db8-4b09-bb4d-036de7668c60 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:13.380242 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f526d1-6db8-4b09-bb4d-036de7668c60 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:13.380242 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f526d1-6db8-4b09-bb4d-036de7668c60 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:13.381664 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 722/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 08:42:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:13.386961 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e93fc-efec-40b1-a89c-b5dcbb2805a8 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:13.387633 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e93fc-efec-40b1-a89c-b5dcbb2805a8 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:13.387787 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e93fc-efec-40b1-a89c-b5dcbb2805a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:13.405980 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-994e93fc-efec-40b1-a89c-b5dcbb2805a8 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:13.407216 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-994e93fc-efec-40b1-a89c-b5dcbb2805a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:13.414949 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 729/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 08:42:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:42:13.454349 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f526d1-6db8-4b09-bb4d-036de7668c60 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:13.464994 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f526d1-6db8-4b09-bb4d-036de7668c60 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:13.468600 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7d6a82-1a01-41bc-83fe-a8a800059328 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:13.469229 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d6a82-1a01-41bc-83fe-a8a800059328 service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:13.469518 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d6a82-1a01-41bc-83fe-a8a800059328 service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:13.469796 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d6a82-1a01-41bc-83fe-a8a800059328 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:13.479209 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7d6a82-1a01-41bc-83fe-a8a800059328 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:13.480650 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7d6a82-1a01-41bc-83fe-a8a800059328 service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:13.490278 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 723/1452] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:42:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:42:15.595771 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1031002-f0a6-41c0-81eb-7e9f0474297c None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:15.596307 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1031002-f0a6-41c0-81eb-7e9f0474297c None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:15.596307 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1031002-f0a6-41c0-81eb-7e9f0474297c None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:15.597718 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 730/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 08:42:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:15.603216 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c4eea-b355-4a8b-809b-f1638581f737 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:15.603643 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c4eea-b355-4a8b-809b-f1638581f737 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:15.603790 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c4eea-b355-4a8b-809b-f1638581f737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:15.621818 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-657c4eea-b355-4a8b-809b-f1638581f737 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:15.623629 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-657c4eea-b355-4a8b-809b-f1638581f737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:15.631505 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 724/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 08:42:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:42:15.670356 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1031002-f0a6-41c0-81eb-7e9f0474297c None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:15.681115 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1031002-f0a6-41c0-81eb-7e9f0474297c None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:15.684681 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918ab123-7e0b-440b-9063-ec4d28e1d949 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:15.685826 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ab123-7e0b-440b-9063-ec4d28e1d949 service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:15.686137 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ab123-7e0b-440b-9063-ec4d28e1d949 service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:15.686427 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ab123-7e0b-440b-9063-ec4d28e1d949 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:15.695815 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918ab123-7e0b-440b-9063-ec4d28e1d949 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:15.697272 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918ab123-7e0b-440b-9063-ec4d28e1d949 service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:15.708887 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 731/1455] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:42:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:42:17.814600 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3461da4a-1416-4827-865a-6137dd261688 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:17.815183 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3461da4a-1416-4827-865a-6137dd261688 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:17.815183 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3461da4a-1416-4827-865a-6137dd261688 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:17.816598 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 725/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 08:42:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:17.822003 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb22039-b287-4883-8508-63dcb39bbbb6 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:17.822531 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb22039-b287-4883-8508-63dcb39bbbb6 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:17.822626 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb22039-b287-4883-8508-63dcb39bbbb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:17.841905 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-dfb22039-b287-4883-8508-63dcb39bbbb6 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:17.843133 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-dfb22039-b287-4883-8508-63dcb39bbbb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:17.851037 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 732/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 08:42:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:42:17.889812 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3461da4a-1416-4827-865a-6137dd261688 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:17.900923 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3461da4a-1416-4827-865a-6137dd261688 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:17.904559 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fadf75-5f59-46c5-a338-4fd35c454877 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:17.905207 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fadf75-5f59-46c5-a338-4fd35c454877 service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:17.905493 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fadf75-5f59-46c5-a338-4fd35c454877 service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:17.905775 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fadf75-5f59-46c5-a338-4fd35c454877 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:17.915445 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fadf75-5f59-46c5-a338-4fd35c454877 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:17.916892 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fadf75-5f59-46c5-a338-4fd35c454877 service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:17.927802 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 726/1458] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:42:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:42:20.034968 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46e5db-835f-49fe-9e49-491fdb99f7ab None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:20.035544 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46e5db-835f-49fe-9e49-491fdb99f7ab None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:20.035544 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46e5db-835f-49fe-9e49-491fdb99f7ab None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:20.036873 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 733/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 08:42:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:42:20.042356 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331cf21-578c-400e-b8eb-a5bb7417ec9c None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:20.042834 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331cf21-578c-400e-b8eb-a5bb7417ec9c None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:20.042927 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331cf21-578c-400e-b8eb-a5bb7417ec9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:20.050513 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=70 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:20.063450 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-4331cf21-578c-400e-b8eb-a5bb7417ec9c None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:20.064642 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-4331cf21-578c-400e-b8eb-a5bb7417ec9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:20.072879 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 727/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 08:42:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:42:20.118679 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f46e5db-835f-49fe-9e49-491fdb99f7ab None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:20.124668 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=73 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:20.131342 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f46e5db-835f-49fe-9e49-491fdb99f7ab None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:20.135042 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0379aaf9-241e-416e-ac54-c412a5a2e4a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:20.135694 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0379aaf9-241e-416e-ac54-c412a5a2e4a0 service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:20.135980 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0379aaf9-241e-416e-ac54-c412a5a2e4a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:20.136262 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0379aaf9-241e-416e-ac54-c412a5a2e4a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:20.147442 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0379aaf9-241e-416e-ac54-c412a5a2e4a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:20.148988 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0379aaf9-241e-416e-ac54-c412a5a2e4a0 service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:20.160856 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 734/1461] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:42:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:42:22.282098 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba2fcc9-45b9-41f8-a9c7-cc6bb188393e None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:22.282686 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba2fcc9-45b9-41f8-a9c7-cc6bb188393e None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:22.282863 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba2fcc9-45b9-41f8-a9c7-cc6bb188393e None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:22.284476 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 728/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 08:42:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:22.289833 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ba0c3-eeaa-438e-8a31-3400abf4f7c9 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:22.290393 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ba0c3-eeaa-438e-8a31-3400abf4f7c9 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:22.290483 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ba0c3-eeaa-438e-8a31-3400abf4f7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:22.308740 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-ef5ba0c3-eeaa-438e-8a31-3400abf4f7c9 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:22.309963 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-ef5ba0c3-eeaa-438e-8a31-3400abf4f7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:22.318442 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 735/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 08:42:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:42:22.357003 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba2fcc9-45b9-41f8-a9c7-cc6bb188393e None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:22.369031 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba2fcc9-45b9-41f8-a9c7-cc6bb188393e None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:22.372413 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a0c78-1dbf-48b4-a54e-38efaf4951c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:22.373614 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a0c78-1dbf-48b4-a54e-38efaf4951c2 service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:22.373894 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a0c78-1dbf-48b4-a54e-38efaf4951c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:22.374228 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a0c78-1dbf-48b4-a54e-38efaf4951c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:22.384144 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30a0c78-1dbf-48b4-a54e-38efaf4951c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:22.385846 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30a0c78-1dbf-48b4-a54e-38efaf4951c2 service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:22.397716 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 729/1464] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:42:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 08:42:24.526122 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ea7c5-06a0-4840-90cc-4efa1c9f8e63 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:24.526666 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ea7c5-06a0-4840-90cc-4efa1c9f8e63 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:24.526666 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ea7c5-06a0-4840-90cc-4efa1c9f8e63 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:24.527946 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 736/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 08:42:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:24.533561 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fccdc88-827f-44ac-b7ba-084f7ccc8ba4 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:24.534098 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fccdc88-827f-44ac-b7ba-084f7ccc8ba4 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:24.534210 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fccdc88-827f-44ac-b7ba-084f7ccc8ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:24.552001 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-7fccdc88-827f-44ac-b7ba-084f7ccc8ba4 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:24.553196 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-7fccdc88-827f-44ac-b7ba-084f7ccc8ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:24.561667 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 730/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 08:42:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:42:24.598416 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ea7c5-06a0-4840-90cc-4efa1c9f8e63 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:24.609828 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ea7c5-06a0-4840-90cc-4efa1c9f8e63 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:24.613361 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20b1603-a9a6-4de1-a65d-7941d89b845f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:24.613991 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b1603-a9a6-4de1-a65d-7941d89b845f service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:24.614315 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b1603-a9a6-4de1-a65d-7941d89b845f service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:24.614593 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b1603-a9a6-4de1-a65d-7941d89b845f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:24.624155 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20b1603-a9a6-4de1-a65d-7941d89b845f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:24.625617 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20b1603-a9a6-4de1-a65d-7941d89b845f service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:24.635184 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 737/1467] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:42:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:42:26.741391 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe7cfd-c5da-4762-897a-0e8e67ba5ab3 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:26.741991 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe7cfd-c5da-4762-897a-0e8e67ba5ab3 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:26.741991 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe7cfd-c5da-4762-897a-0e8e67ba5ab3 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:26.743436 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 731/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 08:42:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:42:26.750487 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbae980-0a5a-4228-b57c-f2a911636c58 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:26.751093 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbae980-0a5a-4228-b57c-f2a911636c58 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:26.751093 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbae980-0a5a-4228-b57c-f2a911636c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:26.771297 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-8dbae980-0a5a-4228-b57c-f2a911636c58 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:26.772586 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-8dbae980-0a5a-4228-b57c-f2a911636c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:26.781963 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 738/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 08:42:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:42:26.820041 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fe7cfd-c5da-4762-897a-0e8e67ba5ab3 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:26.831433 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fe7cfd-c5da-4762-897a-0e8e67ba5ab3 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:26.835278 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdcbea9-3eb5-4e73-997f-3f04055e9a91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:26.835941 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdcbea9-3eb5-4e73-997f-3f04055e9a91 service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:26.836243 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdcbea9-3eb5-4e73-997f-3f04055e9a91 service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:26.836505 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdcbea9-3eb5-4e73-997f-3f04055e9a91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:26.847184 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdcbea9-3eb5-4e73-997f-3f04055e9a91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:26.848632 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdcbea9-3eb5-4e73-997f-3f04055e9a91 service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:26.860037 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 732/1470] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:42:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:42:36.765282 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=17 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:36.854472 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=17 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:47.984926 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8e962-7de1-4aaf-90c7-ecdfb350fb27 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:47.985614 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8e962-7de1-4aaf-90c7-ecdfb350fb27 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:47.985614 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8e962-7de1-4aaf-90c7-ecdfb350fb27 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:47.986936 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 739/1471] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:42:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:47.992665 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0aa37-0432-48be-b59e-fa941b4d30f4 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:47.993126 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0aa37-0432-48be-b59e-fa941b4d30f4 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:47.993234 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0aa37-0432-48be-b59e-fa941b4d30f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:48.011540 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-41c0aa37-0432-48be-b59e-fa941b4d30f4 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:48.012760 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-41c0aa37-0432-48be-b59e-fa941b4d30f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:48.021975 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 733/1472] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:42:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:42:48.071428 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b9e8f-5817-4b37-829f-b3bff0d21c01 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:48.071718 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b9e8f-5817-4b37-829f-b3bff0d21c01 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:48.072000 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b9e8f-5817-4b37-829f-b3bff0d21c01 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:48.073389 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 740/1473] 10.222.0.42 () {54 vars in 962 bytes} [Wed Jun 22 08:42:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:48.079221 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae85c4-8f68-439e-8ae8-e8378676b9ff None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:48.079513 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae85c4-8f68-439e-8ae8-e8378676b9ff None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:48.079797 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae85c4-8f68-439e-8ae8-e8378676b9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:48.099012 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-edae85c4-8f68-439e-8ae8-e8378676b9ff None None] MFA Rules not processed for user `589eb8cc97714580840ac7a48ea38ee8`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:48.100247 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-edae85c4-8f68-439e-8ae8-e8378676b9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:48.108563 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 734/1474] 10.222.0.42 () {58 vars in 1059 bytes} [Wed Jun 22 08:42:48 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:42:48.116200 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b9e8f-5817-4b37-829f-b3bff0d21c01 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:48.127452 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b9e8f-5817-4b37-829f-b3bff0d21c01 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:48.131270 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f4d8fd-2c84-400c-b798-d7ee41b51198 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589eb8cc97714580840ac7a48ea38ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:48.131912 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f4d8fd-2c84-400c-b798-d7ee41b51198 service glance] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:48.132199 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f4d8fd-2c84-400c-b798-d7ee41b51198 service glance] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:48.132479 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f4d8fd-2c84-400c-b798-d7ee41b51198 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:48.143361 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f4d8fd-2c84-400c-b798-d7ee41b51198 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:48.145181 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f4d8fd-2c84-400c-b798-d7ee41b51198 service glance] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:48.156440 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 741/1475] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:42:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:42:50.348543 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d23a32-e17d-443e-9f81-a256bc4f626d None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:50.349104 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d23a32-e17d-443e-9f81-a256bc4f626d None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:50.349203 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d23a32-e17d-443e-9f81-a256bc4f626d None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:50.350677 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 735/1476] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:50.355843 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f09664-128d-4854-ae36-3d74b0accff4 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:50.356291 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f09664-128d-4854-ae36-3d74b0accff4 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:50.356413 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f09664-128d-4854-ae36-3d74b0accff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:50.374671 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-b8f09664-128d-4854-ae36-3d74b0accff4 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:50.375894 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-b8f09664-128d-4854-ae36-3d74b0accff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:50.384008 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 742/1477] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:42:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:42:50.409132 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d23a32-e17d-443e-9f81-a256bc4f626d None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:50.423026 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d23a32-e17d-443e-9f81-a256bc4f626d None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:50.427495 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606da7d6-e079-4921-b0ea-b246662545a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:50.428149 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606da7d6-e079-4921-b0ea-b246662545a9 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:50.428435 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606da7d6-e079-4921-b0ea-b246662545a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:50.428715 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606da7d6-e079-4921-b0ea-b246662545a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:50.429453 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606da7d6-e079-4921-b0ea-b246662545a9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:50.431502 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: WARNING py.warnings [None req-606da7d6-e079-4921-b0ea-b246662545a9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 08:42:50.431502 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: warnings.warn(msg) Jun 22 08:42:50.431502 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: Jun 22 08:42:50.432656 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606da7d6-e079-4921-b0ea-b246662545a9 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:50.454831 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 736/1478] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Jun 22 08:42:50 2022] GET /identity/v3/projects => generated 2553 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:42:52.639949 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2faa034-8bf8-49c4-8eee-ff1944a4ee4e None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:52.640539 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2faa034-8bf8-49c4-8eee-ff1944a4ee4e None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:52.640539 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2faa034-8bf8-49c4-8eee-ff1944a4ee4e None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:52.641854 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 743/1479] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:42:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:52.647771 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09874369-1778-429f-9a19-54ec565cbd6d None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:52.648260 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09874369-1778-429f-9a19-54ec565cbd6d None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:52.648358 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09874369-1778-429f-9a19-54ec565cbd6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:52.668880 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-09874369-1778-429f-9a19-54ec565cbd6d None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:52.670176 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-09874369-1778-429f-9a19-54ec565cbd6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:52.678593 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 737/1480] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:42:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:42:52.723281 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2faa034-8bf8-49c4-8eee-ff1944a4ee4e None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:52.739712 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2faa034-8bf8-49c4-8eee-ff1944a4ee4e None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:52.745686 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cfbb0f-fa5d-4263-ab29-6fd9ecad2007 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f1809a35b244c1db7a185d82859369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:52.746372 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cfbb0f-fa5d-4263-ab29-6fd9ecad2007 service nova] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:52.746659 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cfbb0f-fa5d-4263-ab29-6fd9ecad2007 service nova] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:52.746938 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cfbb0f-fa5d-4263-ab29-6fd9ecad2007 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:52.756089 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cfbb0f-fa5d-4263-ab29-6fd9ecad2007 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:52.757615 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cfbb0f-fa5d-4263-ab29-6fd9ecad2007 service nova] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:52.769152 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 744/1481] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:42:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:42:55.056751 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95c9bc-1fd4-43ce-8c45-3d2bcd59bd38 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:55.057279 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95c9bc-1fd4-43ce-8c45-3d2bcd59bd38 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:55.057279 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95c9bc-1fd4-43ce-8c45-3d2bcd59bd38 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:55.058678 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 738/1482] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:42:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:55.064620 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ea67b-bb78-4954-8387-cec93544693a None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:55.065074 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ea67b-bb78-4954-8387-cec93544693a None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:55.065185 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ea67b-bb78-4954-8387-cec93544693a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:55.082705 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-064ea67b-bb78-4954-8387-cec93544693a None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:55.083958 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-064ea67b-bb78-4954-8387-cec93544693a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:55.091904 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 745/1483] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:42:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:42:55.128619 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f95c9bc-1fd4-43ce-8c45-3d2bcd59bd38 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:55.139498 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f95c9bc-1fd4-43ce-8c45-3d2bcd59bd38 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:55.143262 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a615c-34be-40f0-b6df-43bc9a5b2d50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:55.143891 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a615c-34be-40f0-b6df-43bc9a5b2d50 service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:55.144171 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a615c-34be-40f0-b6df-43bc9a5b2d50 service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:55.144445 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a615c-34be-40f0-b6df-43bc9a5b2d50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:55.153328 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2a615c-34be-40f0-b6df-43bc9a5b2d50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:55.154857 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2a615c-34be-40f0-b6df-43bc9a5b2d50 service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:55.164419 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 739/1484] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:42:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:42:57.273116 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad79c945-e813-4793-a523-028b8265d22a None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:57.273674 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad79c945-e813-4793-a523-028b8265d22a None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:57.273674 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad79c945-e813-4793-a523-028b8265d22a None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:57.275113 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 746/1485] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:42:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:57.281265 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab77ce-d3ed-4503-a670-a1856a8be8aa None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:57.281738 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab77ce-d3ed-4503-a670-a1856a8be8aa None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:57.281852 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab77ce-d3ed-4503-a670-a1856a8be8aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:57.300619 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-73ab77ce-d3ed-4503-a670-a1856a8be8aa None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:57.301832 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-73ab77ce-d3ed-4503-a670-a1856a8be8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:57.309779 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 740/1486] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:42:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:42:57.347434 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad79c945-e813-4793-a523-028b8265d22a None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:57.358710 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad79c945-e813-4793-a523-028b8265d22a None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:57.362326 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5039faeb-61a2-421e-9b23-e3ced422519e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:57.362961 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039faeb-61a2-421e-9b23-e3ced422519e service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:57.363249 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039faeb-61a2-421e-9b23-e3ced422519e service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:57.363527 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039faeb-61a2-421e-9b23-e3ced422519e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:57.373308 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5039faeb-61a2-421e-9b23-e3ced422519e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:57.374781 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5039faeb-61a2-421e-9b23-e3ced422519e service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:57.384292 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 747/1487] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:42:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:42:59.517311 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86afb596-497e-4de9-b0f5-d0b4ca2e72b8 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:59.517839 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86afb596-497e-4de9-b0f5-d0b4ca2e72b8 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:59.517839 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86afb596-497e-4de9-b0f5-d0b4ca2e72b8 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:59.519207 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 741/1488] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:42:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:59.524614 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2449543-7f00-4575-abf5-ec33a1a76cc7 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:59.525087 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2449543-7f00-4575-abf5-ec33a1a76cc7 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:59.525184 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2449543-7f00-4575-abf5-ec33a1a76cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:59.543585 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-a2449543-7f00-4575-abf5-ec33a1a76cc7 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:59.545327 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-a2449543-7f00-4575-abf5-ec33a1a76cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:59.553164 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 748/1489] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:42:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:42:59.594198 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86afb596-497e-4de9-b0f5-d0b4ca2e72b8 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:59.605386 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86afb596-497e-4de9-b0f5-d0b4ca2e72b8 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:59.609483 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e2771f-7281-4ffa-b6a1-c7855b6d9961 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:59.610150 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2771f-7281-4ffa-b6a1-c7855b6d9961 service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:59.610437 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2771f-7281-4ffa-b6a1-c7855b6d9961 service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:59.610712 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2771f-7281-4ffa-b6a1-c7855b6d9961 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:59.620023 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e2771f-7281-4ffa-b6a1-c7855b6d9961 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:59.621449 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e2771f-7281-4ffa-b6a1-c7855b6d9961 service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:59.632025 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 742/1490] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:42:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:43:01.867493 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e9600-7b54-44df-b307-209c18c993fc None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:01.868063 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e9600-7b54-44df-b307-209c18c993fc None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:01.868063 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e9600-7b54-44df-b307-209c18c993fc None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:01.869406 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 749/1491] 10.222.0.42 () {54 vars in 926 bytes} [Wed Jun 22 08:43:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:43:01.875589 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a074383-7abe-4eb4-8345-d21a88708876 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:01.876206 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a074383-7abe-4eb4-8345-d21a88708876 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:01.876206 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a074383-7abe-4eb4-8345-d21a88708876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:01.894913 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-3a074383-7abe-4eb4-8345-d21a88708876 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:43:01.896151 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-3a074383-7abe-4eb4-8345-d21a88708876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:43:01.904749 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 743/1492] 10.222.0.42 () {58 vars in 1023 bytes} [Wed Jun 22 08:43:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 08:43:01.944228 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e9600-7b54-44df-b307-209c18c993fc None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:01.955768 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e9600-7b54-44df-b307-209c18c993fc None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:01.959413 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb734d70-d0d3-4d1b-a0f9-d471ad042ab1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:01.960118 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb734d70-d0d3-4d1b-a0f9-d471ad042ab1 service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:01.960353 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb734d70-d0d3-4d1b-a0f9-d471ad042ab1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:01.960631 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb734d70-d0d3-4d1b-a0f9-d471ad042ab1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:01.971605 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb734d70-d0d3-4d1b-a0f9-d471ad042ab1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:01.973070 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb734d70-d0d3-4d1b-a0f9-d471ad042ab1 service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:01.983334 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 750/1493] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:43:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:43:11.889738 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=33 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:11.978780 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=33 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:44:36.782838 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5260b1-1475-4550-a464-8475bdef42d8 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:36.783519 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5260b1-1475-4550-a464-8475bdef42d8 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:36.783519 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5260b1-1475-4550-a464-8475bdef42d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:36.806233 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-dc5260b1-1475-4550-a464-8475bdef42d8 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:44:36.808119 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-dc5260b1-1475-4550-a464-8475bdef42d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:44:36.817968 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 744/1494] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:44:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:44:36.827705 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb52cc-f2a9-42d8-accb-bbcf848c995e None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:36.828229 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb52cc-f2a9-42d8-accb-bbcf848c995e None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:36.828367 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb52cc-f2a9-42d8-accb-bbcf848c995e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:36.846826 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-1ddb52cc-f2a9-42d8-accb-bbcf848c995e None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:44:36.848034 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-1ddb52cc-f2a9-42d8-accb-bbcf848c995e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:44:36.856381 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 751/1495] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:44:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:44:36.861166 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5260b1-1475-4550-a464-8475bdef42d8 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:44:36.872376 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5260b1-1475-4550-a464-8475bdef42d8 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:44:36.876899 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef6e0d-dfb6-4f4f-b5c7-7ff6d7219431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:44:36.877551 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef6e0d-dfb6-4f4f-b5c7-7ff6d7219431 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:36.877834 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef6e0d-dfb6-4f4f-b5c7-7ff6d7219431 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:36.878170 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef6e0d-dfb6-4f4f-b5c7-7ff6d7219431 admin admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:36.878897 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ef6e0d-dfb6-4f4f-b5c7-7ff6d7219431 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:44:36.879204 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ef6e0d-dfb6-4f4f-b5c7-7ff6d7219431 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:44:36.880221 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: WARNING py.warnings [None req-12ef6e0d-dfb6-4f4f-b5c7-7ff6d7219431 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 08:44:36.880221 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: warnings.warn(msg) Jun 22 08:44:36.880221 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: Jun 22 08:44:36.881109 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ef6e0d-dfb6-4f4f-b5c7-7ff6d7219431 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:44:36.892965 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 745/1496] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Jun 22 08:44:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:44:36.901646 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddb52cc-f2a9-42d8-accb-bbcf848c995e None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:44:36.911043 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddb52cc-f2a9-42d8-accb-bbcf848c995e None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:44:36.916007 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b8e74-fbf0-4288-8503-ae1cce1b33db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:44:36.916704 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b8e74-fbf0-4288-8503-ae1cce1b33db admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:36.917536 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b8e74-fbf0-4288-8503-ae1cce1b33db admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:36.917817 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b8e74-fbf0-4288-8503-ae1cce1b33db admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:36.918585 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7b8e74-fbf0-4288-8503-ae1cce1b33db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:44:36.920361 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: WARNING py.warnings [None req-ae7b8e74-fbf0-4288-8503-ae1cce1b33db admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 08:44:36.920361 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: warnings.warn(msg) Jun 22 08:44:36.920361 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: Jun 22 08:44:36.921571 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7b8e74-fbf0-4288-8503-ae1cce1b33db admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:44:36.959232 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 752/1497] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 08:44:36 2022] POST /identity/v3/projects => generated 379 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:44:36.963589 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef6e0d-dfb6-4f4f-b5c7-7ff6d7219431 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:44:36.973519 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef6e0d-dfb6-4f4f-b5c7-7ff6d7219431 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:44:37.031904 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742921a2-2913-4e72-aef5-1d68631918c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:44:37.032598 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742921a2-2913-4e72-aef5-1d68631918c4 admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:37.032882 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742921a2-2913-4e72-aef5-1d68631918c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:37.033162 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742921a2-2913-4e72-aef5-1d68631918c4 admin admin] PATH_INFO: `/v3/users` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:37.033877 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742921a2-2913-4e72-aef5-1d68631918c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:44:37.034994 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: WARNING py.warnings [None req-742921a2-2913-4e72-aef5-1d68631918c4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 08:44:37.034994 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: warnings.warn(msg) Jun 22 08:44:37.034994 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: Jun 22 08:44:37.036664 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742921a2-2913-4e72-aef5-1d68631918c4 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:44:37.057877 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 746/1498] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 08:44:36 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:44:37.062105 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b8e74-fbf0-4288-8503-ae1cce1b33db admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:44:37.072622 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b8e74-fbf0-4288-8503-ae1cce1b33db admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:44:37.078157 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef1742-2d1d-421f-8eb1-8ce8f59c3f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:44:37.078821 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef1742-2d1d-421f-8eb1-8ce8f59c3f5a admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:37.079111 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef1742-2d1d-421f-8eb1-8ce8f59c3f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:37.079418 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef1742-2d1d-421f-8eb1-8ce8f59c3f5a admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:37.080113 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef1742-2d1d-421f-8eb1-8ce8f59c3f5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:44:37.081132 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: WARNING py.warnings [None req-49ef1742-2d1d-421f-8eb1-8ce8f59c3f5a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 08:44:37.081132 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: warnings.warn(msg) Jun 22 08:44:37.081132 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: Jun 22 08:44:37.082014 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef1742-2d1d-421f-8eb1-8ce8f59c3f5a admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:44:37.095221 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 753/1499] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:44:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:44:37.099250 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742921a2-2913-4e72-aef5-1d68631918c4 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:44:37.109701 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742921a2-2913-4e72-aef5-1d68631918c4 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:44:37.114341 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034fe2e-b98a-4e5c-aec3-2a812b35806c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:44:37.115000 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034fe2e-b98a-4e5c-aec3-2a812b35806c admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:37.115285 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034fe2e-b98a-4e5c-aec3-2a812b35806c admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:37.115566 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034fe2e-b98a-4e5c-aec3-2a812b35806c admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:37.116292 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6034fe2e-b98a-4e5c-aec3-2a812b35806c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:44:37.117301 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: WARNING py.warnings [None req-6034fe2e-b98a-4e5c-aec3-2a812b35806c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 08:44:37.117301 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: warnings.warn(msg) Jun 22 08:44:37.117301 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: Jun 22 08:44:37.118202 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6034fe2e-b98a-4e5c-aec3-2a812b35806c admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:44:37.132064 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 747/1500] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:44:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:44:37.136822 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef1742-2d1d-421f-8eb1-8ce8f59c3f5a admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:44:37.147275 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef1742-2d1d-421f-8eb1-8ce8f59c3f5a admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:44:37.151928 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6bd907-74d8-404d-b4de-7d02444c46f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:44:37.152810 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6bd907-74d8-404d-b4de-7d02444c46f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:37.153098 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6bd907-74d8-404d-b4de-7d02444c46f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:37.153379 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6bd907-74d8-404d-b4de-7d02444c46f6 admin admin] PATH_INFO: `/v3/projects/75e97293752b4555b46d1ea8a0ecbe58/users/6e8d31c352894472985487364b643ece/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:37.168435 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6bd907-74d8-404d-b4de-7d02444c46f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75e97293752b4555b46d1ea8a0ecbe58, user_id=6e8d31c352894472985487364b643ece, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:44:37.169508 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: WARNING py.warnings [None req-1d6bd907-74d8-404d-b4de-7d02444c46f6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 08:44:37.169508 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: warnings.warn(msg) Jun 22 08:44:37.169508 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: Jun 22 08:44:37.171500 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6bd907-74d8-404d-b4de-7d02444c46f6 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:44:37.185271 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 754/1501] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:44:37 2022] PUT /identity/v3/projects/75e97293752b4555b46d1ea8a0ecbe58/users/6e8d31c352894472985487364b643ece/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:44:37.196788 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029dfc2-4601-4fb4-9043-63dd17fb91e6 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:37.197084 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029dfc2-4601-4fb4-9043-63dd17fb91e6 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:37.197368 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029dfc2-4601-4fb4-9043-63dd17fb91e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:37.224160 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-f029dfc2-4601-4fb4-9043-63dd17fb91e6 None None] MFA Rules not processed for user `6e8d31c352894472985487364b643ece`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:44:37.225374 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-f029dfc2-4601-4fb4-9043-63dd17fb91e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:44:37.291202 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 748/1502] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:44:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:44:37.304216 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abbacd3-658c-470c-a6df-572b8d01a1ab None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:37.304508 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abbacd3-658c-470c-a6df-572b8d01a1ab None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:37.304792 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abbacd3-658c-470c-a6df-572b8d01a1ab None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:37.306167 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 755/1503] 10.222.0.42 () {54 vars in 963 bytes} [Wed Jun 22 08:44:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:44:37.311235 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372ba27-216a-4db4-a826-1c92dc585d8c None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:37.311561 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372ba27-216a-4db4-a826-1c92dc585d8c None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:37.311868 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372ba27-216a-4db4-a826-1c92dc585d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:37.330140 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-4372ba27-216a-4db4-a826-1c92dc585d8c None None] MFA Rules not processed for user `b4a2701c65144851ad87ac77fccb686f`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:44:37.331276 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-4372ba27-216a-4db4-a826-1c92dc585d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:44:37.374115 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:44:37.382699 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 749/1504] 10.222.0.42 () {58 vars in 1060 bytes} [Wed Jun 22 08:44:37 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 08:44:37.391373 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abbacd3-658c-470c-a6df-572b8d01a1ab None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:44:37.402777 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abbacd3-658c-470c-a6df-572b8d01a1ab None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:44:37.406393 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8a8e1-d11c-47fa-a10d-1a9021d1ee2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:44:37.407032 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8a8e1-d11c-47fa-a10d-1a9021d1ee2b service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:37.407317 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8a8e1-d11c-47fa-a10d-1a9021d1ee2b service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:37.407595 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8a8e1-d11c-47fa-a10d-1a9021d1ee2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:37.415944 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f8a8e1-d11c-47fa-a10d-1a9021d1ee2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:44:37.417385 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f8a8e1-d11c-47fa-a10d-1a9021d1ee2b service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:44:37.426234 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 756/1505] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:44:37 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:44:37.469328 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c08c4-dadf-49af-977e-3e8e73eb7546 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:37.469621 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c08c4-dadf-49af-977e-3e8e73eb7546 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:37.469904 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c08c4-dadf-49af-977e-3e8e73eb7546 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:37.471246 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 750/1506] 10.222.0.42 () {52 vars in 829 bytes} [Wed Jun 22 08:44:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:44:37.474996 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8a8e1-d11c-47fa-a10d-1a9021d1ee2b service cinder] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:44:37.537964 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8a8e1-d11c-47fa-a10d-1a9021d1ee2b service cinder] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:44:37.543261 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b03d50b-7d10-4a5c-894a-7a38671f9ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:44:37.544123 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b03d50b-7d10-4a5c-894a-7a38671f9ef7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:37.544415 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b03d50b-7d10-4a5c-894a-7a38671f9ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:37.544688 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b03d50b-7d10-4a5c-894a-7a38671f9ef7 admin admin] PATH_INFO: `/v3/users/6e8d31c352894472985487364b643ece` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:37.545964 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b03d50b-7d10-4a5c-894a-7a38671f9ef7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e8d31c352894472985487364b643ece)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:44:37.547018 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: WARNING py.warnings [None req-4b03d50b-7d10-4a5c-894a-7a38671f9ef7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 08:44:37.547018 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: warnings.warn(msg) Jun 22 08:44:37.547018 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: Jun 22 08:44:37.548221 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b03d50b-7d10-4a5c-894a-7a38671f9ef7 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:44:37.614194 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-4b03d50b-7d10-4a5c-894a-7a38671f9ef7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e8d31c352894472985487364b643ece'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:44:37.627473 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-4b03d50b-7d10-4a5c-894a-7a38671f9ef7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e8d31c352894472985487364b643ece'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:44:37.628295 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-4b03d50b-7d10-4a5c-894a-7a38671f9ef7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e8d31c352894472985487364b643ece'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:44:37.638550 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-4b03d50b-7d10-4a5c-894a-7a38671f9ef7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e8d31c352894472985487364b643ece'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:44:37.639466 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-4b03d50b-7d10-4a5c-894a-7a38671f9ef7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e8d31c352894472985487364b643ece'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:44:37.658364 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:44:37.671316 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 757/1507] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 08:44:37 2022] DELETE /identity/v3/users/6e8d31c352894472985487364b643ece => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:44:37.675726 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026fac9-e21d-4f7f-85de-0a5e2019577d None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:37.676043 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026fac9-e21d-4f7f-85de-0a5e2019577d None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:37.676398 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026fac9-e21d-4f7f-85de-0a5e2019577d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:37.693656 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-e026fac9-e21d-4f7f-85de-0a5e2019577d None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:44:37.694919 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-e026fac9-e21d-4f7f-85de-0a5e2019577d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:44:37.754757 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 751/1508] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:44:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:44:37.764535 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b03d50b-7d10-4a5c-894a-7a38671f9ef7 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:44:37.765945 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-4b03d50b-7d10-4a5c-894a-7a38671f9ef7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:44:37.824124 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b03d50b-7d10-4a5c-894a-7a38671f9ef7 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:44:37.827736 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dcc234-5188-459b-8932-0332dc569d69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:44:37.828372 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dcc234-5188-459b-8932-0332dc569d69 service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:37.828657 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dcc234-5188-459b-8932-0332dc569d69 service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:37.828936 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dcc234-5188-459b-8932-0332dc569d69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:37.838161 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dcc234-5188-459b-8932-0332dc569d69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:44:37.840128 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dcc234-5188-459b-8932-0332dc569d69 service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:44:37.849776 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 758/1509] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:44:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:44:38.183808 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e026fac9-e21d-4f7f-85de-0a5e2019577d None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:44:38.185441 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-e026fac9-e21d-4f7f-85de-0a5e2019577d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:44:38.197464 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e026fac9-e21d-4f7f-85de-0a5e2019577d None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:44:38.202694 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c80d0-9367-4b34-bcaf-569130e2f6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:44:38.203576 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c80d0-9367-4b34-bcaf-569130e2f6a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:38.203859 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c80d0-9367-4b34-bcaf-569130e2f6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:38.204136 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c80d0-9367-4b34-bcaf-569130e2f6a1 admin admin] PATH_INFO: `/v3/projects/75e97293752b4555b46d1ea8a0ecbe58` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:38.205372 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556c80d0-9367-4b34-bcaf-569130e2f6a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75e97293752b4555b46d1ea8a0ecbe58)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:44:38.206428 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: WARNING py.warnings [None req-556c80d0-9367-4b34-bcaf-569130e2f6a1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 08:44:38.206428 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: warnings.warn(msg) Jun 22 08:44:38.206428 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: Jun 22 08:44:38.207639 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556c80d0-9367-4b34-bcaf-569130e2f6a1 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:44:38.281338 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-556c80d0-9367-4b34-bcaf-569130e2f6a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75e97293752b4555b46d1ea8a0ecbe58', 'request_id': 'req-556c80d0-9367-4b34-bcaf-569130e2f6a1'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:44:38.288489 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-556c80d0-9367-4b34-bcaf-569130e2f6a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75e97293752b4555b46d1ea8a0ecbe58', 'request_id': 'req-556c80d0-9367-4b34-bcaf-569130e2f6a1'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:44:38.304159 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-556c80d0-9367-4b34-bcaf-569130e2f6a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75e97293752b4555b46d1ea8a0ecbe58', 'request_id': 'req-556c80d0-9367-4b34-bcaf-569130e2f6a1'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:44:38.321512 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-556c80d0-9367-4b34-bcaf-569130e2f6a1 admin admin] The token cache is being invalidate because project 75e97293752b4555b46d1ea8a0ecbe58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 08:44:38.321803 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-556c80d0-9367-4b34-bcaf-569130e2f6a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:44:38.322503 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-556c80d0-9367-4b34-bcaf-569130e2f6a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:44:38.324237 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 752/1510] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 08:44:38 2022] DELETE /identity/v3/projects/75e97293752b4555b46d1ea8a0ecbe58 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 08:44:47.845565 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:44:48.317915 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:46:18.481818 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c53192e-480e-4812-8f6f-1dc7b8571e85 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:18.482494 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c53192e-480e-4812-8f6f-1dc7b8571e85 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:18.482494 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c53192e-480e-4812-8f6f-1dc7b8571e85 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:18.483766 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 759/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 08:46:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:46:18.488634 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5148183d-1275-4d8c-b96a-3f978e06018b None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:18.489106 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5148183d-1275-4d8c-b96a-3f978e06018b None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:18.489209 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5148183d-1275-4d8c-b96a-3f978e06018b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:18.507266 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-5148183d-1275-4d8c-b96a-3f978e06018b None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:46:18.508915 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-5148183d-1275-4d8c-b96a-3f978e06018b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:46:18.567580 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 753/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 08:46:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 08:46:18.723478 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c53192e-480e-4812-8f6f-1dc7b8571e85 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:46:18.725764 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-9c53192e-480e-4812-8f6f-1dc7b8571e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:46:18.802775 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c53192e-480e-4812-8f6f-1dc7b8571e85 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:46:18.809831 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c896901a-81bc-4c87-bd2f-e48e98769cb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f1809a35b244c1db7a185d82859369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:46:18.810537 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c896901a-81bc-4c87-bd2f-e48e98769cb4 service nova] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:18.810829 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c896901a-81bc-4c87-bd2f-e48e98769cb4 service nova] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:18.811101 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c896901a-81bc-4c87-bd2f-e48e98769cb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:18.820401 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c896901a-81bc-4c87-bd2f-e48e98769cb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:46:18.822182 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c896901a-81bc-4c87-bd2f-e48e98769cb4 service nova] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:46:18.832382 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 760/1513] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:46:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:46:19.678591 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec034b26-cb8c-4daf-8126-1937db16d473 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:19.679162 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec034b26-cb8c-4daf-8126-1937db16d473 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:19.679291 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec034b26-cb8c-4daf-8126-1937db16d473 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:19.681398 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 754/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 08:46:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:46:19.686446 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c569a7d-d20d-4a85-9769-fbad6e949976 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:19.686878 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c569a7d-d20d-4a85-9769-fbad6e949976 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:19.687016 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c569a7d-d20d-4a85-9769-fbad6e949976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:19.707911 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-0c569a7d-d20d-4a85-9769-fbad6e949976 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:46:19.709215 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-0c569a7d-d20d-4a85-9769-fbad6e949976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:46:19.717554 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 761/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 08:46:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:46:19.869904 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec034b26-cb8c-4daf-8126-1937db16d473 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:46:19.885059 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec034b26-cb8c-4daf-8126-1937db16d473 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:46:19.890803 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c141819-4af1-40bf-831e-333c0904d894 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f1809a35b244c1db7a185d82859369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:46:19.891435 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c141819-4af1-40bf-831e-333c0904d894 service nova] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:19.891717 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c141819-4af1-40bf-831e-333c0904d894 service nova] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:19.892002 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c141819-4af1-40bf-831e-333c0904d894 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:19.900538 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c141819-4af1-40bf-831e-333c0904d894 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:46:19.902164 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c141819-4af1-40bf-831e-333c0904d894 service nova] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:46:19.911616 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 755/1516] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:46:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:46:20.292568 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63b915-c0c1-449d-bc5c-cebe7fa88b5f None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:20.292860 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63b915-c0c1-449d-bc5c-cebe7fa88b5f None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:20.293136 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63b915-c0c1-449d-bc5c-cebe7fa88b5f None None] PATH_INFO: `/v3` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:20.294481 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 762/1517] 10.222.0.26 () {54 vars in 925 bytes} [Wed Jun 22 08:46:20 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:46:20.301168 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796e02d-1e71-4b2f-aa5c-183d66bfb171 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:20.301168 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796e02d-1e71-4b2f-aa5c-183d66bfb171 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:20.304183 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796e02d-1e71-4b2f-aa5c-183d66bfb171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:20.320437 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-5796e02d-1e71-4b2f-aa5c-183d66bfb171 None None] MFA Rules not processed for user `ec2627e3cdc94ec38d7cc3b1bc670ef1`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:46:20.321639 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-5796e02d-1e71-4b2f-aa5c-183d66bfb171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:46:20.383744 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 756/1518] 10.222.0.26 () {58 vars in 1015 bytes} [Wed Jun 22 08:46:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 08:46:24.197530 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f992df-fd3c-4998-9105-f039f93a5fc7 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:24.198063 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f992df-fd3c-4998-9105-f039f93a5fc7 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:24.198063 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f992df-fd3c-4998-9105-f039f93a5fc7 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:24.199453 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 763/1519] 10.222.0.42 () {54 vars in 960 bytes} [Wed Jun 22 08:46:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:46:24.204463 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43509468-3499-45eb-be75-5a78801f53b7 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:24.204889 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43509468-3499-45eb-be75-5a78801f53b7 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:24.205013 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43509468-3499-45eb-be75-5a78801f53b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:24.223761 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-43509468-3499-45eb-be75-5a78801f53b7 None None] MFA Rules not processed for user `ec2627e3cdc94ec38d7cc3b1bc670ef1`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:46:24.224980 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-43509468-3499-45eb-be75-5a78801f53b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:46:24.234588 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 757/1520] 10.222.0.42 () {58 vars in 1057 bytes} [Wed Jun 22 08:46:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:46:24.242570 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f992df-fd3c-4998-9105-f039f93a5fc7 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:46:24.256716 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f992df-fd3c-4998-9105-f039f93a5fc7 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:46:24.261669 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db51a441-593a-4f6c-b1c4-7b0f38e49e5e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec2627e3cdc94ec38d7cc3b1bc670ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:46:24.262350 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51a441-593a-4f6c-b1c4-7b0f38e49e5e service placement] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:24.262660 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51a441-593a-4f6c-b1c4-7b0f38e49e5e service placement] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:24.262984 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51a441-593a-4f6c-b1c4-7b0f38e49e5e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:24.272326 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db51a441-593a-4f6c-b1c4-7b0f38e49e5e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:46:24.274475 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db51a441-593a-4f6c-b1c4-7b0f38e49e5e service placement] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:46:24.285490 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 764/1521] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:46:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:46:31.179736 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479e473-199d-447c-9e61-5a4ed1ee9bc0 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:31.180357 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479e473-199d-447c-9e61-5a4ed1ee9bc0 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:31.180357 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479e473-199d-447c-9e61-5a4ed1ee9bc0 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:31.181703 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 758/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 08:46:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:46:31.186921 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0860f-0ec3-4266-acb8-7330dcd9ecbc None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:31.187362 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0860f-0ec3-4266-acb8-7330dcd9ecbc None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:31.187489 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0860f-0ec3-4266-acb8-7330dcd9ecbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:31.207837 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-1be0860f-0ec3-4266-acb8-7330dcd9ecbc None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:46:31.209066 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-1be0860f-0ec3-4266-acb8-7330dcd9ecbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:46:31.218510 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 765/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 08:46:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:46:31.380389 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4479e473-199d-447c-9e61-5a4ed1ee9bc0 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:46:31.395828 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4479e473-199d-447c-9e61-5a4ed1ee9bc0 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:46:31.401826 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149fc9cc-0aaa-4390-82d8-9dd2d9d3051a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f1809a35b244c1db7a185d82859369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:46:31.402497 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149fc9cc-0aaa-4390-82d8-9dd2d9d3051a service nova] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:31.402781 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149fc9cc-0aaa-4390-82d8-9dd2d9d3051a service nova] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:31.403057 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149fc9cc-0aaa-4390-82d8-9dd2d9d3051a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:31.411762 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149fc9cc-0aaa-4390-82d8-9dd2d9d3051a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:46:31.413855 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149fc9cc-0aaa-4390-82d8-9dd2d9d3051a service nova] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:46:31.423652 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 759/1524] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:46:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:46:32.253145 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e343c68-d248-4950-9c77-49339b1f551e None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:32.253609 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e343c68-d248-4950-9c77-49339b1f551e None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:32.253725 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e343c68-d248-4950-9c77-49339b1f551e None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:32.255146 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 766/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 08:46:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:46:32.260823 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76401234-ffbc-473f-a359-ed53db9304e5 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:32.261324 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76401234-ffbc-473f-a359-ed53db9304e5 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:32.261434 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76401234-ffbc-473f-a359-ed53db9304e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:32.281107 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-76401234-ffbc-473f-a359-ed53db9304e5 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:46:32.282347 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-76401234-ffbc-473f-a359-ed53db9304e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:46:32.290752 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 760/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 08:46:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 08:46:32.442841 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e343c68-d248-4950-9c77-49339b1f551e None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:46:32.459869 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e343c68-d248-4950-9c77-49339b1f551e None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:46:32.465981 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dd936e-5703-42d6-8b19-ce6eb64dbab6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f1809a35b244c1db7a185d82859369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:46:32.466663 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd936e-5703-42d6-8b19-ce6eb64dbab6 service nova] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:32.466948 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd936e-5703-42d6-8b19-ce6eb64dbab6 service nova] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:32.467276 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd936e-5703-42d6-8b19-ce6eb64dbab6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:32.476657 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dd936e-5703-42d6-8b19-ce6eb64dbab6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:46:32.478311 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dd936e-5703-42d6-8b19-ce6eb64dbab6 service nova] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:46:32.488259 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 767/1527] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:46:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:46:36.409342 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df9b63-20df-47c5-814c-0fd112ec64cb None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:36.409914 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df9b63-20df-47c5-814c-0fd112ec64cb None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:36.409914 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df9b63-20df-47c5-814c-0fd112ec64cb None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:36.411300 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 761/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 08:46:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:46:36.417675 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96599a5-baf3-41b4-938a-dd15b12145a3 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:36.418195 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96599a5-baf3-41b4-938a-dd15b12145a3 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:36.418302 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96599a5-baf3-41b4-938a-dd15b12145a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:36.439399 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-b96599a5-baf3-41b4-938a-dd15b12145a3 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:46:36.440711 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-b96599a5-baf3-41b4-938a-dd15b12145a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:46:36.451117 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 768/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 08:46:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:46:36.488653 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df9b63-20df-47c5-814c-0fd112ec64cb None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:46:36.490400 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-76df9b63-20df-47c5-814c-0fd112ec64cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:46:36.550815 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df9b63-20df-47c5-814c-0fd112ec64cb None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:46:36.554252 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a0776-007a-4d82-bb71-347629011893 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:46:36.554899 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a0776-007a-4d82-bb71-347629011893 service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:36.555184 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a0776-007a-4d82-bb71-347629011893 service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:36.555464 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a0776-007a-4d82-bb71-347629011893 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:36.564302 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1a0776-007a-4d82-bb71-347629011893 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:46:36.565721 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1a0776-007a-4d82-bb71-347629011893 service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:46:36.571176 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:46:36.576701 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 762/1530] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:46:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:46:38.624199 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c11a8-50a1-40ac-b595-bbb72e0c0aaf None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:38.624721 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c11a8-50a1-40ac-b595-bbb72e0c0aaf None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:38.624721 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c11a8-50a1-40ac-b595-bbb72e0c0aaf None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:38.626032 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 769/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 08:46:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:46:38.631690 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff7a9c-5f3a-4f35-8ae5-0be0ac7c77c5 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:38.632107 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff7a9c-5f3a-4f35-8ae5-0be0ac7c77c5 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:38.632404 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff7a9c-5f3a-4f35-8ae5-0be0ac7c77c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:38.650953 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-37ff7a9c-5f3a-4f35-8ae5-0be0ac7c77c5 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:46:38.652180 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-37ff7a9c-5f3a-4f35-8ae5-0be0ac7c77c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:46:38.660258 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 763/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 08:46:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:46:38.696427 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c11a8-50a1-40ac-b595-bbb72e0c0aaf None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:46:38.707260 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c11a8-50a1-40ac-b595-bbb72e0c0aaf None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:46:38.711467 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec62891-b316-4669-a3d2-7f0eb7458b8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:46:38.712099 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec62891-b316-4669-a3d2-7f0eb7458b8f service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:38.712382 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec62891-b316-4669-a3d2-7f0eb7458b8f service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:38.712659 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec62891-b316-4669-a3d2-7f0eb7458b8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:38.721779 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec62891-b316-4669-a3d2-7f0eb7458b8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:46:38.723293 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec62891-b316-4669-a3d2-7f0eb7458b8f service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:46:38.733592 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 770/1533] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:46:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:46:42.393418 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca112b-1315-4142-8db8-fbe949456445 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:42.393998 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca112b-1315-4142-8db8-fbe949456445 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:42.393998 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca112b-1315-4142-8db8-fbe949456445 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:42.395387 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 764/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 08:46:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:46:42.401362 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb96e76-3a34-49a2-81b6-5d67067dd683 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:42.401780 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb96e76-3a34-49a2-81b6-5d67067dd683 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:42.401943 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb96e76-3a34-49a2-81b6-5d67067dd683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:42.420698 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-ecb96e76-3a34-49a2-81b6-5d67067dd683 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:46:42.421910 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-ecb96e76-3a34-49a2-81b6-5d67067dd683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:46:42.429802 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 771/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 08:46:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:46:42.738786 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca112b-1315-4142-8db8-fbe949456445 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:46:42.740494 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-92ca112b-1315-4142-8db8-fbe949456445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:46:42.801046 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca112b-1315-4142-8db8-fbe949456445 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:46:42.805111 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ecfb8-b22e-442b-b0e3-c14a95b3945f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:46:42.805757 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ecfb8-b22e-442b-b0e3-c14a95b3945f service cinder] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:42.806042 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ecfb8-b22e-442b-b0e3-c14a95b3945f service cinder] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:42.806354 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ecfb8-b22e-442b-b0e3-c14a95b3945f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:42.815426 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933ecfb8-b22e-442b-b0e3-c14a95b3945f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:46:42.816844 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933ecfb8-b22e-442b-b0e3-c14a95b3945f service cinder] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:46:42.826367 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 765/1536] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:46:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:46:44.944532 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f7f85-db7c-4563-a7c4-b72475968e05 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:44.945060 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f7f85-db7c-4563-a7c4-b72475968e05 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:44.945060 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f7f85-db7c-4563-a7c4-b72475968e05 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:44.946284 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 772/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 08:46:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:46:44.951905 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f343e1-f53a-4194-96e8-3867bfd75a44 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:44.952401 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f343e1-f53a-4194-96e8-3867bfd75a44 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:44.952510 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f343e1-f53a-4194-96e8-3867bfd75a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:44.971240 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-c5f343e1-f53a-4194-96e8-3867bfd75a44 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:46:44.972474 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-c5f343e1-f53a-4194-96e8-3867bfd75a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:46:44.980902 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 766/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 08:46:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 08:46:45.293199 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f7f85-db7c-4563-a7c4-b72475968e05 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:46:45.295188 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-1a1f7f85-db7c-4563-a7c4-b72475968e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:46:45.308706 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f7f85-db7c-4563-a7c4-b72475968e05 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:46:45.320967 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7184307a-fff4-4a32-9ba1-694e4bd66103 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:46:45.321617 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184307a-fff4-4a32-9ba1-694e4bd66103 service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:45.321904 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184307a-fff4-4a32-9ba1-694e4bd66103 service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:45.322215 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184307a-fff4-4a32-9ba1-694e4bd66103 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:45.332056 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7184307a-fff4-4a32-9ba1-694e4bd66103 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:46:45.333483 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7184307a-fff4-4a32-9ba1-694e4bd66103 service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:46:45.343064 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 773/1539] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:46:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:46:54.966045 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=32 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:46:55.338773 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=70 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:14.791965 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba07070-f538-4294-a5d2-ad60278c1de7 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:14.793272 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba07070-f538-4294-a5d2-ad60278c1de7 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:14.793272 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba07070-f538-4294-a5d2-ad60278c1de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:14.828096 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-eba07070-f538-4294-a5d2-ad60278c1de7 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:14.829328 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-eba07070-f538-4294-a5d2-ad60278c1de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:14.840941 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 767/1540] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 08:48:14.852687 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac857526-3dcd-40d9-a4d9-7d7d3c338b09 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:14.853300 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac857526-3dcd-40d9-a4d9-7d7d3c338b09 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:14.853300 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac857526-3dcd-40d9-a4d9-7d7d3c338b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:14.885778 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-ac857526-3dcd-40d9-a4d9-7d7d3c338b09 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:14.887341 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-ac857526-3dcd-40d9-a4d9-7d7d3c338b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:14.905564 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 774/1541] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:14.910914 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba07070-f538-4294-a5d2-ad60278c1de7 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:14.925954 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba07070-f538-4294-a5d2-ad60278c1de7 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:14.932236 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b43dab-aa7e-48aa-b6f5-afb96dc1af50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:14.932928 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b43dab-aa7e-48aa-b6f5-afb96dc1af50 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:14.933208 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b43dab-aa7e-48aa-b6f5-afb96dc1af50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:14.933482 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b43dab-aa7e-48aa-b6f5-afb96dc1af50 admin admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:14.934314 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b43dab-aa7e-48aa-b6f5-afb96dc1af50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:14.934568 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b43dab-aa7e-48aa-b6f5-afb96dc1af50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:14.936416 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b43dab-aa7e-48aa-b6f5-afb96dc1af50 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:14.957622 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 768/1542] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Jun 22 08:48:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:14.966851 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac857526-3dcd-40d9-a4d9-7d7d3c338b09 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:14.979736 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac857526-3dcd-40d9-a4d9-7d7d3c338b09 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:14.989702 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c44738-1a36-4388-9fdb-8bc16e4c346f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:14.990423 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c44738-1a36-4388-9fdb-8bc16e4c346f admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:14.990709 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c44738-1a36-4388-9fdb-8bc16e4c346f admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:14.990988 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c44738-1a36-4388-9fdb-8bc16e4c346f admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:14.991703 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c44738-1a36-4388-9fdb-8bc16e4c346f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:14.993675 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c44738-1a36-4388-9fdb-8bc16e4c346f admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:15.035785 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 775/1543] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 08:48:14 2022] POST /identity/v3/projects => generated 373 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:15.044963 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b43dab-aa7e-48aa-b6f5-afb96dc1af50 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:15.061237 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b43dab-aa7e-48aa-b6f5-afb96dc1af50 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:15.141396 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d1d73-6ff8-4023-a0e9-7ff1b4b58a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:15.142139 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d1d73-6ff8-4023-a0e9-7ff1b4b58a89 admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:15.142426 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d1d73-6ff8-4023-a0e9-7ff1b4b58a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:15.142705 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d1d73-6ff8-4023-a0e9-7ff1b4b58a89 admin admin] PATH_INFO: `/v3/users` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:15.143422 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9d1d73-6ff8-4023-a0e9-7ff1b4b58a89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:15.145587 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9d1d73-6ff8-4023-a0e9-7ff1b4b58a89 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:15.179596 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 769/1544] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 08:48:15 2022] POST /identity/v3/users => generated 287 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:15.183347 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c44738-1a36-4388-9fdb-8bc16e4c346f admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:15.199574 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c44738-1a36-4388-9fdb-8bc16e4c346f admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:15.208539 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a21d339-71f3-4a0e-a244-81f98f9bf066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:15.209286 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21d339-71f3-4a0e-a244-81f98f9bf066 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:15.209577 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21d339-71f3-4a0e-a244-81f98f9bf066 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:15.209860 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21d339-71f3-4a0e-a244-81f98f9bf066 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:15.210651 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a21d339-71f3-4a0e-a244-81f98f9bf066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:15.212283 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a21d339-71f3-4a0e-a244-81f98f9bf066 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:15.228402 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 776/1545] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:48:15 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:48:15.232417 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d1d73-6ff8-4023-a0e9-7ff1b4b58a89 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:15.245685 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d1d73-6ff8-4023-a0e9-7ff1b4b58a89 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:15.246694 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c134e01-68e8-4261-8483-f4c2469d4f42 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:15.247106 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c134e01-68e8-4261-8483-f4c2469d4f42 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:15.247398 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c134e01-68e8-4261-8483-f4c2469d4f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:15.253416 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c63ca7-9163-4902-8780-300c36bcebb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:15.257068 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c63ca7-9163-4902-8780-300c36bcebb2 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:15.257366 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c63ca7-9163-4902-8780-300c36bcebb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:15.262111 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c63ca7-9163-4902-8780-300c36bcebb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:15.262111 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c63ca7-9163-4902-8780-300c36bcebb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:15.263390 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c63ca7-9163-4902-8780-300c36bcebb2 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:15.278409 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 770/1546] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:48:15 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:48:15.284374 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c63ca7-9163-4902-8780-300c36bcebb2 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:15.289719 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-1c134e01-68e8-4261-8483-f4c2469d4f42 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:15.290997 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-1c134e01-68e8-4261-8483-f4c2469d4f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:15.300490 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c63ca7-9163-4902-8780-300c36bcebb2 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:15.310719 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a553b9-a0f3-46c7-8e53-23c760243c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:15.311637 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a553b9-a0f3-46c7-8e53-23c760243c94 admin admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:15.311917 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a553b9-a0f3-46c7-8e53-23c760243c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:15.312190 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a553b9-a0f3-46c7-8e53-23c760243c94 admin admin] PATH_INFO: `/v3/projects/a1d4d027d5f540d6ac0ce56bcca26da0/users/8a9cb369ad0d4d09b237fa6ea0c69871/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:15.331171 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 777/1547] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 08:48:15.334734 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a553b9-a0f3-46c7-8e53-23c760243c94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1d4d027d5f540d6ac0ce56bcca26da0, user_id=8a9cb369ad0d4d09b237fa6ea0c69871, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:15.335793 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: WARNING py.warnings [None req-d2a553b9-a0f3-46c7-8e53-23c760243c94 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 08:48:15.335793 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: warnings.warn(msg) Jun 22 08:48:15.335793 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: Jun 22 08:48:15.338017 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a553b9-a0f3-46c7-8e53-23c760243c94 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:15.352319 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331bc203-622c-422f-ace2-b9e9e4245b84 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:15.352690 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331bc203-622c-422f-ace2-b9e9e4245b84 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:15.352891 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331bc203-622c-422f-ace2-b9e9e4245b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:15.368754 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 771/1548] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:48:15 2022] PUT /identity/v3/projects/a1d4d027d5f540d6ac0ce56bcca26da0/users/8a9cb369ad0d4d09b237fa6ea0c69871/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 08:48:15.397523 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-331bc203-622c-422f-ace2-b9e9e4245b84 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:15.398908 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-331bc203-622c-422f-ace2-b9e9e4245b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:15.399228 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f3296-0cfb-4e93-8016-8d44e7790c42 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:15.399483 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f3296-0cfb-4e93-8016-8d44e7790c42 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:15.399766 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f3296-0cfb-4e93-8016-8d44e7790c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:15.453388 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-fb9f3296-0cfb-4e93-8016-8d44e7790c42 None None] MFA Rules not processed for user `8a9cb369ad0d4d09b237fa6ea0c69871`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:15.454554 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-fb9f3296-0cfb-4e93-8016-8d44e7790c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:15.533095 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 778/1549] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:15.534542 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826bef2d-6399-40dd-a952-59c396e89651 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:15.534837 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826bef2d-6399-40dd-a952-59c396e89651 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:15.535118 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826bef2d-6399-40dd-a952-59c396e89651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:15.579397 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-826bef2d-6399-40dd-a952-59c396e89651 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:15.580637 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-826bef2d-6399-40dd-a952-59c396e89651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:15.595945 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 772/1550] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:15.597511 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd8dd8-3939-4cfe-9718-934187898708 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:15.597808 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd8dd8-3939-4cfe-9718-934187898708 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:15.598102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd8dd8-3939-4cfe-9718-934187898708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:15.602501 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 779/1551] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:15.603187 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826bef2d-6399-40dd-a952-59c396e89651 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:15.619035 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826bef2d-6399-40dd-a952-59c396e89651 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:15.623786 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c7b34e-8a75-46c4-8e38-b64810f2d3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:15.624448 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7b34e-8a75-46c4-8e38-b64810f2d3a8 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:15.624732 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7b34e-8a75-46c4-8e38-b64810f2d3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:15.625007 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7b34e-8a75-46c4-8e38-b64810f2d3a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:15.625736 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c7b34e-8a75-46c4-8e38-b64810f2d3a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:15.626047 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c7b34e-8a75-46c4-8e38-b64810f2d3a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:15.627373 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: WARNING py.warnings [None req-18c7b34e-8a75-46c4-8e38-b64810f2d3a8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 08:48:15.627373 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: warnings.warn(msg) Jun 22 08:48:15.627373 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: Jun 22 08:48:15.628477 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c7b34e-8a75-46c4-8e38-b64810f2d3a8 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:15.629161 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-05bd8dd8-3939-4cfe-9718-934187898708 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:15.631102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-05bd8dd8-3939-4cfe-9718-934187898708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:15.640216 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 773/1552] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:15.641489 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131cba7f-bd8b-4dea-a3f3-c4a4a5813dd2 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:15.641851 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131cba7f-bd8b-4dea-a3f3-c4a4a5813dd2 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:15.642228 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131cba7f-bd8b-4dea-a3f3-c4a4a5813dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:15.643304 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 780/1553] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Jun 22 08:48:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:15.644538 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c7b34e-8a75-46c4-8e38-b64810f2d3a8 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:15.655560 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c7b34e-8a75-46c4-8e38-b64810f2d3a8 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:15.660700 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b6baf4-f1ea-4f1e-949c-a203aca108f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:15.661599 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6baf4-f1ea-4f1e-949c-a203aca108f5 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:15.662670 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6baf4-f1ea-4f1e-949c-a203aca108f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:15.662960 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6baf4-f1ea-4f1e-949c-a203aca108f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:15.663685 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b6baf4-f1ea-4f1e-949c-a203aca108f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:15.665629 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b6baf4-f1ea-4f1e-949c-a203aca108f5 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:15.672753 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-131cba7f-bd8b-4dea-a3f3-c4a4a5813dd2 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:15.674178 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-131cba7f-bd8b-4dea-a3f3-c4a4a5813dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:15.683049 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 774/1554] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:15.684183 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14090a5f-4ee6-47b2-b8b9-61968a21394e None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:15.684473 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14090a5f-4ee6-47b2-b8b9-61968a21394e None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:15.684755 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14090a5f-4ee6-47b2-b8b9-61968a21394e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:15.711582 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 781/1555] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 08:48:15 2022] POST /identity/v3/projects => generated 373 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:15.712959 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60835e-6e46-4688-971d-8b23467870fb None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:15.713253 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60835e-6e46-4688-971d-8b23467870fb None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:15.713535 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60835e-6e46-4688-971d-8b23467870fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:15.716575 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-14090a5f-4ee6-47b2-b8b9-61968a21394e None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:15.717988 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-14090a5f-4ee6-47b2-b8b9-61968a21394e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:15.726867 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:15.733199 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-7d60835e-6e46-4688-971d-8b23467870fb None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:15.734797 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-7d60835e-6e46-4688-971d-8b23467870fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:15.786244 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 775/1556] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:15.788133 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c661ece-bd68-46d5-893b-358820919723 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:15.788428 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c661ece-bd68-46d5-893b-358820919723 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:15.788705 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c661ece-bd68-46d5-893b-358820919723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:15.799173 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 782/1557] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:15.806388 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d60835e-6e46-4688-971d-8b23467870fb None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:15.806650 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-5c661ece-bd68-46d5-893b-358820919723 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:15.807850 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-5c661ece-bd68-46d5-893b-358820919723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:15.815677 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d60835e-6e46-4688-971d-8b23467870fb None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:15.819432 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 776/1558] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:15.819432 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc648f-6ad6-4639-9670-8e7b6b4a83a1 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:15.819432 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc648f-6ad6-4639-9670-8e7b6b4a83a1 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:15.819432 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc648f-6ad6-4639-9670-8e7b6b4a83a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:15.820533 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e761e4d5-8256-429c-b9d5-76d43b709f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:15.821223 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761e4d5-8256-429c-b9d5-76d43b709f82 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:15.821510 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761e4d5-8256-429c-b9d5-76d43b709f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:15.821792 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761e4d5-8256-429c-b9d5-76d43b709f82 admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:15.822585 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e761e4d5-8256-429c-b9d5-76d43b709f82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:15.824529 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e761e4d5-8256-429c-b9d5-76d43b709f82 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:15.835313 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:15.837137 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-6cfc648f-6ad6-4639-9670-8e7b6b4a83a1 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:15.838313 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-6cfc648f-6ad6-4639-9670-8e7b6b4a83a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:15.846833 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 777/1559] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:15.848134 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c9e4c-82f1-44cd-8a3f-5da1ce77815a None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:15.848435 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c9e4c-82f1-44cd-8a3f-5da1ce77815a None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:15.848701 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c9e4c-82f1-44cd-8a3f-5da1ce77815a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:15.854835 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 783/1560] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 08:48:15 2022] POST /identity/v3/projects => generated 391 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:15.856898 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543768d0-1226-4684-b776-37b4e2772306 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:15.857198 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543768d0-1226-4684-b776-37b4e2772306 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:15.857540 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543768d0-1226-4684-b776-37b4e2772306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:15.875517 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-543768d0-1226-4684-b776-37b4e2772306 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:15.876770 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-543768d0-1226-4684-b776-37b4e2772306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:15.944508 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 784/1561] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:15.945370 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543768d0-1226-4684-b776-37b4e2772306 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:15.956041 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543768d0-1226-4684-b776-37b4e2772306 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:15.961406 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc22304-63c3-43ff-9869-dbd076084e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:15.962181 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc22304-63c3-43ff-9869-dbd076084e55 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:15.962410 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc22304-63c3-43ff-9869-dbd076084e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:15.962696 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc22304-63c3-43ff-9869-dbd076084e55 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:15.963410 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc22304-63c3-43ff-9869-dbd076084e55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:15.964468 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: WARNING py.warnings [None req-efc22304-63c3-43ff-9869-dbd076084e55 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 08:48:15.964468 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: warnings.warn(msg) Jun 22 08:48:15.964468 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: Jun 22 08:48:15.965713 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc22304-63c3-43ff-9869-dbd076084e55 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:15.987812 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 785/1562] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 08:48:15 2022] POST /identity/v3/users => generated 293 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:15.988498 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc22304-63c3-43ff-9869-dbd076084e55 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:15.998589 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc22304-63c3-43ff-9869-dbd076084e55 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:15.998850 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-a29c9e4c-82f1-44cd-8a3f-5da1ce77815a None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:16.000179 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-a29c9e4c-82f1-44cd-8a3f-5da1ce77815a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:16.003541 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20860fa-0fa4-4797-b483-63efd2ea5147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:16.004190 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20860fa-0fa4-4797-b483-63efd2ea5147 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:16.004484 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20860fa-0fa4-4797-b483-63efd2ea5147 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:16.004767 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20860fa-0fa4-4797-b483-63efd2ea5147 admin admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:16.005530 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20860fa-0fa4-4797-b483-63efd2ea5147 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:16.005898 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20860fa-0fa4-4797-b483-63efd2ea5147 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:16.007497 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20860fa-0fa4-4797-b483-63efd2ea5147 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:16.008253 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 778/1563] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:16.012447 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f45f3-feb2-4f25-ad54-af86f0861c15 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:16.012447 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f45f3-feb2-4f25-ad54-af86f0861c15 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:16.012447 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f45f3-feb2-4f25-ad54-af86f0861c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:16.027287 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 786/1564] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Jun 22 08:48:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:16.028147 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20860fa-0fa4-4797-b483-63efd2ea5147 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:16.030122 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-d64f45f3-feb2-4f25-ad54-af86f0861c15 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:16.031544 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-d64f45f3-feb2-4f25-ad54-af86f0861c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:16.041118 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20860fa-0fa4-4797-b483-63efd2ea5147 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:16.043435 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 779/1565] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:16.045375 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2816b27-4a5f-4bb1-ab60-999e98a20a31 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:16.045830 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2816b27-4a5f-4bb1-ab60-999e98a20a31 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:16.046182 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1750dda4-96f3-4d18-a9ce-2b4db561762b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:16.046327 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2816b27-4a5f-4bb1-ab60-999e98a20a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:16.047154 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1750dda4-96f3-4d18-a9ce-2b4db561762b admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:16.047154 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1750dda4-96f3-4d18-a9ce-2b4db561762b admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:16.047451 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1750dda4-96f3-4d18-a9ce-2b4db561762b admin admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:16.048188 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1750dda4-96f3-4d18-a9ce-2b4db561762b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:16.048504 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1750dda4-96f3-4d18-a9ce-2b4db561762b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:16.050164 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1750dda4-96f3-4d18-a9ce-2b4db561762b admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:16.064656 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 787/1566] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Jun 22 08:48:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:16.065557 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1750dda4-96f3-4d18-a9ce-2b4db561762b admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:16.066282 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-a2816b27-4a5f-4bb1-ab60-999e98a20a31 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:16.067533 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-a2816b27-4a5f-4bb1-ab60-999e98a20a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:16.075959 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1750dda4-96f3-4d18-a9ce-2b4db561762b admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:16.076115 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 780/1567] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:16.077249 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153935d5-40eb-424c-838d-ad975e879614 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:16.077549 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153935d5-40eb-424c-838d-ad975e879614 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:16.077818 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153935d5-40eb-424c-838d-ad975e879614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:16.082491 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d4f8c-4b62-4b5e-bc80-c0d4e9b71004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:16.083141 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d4f8c-4b62-4b5e-bc80-c0d4e9b71004 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:16.083431 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d4f8c-4b62-4b5e-bc80-c0d4e9b71004 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:16.084252 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d4f8c-4b62-4b5e-bc80-c0d4e9b71004 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:16.084935 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1d4f8c-4b62-4b5e-bc80-c0d4e9b71004 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:16.086882 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1d4f8c-4b62-4b5e-bc80-c0d4e9b71004 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:16.096772 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-153935d5-40eb-424c-838d-ad975e879614 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:16.097996 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-153935d5-40eb-424c-838d-ad975e879614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:16.108245 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 788/1568] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 08:48:16 2022] POST /identity/v3/users => generated 296 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:16.109153 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d4f8c-4b62-4b5e-bc80-c0d4e9b71004 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:16.114205 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 781/1569] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:16.114205 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153935d5-40eb-424c-838d-ad975e879614 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:16.120087 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d4f8c-4b62-4b5e-bc80-c0d4e9b71004 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:16.121109 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153935d5-40eb-424c-838d-ad975e879614 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:16.124945 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0474ae3f-0f16-44e4-b9c4-732eee7b06fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:16.125612 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474ae3f-0f16-44e4-b9c4-732eee7b06fb admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:16.125740 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a401310-000d-4c8a-aa17-6cfc836ce146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:16.125907 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474ae3f-0f16-44e4-b9c4-732eee7b06fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:16.126207 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474ae3f-0f16-44e4-b9c4-732eee7b06fb admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:16.126400 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a401310-000d-4c8a-aa17-6cfc836ce146 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:16.126681 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a401310-000d-4c8a-aa17-6cfc836ce146 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:16.126939 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0474ae3f-0f16-44e4-b9c4-732eee7b06fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:16.127052 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a401310-000d-4c8a-aa17-6cfc836ce146 admin admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:16.127665 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a401310-000d-4c8a-aa17-6cfc836ce146 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:16.127970 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a401310-000d-4c8a-aa17-6cfc836ce146 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:16.128544 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0474ae3f-0f16-44e4-b9c4-732eee7b06fb admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:16.129555 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a401310-000d-4c8a-aa17-6cfc836ce146 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:16.140780 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 789/1570] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:48:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:48:16.141730 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0474ae3f-0f16-44e4-b9c4-732eee7b06fb admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:16.142178 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 782/1571] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Jun 22 08:48:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:16.142817 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a401310-000d-4c8a-aa17-6cfc836ce146 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:16.153400 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a401310-000d-4c8a-aa17-6cfc836ce146 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:16.156762 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0474ae3f-0f16-44e4-b9c4-732eee7b06fb admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:16.157951 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb78b01c-664e-4e7d-9e43-4e168069855d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:16.158643 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78b01c-664e-4e7d-9e43-4e168069855d admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:16.158929 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78b01c-664e-4e7d-9e43-4e168069855d admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:16.159209 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78b01c-664e-4e7d-9e43-4e168069855d admin admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:16.159931 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb78b01c-664e-4e7d-9e43-4e168069855d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:16.160236 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb78b01c-664e-4e7d-9e43-4e168069855d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:16.161462 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba7480-42a6-4727-a164-58f6ffd728f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:16.161832 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb78b01c-664e-4e7d-9e43-4e168069855d admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:16.162408 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba7480-42a6-4727-a164-58f6ffd728f3 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:16.162695 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba7480-42a6-4727-a164-58f6ffd728f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:16.162972 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba7480-42a6-4727-a164-58f6ffd728f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:16.163701 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eba7480-42a6-4727-a164-58f6ffd728f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:16.165719 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eba7480-42a6-4727-a164-58f6ffd728f3 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:16.173828 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 783/1572] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Jun 22 08:48:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:16.173828 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb78b01c-664e-4e7d-9e43-4e168069855d admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:16.185363 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb78b01c-664e-4e7d-9e43-4e168069855d admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:16.190148 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407a5d7-869d-452f-bc82-6f166726ee13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:16.190805 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407a5d7-869d-452f-bc82-6f166726ee13 admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:16.191088 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407a5d7-869d-452f-bc82-6f166726ee13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:16.191371 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407a5d7-869d-452f-bc82-6f166726ee13 admin admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:16.192296 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b407a5d7-869d-452f-bc82-6f166726ee13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:16.193947 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: WARNING py.warnings [None req-b407a5d7-869d-452f-bc82-6f166726ee13 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 08:48:16.193947 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: warnings.warn(msg) Jun 22 08:48:16.193947 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: Jun 22 08:48:16.195245 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b407a5d7-869d-452f-bc82-6f166726ee13 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:16.199726 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 790/1573] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 08:48:16 2022] POST /identity/v3/projects => generated 389 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:16.203135 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba7480-42a6-4727-a164-58f6ffd728f3 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:16.222036 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 784/1574] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 08:48:16 2022] POST /identity/v3/projects => generated 405 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:16.223281 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407a5d7-869d-452f-bc82-6f166726ee13 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:16.271183 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:16.275939 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba7480-42a6-4727-a164-58f6ffd728f3 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:16.290603 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407a5d7-869d-452f-bc82-6f166726ee13 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:16.295146 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b2eff-c5c6-4dca-82a7-b22af46cc354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:16.295812 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b2eff-c5c6-4dca-82a7-b22af46cc354 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:16.296093 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b2eff-c5c6-4dca-82a7-b22af46cc354 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:16.296366 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b2eff-c5c6-4dca-82a7-b22af46cc354 admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:16.297097 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273b2eff-c5c6-4dca-82a7-b22af46cc354 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:16.298704 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273b2eff-c5c6-4dca-82a7-b22af46cc354 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:16.308963 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 785/1575] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:48:16 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:48:16.309780 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b2eff-c5c6-4dca-82a7-b22af46cc354 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:16.319772 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b2eff-c5c6-4dca-82a7-b22af46cc354 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:16.324541 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332639e1-4412-4e15-8585-012c9d217299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:16.325197 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332639e1-4412-4e15-8585-012c9d217299 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:16.325478 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332639e1-4412-4e15-8585-012c9d217299 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:16.325756 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332639e1-4412-4e15-8585-012c9d217299 admin admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:16.326507 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332639e1-4412-4e15-8585-012c9d217299 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:16.326812 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332639e1-4412-4e15-8585-012c9d217299 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:16.328408 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332639e1-4412-4e15-8585-012c9d217299 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:16.337939 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52296a49-8a16-4437-813a-01c06cbe985a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:16.338638 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52296a49-8a16-4437-813a-01c06cbe985a admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:16.338921 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52296a49-8a16-4437-813a-01c06cbe985a admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:16.339197 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52296a49-8a16-4437-813a-01c06cbe985a admin admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:16.339954 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52296a49-8a16-4437-813a-01c06cbe985a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:16.340262 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52296a49-8a16-4437-813a-01c06cbe985a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:16.340879 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 786/1576] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Jun 22 08:48:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:16.341755 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332639e1-4412-4e15-8585-012c9d217299 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:16.342868 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52296a49-8a16-4437-813a-01c06cbe985a admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:16.351569 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332639e1-4412-4e15-8585-012c9d217299 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:16.362216 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 791/1577] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Jun 22 08:48:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:16.362216 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52296a49-8a16-4437-813a-01c06cbe985a admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:16.362514 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde18816-1c9d-42a8-b146-6bc93c43667e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:16.362514 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde18816-1c9d-42a8-b146-6bc93c43667e admin admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:16.362514 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde18816-1c9d-42a8-b146-6bc93c43667e admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:16.362514 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde18816-1c9d-42a8-b146-6bc93c43667e admin admin] PATH_INFO: `/v3/projects/62c6c4043b9a40c68822ea688501c484/users/26fe5e737b5b4e84a1ba2d387aa6c6e4/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:16.362892 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:16.373380 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52296a49-8a16-4437-813a-01c06cbe985a admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:16.374557 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde18816-1c9d-42a8-b146-6bc93c43667e admin admin] RBAC: Authorizing `identity:create_grant(project_id=62c6c4043b9a40c68822ea688501c484, user_id=26fe5e737b5b4e84a1ba2d387aa6c6e4, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:16.377211 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde18816-1c9d-42a8-b146-6bc93c43667e admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:16.378063 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b913b9e-945b-4a16-ac60-a49fc1414eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:16.378793 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b913b9e-945b-4a16-ac60-a49fc1414eef admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:16.379108 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b913b9e-945b-4a16-ac60-a49fc1414eef admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:16.379390 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b913b9e-945b-4a16-ac60-a49fc1414eef admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:16.380076 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b913b9e-945b-4a16-ac60-a49fc1414eef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:16.382715 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b913b9e-945b-4a16-ac60-a49fc1414eef admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:16.391417 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 787/1578] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:48:16 2022] PUT /identity/v3/projects/62c6c4043b9a40c68822ea688501c484/users/26fe5e737b5b4e84a1ba2d387aa6c6e4/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:16.392193 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde18816-1c9d-42a8-b146-6bc93c43667e admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:16.413116 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 792/1579] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 08:48:16 2022] POST /identity/v3/projects => generated 367 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:16.413922 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b913b9e-945b-4a16-ac60-a49fc1414eef admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:16.457218 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde18816-1c9d-42a8-b146-6bc93c43667e admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:16.478389 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b913b9e-945b-4a16-ac60-a49fc1414eef admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:16.482998 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913bbcd3-d4a2-456f-b8bd-5c083ed9e18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:16.483661 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913bbcd3-d4a2-456f-b8bd-5c083ed9e18c admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:16.483961 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913bbcd3-d4a2-456f-b8bd-5c083ed9e18c admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:16.484229 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913bbcd3-d4a2-456f-b8bd-5c083ed9e18c admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:16.484925 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913bbcd3-d4a2-456f-b8bd-5c083ed9e18c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:16.486884 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913bbcd3-d4a2-456f-b8bd-5c083ed9e18c admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:16.507984 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 793/1580] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 08:48:16 2022] POST /identity/v3/users => generated 295 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:16.508840 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913bbcd3-d4a2-456f-b8bd-5c083ed9e18c admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:16.517938 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39289f0c-277a-491d-b6a8-89c2d70460ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:16.518568 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913bbcd3-d4a2-456f-b8bd-5c083ed9e18c admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:16.518705 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39289f0c-277a-491d-b6a8-89c2d70460ef admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:16.518927 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39289f0c-277a-491d-b6a8-89c2d70460ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:16.519204 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39289f0c-277a-491d-b6a8-89c2d70460ef admin admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:16.519896 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39289f0c-277a-491d-b6a8-89c2d70460ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:16.522466 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39289f0c-277a-491d-b6a8-89c2d70460ef admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:16.523878 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8eef06-e9c9-40a5-a5dd-3c8756cfadd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:16.524527 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8eef06-e9c9-40a5-a5dd-3c8756cfadd3 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:16.524814 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8eef06-e9c9-40a5-a5dd-3c8756cfadd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:16.525092 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8eef06-e9c9-40a5-a5dd-3c8756cfadd3 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:16.525777 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8eef06-e9c9-40a5-a5dd-3c8756cfadd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:16.527722 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8eef06-e9c9-40a5-a5dd-3c8756cfadd3 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:16.548185 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 788/1582] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 08:48:16 2022] POST /identity/v3/projects => generated 369 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:16.551435 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 794/1582] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 08:48:16 2022] POST /identity/v3/users => generated 303 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:16.551435 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8eef06-e9c9-40a5-a5dd-3c8756cfadd3 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:16.553163 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39289f0c-277a-491d-b6a8-89c2d70460ef admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:16.560303 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8eef06-e9c9-40a5-a5dd-3c8756cfadd3 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:16.604857 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:16.616241 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39289f0c-277a-491d-b6a8-89c2d70460ef admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:16.618328 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ca33d7-f12e-4626-830b-25381093d2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:16.618994 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca33d7-f12e-4626-830b-25381093d2f2 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:16.619279 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca33d7-f12e-4626-830b-25381093d2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:16.619596 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca33d7-f12e-4626-830b-25381093d2f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:16.620319 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ca33d7-f12e-4626-830b-25381093d2f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:16.620953 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca8f3f-b043-41c9-8c50-2f6f134606e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:16.621606 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca8f3f-b043-41c9-8c50-2f6f134606e2 admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:16.621893 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca8f3f-b043-41c9-8c50-2f6f134606e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:16.621989 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ca33d7-f12e-4626-830b-25381093d2f2 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:16.622275 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca8f3f-b043-41c9-8c50-2f6f134606e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:16.622998 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ca8f3f-b043-41c9-8c50-2f6f134606e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:16.624895 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ca8f3f-b043-41c9-8c50-2f6f134606e2 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:16.632680 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 795/1583] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:48:16 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:48:16.633456 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ca33d7-f12e-4626-830b-25381093d2f2 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:16.642974 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ca33d7-f12e-4626-830b-25381093d2f2 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:16.648284 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eed46e-b69f-4461-bc21-de2b80a109c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:16.648842 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:16.649000 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eed46e-b69f-4461-bc21-de2b80a109c6 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:16.649191 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eed46e-b69f-4461-bc21-de2b80a109c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:16.649463 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eed46e-b69f-4461-bc21-de2b80a109c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:16.650189 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eed46e-b69f-4461-bc21-de2b80a109c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:16.652222 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eed46e-b69f-4461-bc21-de2b80a109c6 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:16.656135 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 789/1584] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 08:48:16 2022] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:16.656719 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca8f3f-b043-41c9-8c50-2f6f134606e2 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:16.682211 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 796/1585] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 08:48:16 2022] POST /identity/v3/projects => generated 405 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:16.683040 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eed46e-b69f-4461-bc21-de2b80a109c6 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:16.728118 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca8f3f-b043-41c9-8c50-2f6f134606e2 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:16.745924 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eed46e-b69f-4461-bc21-de2b80a109c6 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:16.750453 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b9ce6b-451a-4f2d-b649-30f99f2662dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:16.751118 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b9ce6b-451a-4f2d-b649-30f99f2662dd admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:16.751434 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b9ce6b-451a-4f2d-b649-30f99f2662dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:16.751713 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b9ce6b-451a-4f2d-b649-30f99f2662dd admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:16.752433 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b9ce6b-451a-4f2d-b649-30f99f2662dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:16.754397 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b9ce6b-451a-4f2d-b649-30f99f2662dd admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:16.776314 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 797/1586] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 08:48:16 2022] POST /identity/v3/users => generated 284 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:16.777292 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b9ce6b-451a-4f2d-b649-30f99f2662dd admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:16.787285 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b9ce6b-451a-4f2d-b649-30f99f2662dd admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:16.789060 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca9351-8983-498a-a07b-f2a21e82fff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:16.789729 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca9351-8983-498a-a07b-f2a21e82fff9 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:16.790012 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca9351-8983-498a-a07b-f2a21e82fff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:16.790316 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca9351-8983-498a-a07b-f2a21e82fff9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:16.791039 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ca9351-8983-498a-a07b-f2a21e82fff9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:16.791927 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9beb6a-a665-46c5-a807-52dd28668054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:16.792575 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9beb6a-a665-46c5-a807-52dd28668054 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:16.792683 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ca9351-8983-498a-a07b-f2a21e82fff9 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:16.792864 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9beb6a-a665-46c5-a807-52dd28668054 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:16.793143 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9beb6a-a665-46c5-a807-52dd28668054 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:16.793872 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9beb6a-a665-46c5-a807-52dd28668054 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:16.795621 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9beb6a-a665-46c5-a807-52dd28668054 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:16.803990 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 790/1587] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:48:16 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:48:16.806789 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 798/1588] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:48:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:48:16.807510 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca9351-8983-498a-a07b-f2a21e82fff9 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:16.807997 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9beb6a-a665-46c5-a807-52dd28668054 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:16.818698 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9beb6a-a665-46c5-a807-52dd28668054 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:16.819000 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca9351-8983-498a-a07b-f2a21e82fff9 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:16.825603 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80dc02e-249b-46c7-8d02-73516d89bdbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:16.826317 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80dc02e-249b-46c7-8d02-73516d89bdbf admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:16.826626 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80dc02e-249b-46c7-8d02-73516d89bdbf admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:16.826920 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80dc02e-249b-46c7-8d02-73516d89bdbf admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:16.827342 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2017a670-4182-4d4e-89b6-d3363d60aceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:16.827653 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80dc02e-249b-46c7-8d02-73516d89bdbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:16.828220 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017a670-4182-4d4e-89b6-d3363d60aceb admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:16.828508 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017a670-4182-4d4e-89b6-d3363d60aceb admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:16.828788 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017a670-4182-4d4e-89b6-d3363d60aceb admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:16.829247 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80dc02e-249b-46c7-8d02-73516d89bdbf admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:16.829493 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2017a670-4182-4d4e-89b6-d3363d60aceb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:16.831668 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2017a670-4182-4d4e-89b6-d3363d60aceb admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:16.840039 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 791/1589] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:48:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:48:16.840916 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80dc02e-249b-46c7-8d02-73516d89bdbf admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:16.851176 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80dc02e-249b-46c7-8d02-73516d89bdbf admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:16.855101 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 799/1590] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 08:48:16 2022] POST /identity/v3/users => generated 285 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:16.855101 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2017a670-4182-4d4e-89b6-d3363d60aceb admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:16.856195 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d62c3c-8e4c-4639-8dbe-06045869f781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:16.857171 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d62c3c-8e4c-4639-8dbe-06045869f781 admin admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:16.857483 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d62c3c-8e4c-4639-8dbe-06045869f781 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:16.857870 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d62c3c-8e4c-4639-8dbe-06045869f781 admin admin] PATH_INFO: `/v3/projects/3a4ab81e1a914c618f9856c1758eb700/users/b5a4250771db454a88bbb1c88ed17b66/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:16.864130 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2017a670-4182-4d4e-89b6-d3363d60aceb admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:16.869763 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e68831-ddb9-439f-bc6c-08260678be19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:16.870460 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e68831-ddb9-439f-bc6c-08260678be19 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:16.870754 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e68831-ddb9-439f-bc6c-08260678be19 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:16.871037 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e68831-ddb9-439f-bc6c-08260678be19 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:16.871732 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e68831-ddb9-439f-bc6c-08260678be19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:16.873278 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d62c3c-8e4c-4639-8dbe-06045869f781 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a4ab81e1a914c618f9856c1758eb700, user_id=b5a4250771db454a88bbb1c88ed17b66, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:16.873660 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e68831-ddb9-439f-bc6c-08260678be19 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:16.875951 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d62c3c-8e4c-4639-8dbe-06045869f781 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:16.890680 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 792/1591] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:48:16 2022] PUT /identity/v3/projects/3a4ab81e1a914c618f9856c1758eb700/users/b5a4250771db454a88bbb1c88ed17b66/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:16.891682 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d62c3c-8e4c-4639-8dbe-06045869f781 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:16.894927 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 800/1592] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 08:48:16 2022] POST /identity/v3/users => generated 289 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:16.895895 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e68831-ddb9-439f-bc6c-08260678be19 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:16.906387 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e68831-ddb9-439f-bc6c-08260678be19 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:16.955040 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d62c3c-8e4c-4639-8dbe-06045869f781 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:16.960005 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc039fe3-3b16-48bb-af4e-ee0055a436b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:16.960678 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc039fe3-3b16-48bb-af4e-ee0055a436b5 admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:16.960965 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc039fe3-3b16-48bb-af4e-ee0055a436b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:16.961247 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc039fe3-3b16-48bb-af4e-ee0055a436b5 admin admin] PATH_INFO: `/v3/users` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:16.961940 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc039fe3-3b16-48bb-af4e-ee0055a436b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:16.963921 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc039fe3-3b16-48bb-af4e-ee0055a436b5 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:16.965143 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48358837-5629-4e32-888f-e6678ae70232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:16.965849 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48358837-5629-4e32-888f-e6678ae70232 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:16.966162 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48358837-5629-4e32-888f-e6678ae70232 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:16.966440 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48358837-5629-4e32-888f-e6678ae70232 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:16.967288 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48358837-5629-4e32-888f-e6678ae70232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:16.969010 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48358837-5629-4e32-888f-e6678ae70232 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:16.979498 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:16.980685 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 801/1593] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:48:16 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:48:16.981407 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48358837-5629-4e32-888f-e6678ae70232 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:16.988485 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 793/1594] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 08:48:16 2022] POST /identity/v3/users => generated 303 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:16.988485 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc039fe3-3b16-48bb-af4e-ee0055a436b5 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:16.988786 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:16.994350 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48358837-5629-4e32-888f-e6678ae70232 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:16.998693 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc039fe3-3b16-48bb-af4e-ee0055a436b5 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:17.000499 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f423dd7-fb91-4fd5-aa40-46d55ffe77a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:17.001555 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f423dd7-fb91-4fd5-aa40-46d55ffe77a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:17.001842 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f423dd7-fb91-4fd5-aa40-46d55ffe77a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:17.002133 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f423dd7-fb91-4fd5-aa40-46d55ffe77a9 admin admin] PATH_INFO: `/v3/projects/62c6c4043b9a40c68822ea688501c484/users/26fe5e737b5b4e84a1ba2d387aa6c6e4/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:17.003393 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921a38a-6492-45e6-9b20-c8f756df25a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:17.003997 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921a38a-6492-45e6-9b20-c8f756df25a1 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:17.004119 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f423dd7-fb91-4fd5-aa40-46d55ffe77a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62c6c4043b9a40c68822ea688501c484, user_id=26fe5e737b5b4e84a1ba2d387aa6c6e4, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:17.004281 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921a38a-6492-45e6-9b20-c8f756df25a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:17.004556 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921a38a-6492-45e6-9b20-c8f756df25a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:17.005287 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f921a38a-6492-45e6-9b20-c8f756df25a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:17.006810 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f423dd7-fb91-4fd5-aa40-46d55ffe77a9 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:17.006925 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f921a38a-6492-45e6-9b20-c8f756df25a1 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:17.017444 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 794/1595] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:48:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:48:17.018089 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 802/1596] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:48:16 2022] PUT /identity/v3/projects/62c6c4043b9a40c68822ea688501c484/users/26fe5e737b5b4e84a1ba2d387aa6c6e4/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:17.018363 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921a38a-6492-45e6-9b20-c8f756df25a1 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:17.021524 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f423dd7-fb91-4fd5-aa40-46d55ffe77a9 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:17.029299 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921a38a-6492-45e6-9b20-c8f756df25a1 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:17.086907 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e58cd6-6528-4ae0-88bb-d990fd96b2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:17.087575 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e58cd6-6528-4ae0-88bb-d990fd96b2db admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:17.087815 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f423dd7-fb91-4fd5-aa40-46d55ffe77a9 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:17.087936 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e58cd6-6528-4ae0-88bb-d990fd96b2db admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:17.088128 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e58cd6-6528-4ae0-88bb-d990fd96b2db admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:17.088875 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e58cd6-6528-4ae0-88bb-d990fd96b2db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:17.090562 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e58cd6-6528-4ae0-88bb-d990fd96b2db admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:17.092729 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de876b7-7e59-4f7a-8280-df41c58bb8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:17.093383 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de876b7-7e59-4f7a-8280-df41c58bb8aa admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:17.093663 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de876b7-7e59-4f7a-8280-df41c58bb8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:17.093936 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de876b7-7e59-4f7a-8280-df41c58bb8aa admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:17.094689 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de876b7-7e59-4f7a-8280-df41c58bb8aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:17.096295 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de876b7-7e59-4f7a-8280-df41c58bb8aa admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:17.101041 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 795/1597] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:48:17 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:48:17.102349 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056837d-22ff-4ef7-b9e4-a02cf3513384 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:17.102638 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056837d-22ff-4ef7-b9e4-a02cf3513384 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:17.102917 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056837d-22ff-4ef7-b9e4-a02cf3513384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:17.111882 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 803/1598] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:48:17 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:48:17.111882 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de876b7-7e59-4f7a-8280-df41c58bb8aa admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:17.120752 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de876b7-7e59-4f7a-8280-df41c58bb8aa admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:17.124038 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-2056837d-22ff-4ef7-b9e4-a02cf3513384 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:17.125236 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-2056837d-22ff-4ef7-b9e4-a02cf3513384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:17.125537 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7417c45-5439-43d8-8a4b-c4e9c6f510d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:17.126221 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7417c45-5439-43d8-8a4b-c4e9c6f510d0 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:17.126509 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7417c45-5439-43d8-8a4b-c4e9c6f510d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:17.126786 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7417c45-5439-43d8-8a4b-c4e9c6f510d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:17.127507 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7417c45-5439-43d8-8a4b-c4e9c6f510d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:17.129089 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7417c45-5439-43d8-8a4b-c4e9c6f510d0 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:17.133598 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 796/1599] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:17.134416 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2056837d-22ff-4ef7-b9e4-a02cf3513384 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:17.142797 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 804/1600] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:48:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:48:17.142797 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7417c45-5439-43d8-8a4b-c4e9c6f510d0 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:17.150372 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2056837d-22ff-4ef7-b9e4-a02cf3513384 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:17.151061 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7417c45-5439-43d8-8a4b-c4e9c6f510d0 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:17.155173 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e07507d-4feb-4ce6-bd30-33a09514301f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:17.155595 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c7670-c487-411f-8544-7927dfa2d4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:17.155835 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07507d-4feb-4ce6-bd30-33a09514301f admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:17.156145 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07507d-4feb-4ce6-bd30-33a09514301f admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:17.156265 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c7670-c487-411f-8544-7927dfa2d4b9 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:17.156419 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07507d-4feb-4ce6-bd30-33a09514301f admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:17.156522 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c7670-c487-411f-8544-7927dfa2d4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:17.156772 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c7670-c487-411f-8544-7927dfa2d4b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:17.157151 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e07507d-4feb-4ce6-bd30-33a09514301f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:17.157490 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85c7670-c487-411f-8544-7927dfa2d4b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:17.158783 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e07507d-4feb-4ce6-bd30-33a09514301f admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:17.159094 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85c7670-c487-411f-8544-7927dfa2d4b9 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:17.169715 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 797/1601] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:48:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:48:17.169917 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 805/1602] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:48:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:48:17.170475 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e07507d-4feb-4ce6-bd30-33a09514301f admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:17.170866 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626cdf1-f7e3-4315-9b0c-410d219a0d3b None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:17.171106 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626cdf1-f7e3-4315-9b0c-410d219a0d3b None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:17.171386 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626cdf1-f7e3-4315-9b0c-410d219a0d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:17.185560 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e07507d-4feb-4ce6-bd30-33a09514301f admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:17.190169 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba0008-8d11-4b3b-809d-97844655420d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:17.191051 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba0008-8d11-4b3b-809d-97844655420d admin admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:17.191327 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba0008-8d11-4b3b-809d-97844655420d admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:17.191597 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba0008-8d11-4b3b-809d-97844655420d admin admin] PATH_INFO: `/v3/projects/7139670440a6411582ebc4c8a0500bce/users/0a2c3b8979a84abf933ab3228cdff26c/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:17.202185 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-a626cdf1-f7e3-4315-9b0c-410d219a0d3b None None] MFA Rules not processed for user `26fe5e737b5b4e84a1ba2d387aa6c6e4`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:17.203443 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-a626cdf1-f7e3-4315-9b0c-410d219a0d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:17.205963 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ba0008-8d11-4b3b-809d-97844655420d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7139670440a6411582ebc4c8a0500bce, user_id=0a2c3b8979a84abf933ab3228cdff26c, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:17.208677 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ba0008-8d11-4b3b-809d-97844655420d admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:17.222570 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 798/1603] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:48:17 2022] PUT /identity/v3/projects/7139670440a6411582ebc4c8a0500bce/users/0a2c3b8979a84abf933ab3228cdff26c/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:17.223493 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba0008-8d11-4b3b-809d-97844655420d admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:17.279570 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 806/1604] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:17 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:17.280498 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a626cdf1-f7e3-4315-9b0c-410d219a0d3b None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:17.291518 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a626cdf1-f7e3-4315-9b0c-410d219a0d3b None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:17.295974 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba0008-8d11-4b3b-809d-97844655420d admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:17.296298 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a78a91-9757-49e6-a434-187f07047958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:17.296978 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a78a91-9757-49e6-a434-187f07047958 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:17.297259 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a78a91-9757-49e6-a434-187f07047958 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:17.297564 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a78a91-9757-49e6-a434-187f07047958 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:17.298321 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a78a91-9757-49e6-a434-187f07047958 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:17.299907 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a78a91-9757-49e6-a434-187f07047958 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:17.300645 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f2049-a236-4c53-b470-98c437210321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:17.301528 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f2049-a236-4c53-b470-98c437210321 admin admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:17.301815 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f2049-a236-4c53-b470-98c437210321 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:17.302098 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f2049-a236-4c53-b470-98c437210321 admin admin] PATH_INFO: `/v3/projects/e9d0843b9dbe43a0b26741a5ebcde211/users/b26c58f2e12a4824abb71088f1f3b2c8/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:17.310176 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 807/1605] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:48:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:48:17.310839 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a78a91-9757-49e6-a434-187f07047958 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:17.317104 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f2049-a236-4c53-b470-98c437210321 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9d0843b9dbe43a0b26741a5ebcde211, user_id=b26c58f2e12a4824abb71088f1f3b2c8, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:17.325018 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f2049-a236-4c53-b470-98c437210321 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:17.339943 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 799/1606] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:48:17 2022] PUT /identity/v3/projects/e9d0843b9dbe43a0b26741a5ebcde211/users/b26c58f2e12a4824abb71088f1f3b2c8/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:17.343780 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f2049-a236-4c53-b470-98c437210321 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:17.355869 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:17.370492 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:17.371381 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a78a91-9757-49e6-a434-187f07047958 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:17.408318 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f2049-a236-4c53-b470-98c437210321 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:17.413784 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd4640c-ff2f-45c7-add1-6d52bc8f6581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:17.414510 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd4640c-ff2f-45c7-add1-6d52bc8f6581 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:17.414792 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd4640c-ff2f-45c7-add1-6d52bc8f6581 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:17.415068 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd4640c-ff2f-45c7-add1-6d52bc8f6581 admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:17.415791 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd4640c-ff2f-45c7-add1-6d52bc8f6581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:17.417378 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd4640c-ff2f-45c7-add1-6d52bc8f6581 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:17.420594 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a454b-afc9-48fa-b615-fe9548ceb3d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:17.421248 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a454b-afc9-48fa-b615-fe9548ceb3d9 service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:17.421532 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a454b-afc9-48fa-b615-fe9548ceb3d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:17.421812 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a454b-afc9-48fa-b615-fe9548ceb3d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:17.429125 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 800/1607] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:48:17 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:48:17.430321 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd4640c-ff2f-45c7-add1-6d52bc8f6581 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:17.433274 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896a454b-afc9-48fa-b615-fe9548ceb3d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:17.434770 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896a454b-afc9-48fa-b615-fe9548ceb3d9 service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:17.440244 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd4640c-ff2f-45c7-add1-6d52bc8f6581 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:17.444751 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 808/1608] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:48:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:48:17.444887 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd282b-8b1c-48e4-82a5-18cc3cb435a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:17.445388 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a454b-afc9-48fa-b615-fe9548ceb3d9 service neutron] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:17.445701 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd282b-8b1c-48e4-82a5-18cc3cb435a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:17.445986 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd282b-8b1c-48e4-82a5-18cc3cb435a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:17.446294 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd282b-8b1c-48e4-82a5-18cc3cb435a4 admin admin] PATH_INFO: `/v3/projects/49526a1986384fe1ae3db8e15509d0ac/users/41bce23fb7204d37abc583101f746622/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:17.455145 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a454b-afc9-48fa-b615-fe9548ceb3d9 service neutron] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:17.460577 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1052de0-4bba-4fca-869e-dca4a66a5bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:17.461240 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1052de0-4bba-4fca-869e-dca4a66a5bb9 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:17.461611 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1052de0-4bba-4fca-869e-dca4a66a5bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:17.461802 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1052de0-4bba-4fca-869e-dca4a66a5bb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:17.462565 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1052de0-4bba-4fca-869e-dca4a66a5bb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:17.463514 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfd282b-8b1c-48e4-82a5-18cc3cb435a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49526a1986384fe1ae3db8e15509d0ac, user_id=41bce23fb7204d37abc583101f746622, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:17.464164 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1052de0-4bba-4fca-869e-dca4a66a5bb9 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:17.466182 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfd282b-8b1c-48e4-82a5-18cc3cb435a4 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:17.476826 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 809/1609] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:48:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:48:17.480311 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f74e9-81fe-4409-8d31-649f1cf7fed4 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:17.480311 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f74e9-81fe-4409-8d31-649f1cf7fed4 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:17.480311 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f74e9-81fe-4409-8d31-649f1cf7fed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:17.488111 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 801/1610] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:48:17 2022] PUT /identity/v3/projects/49526a1986384fe1ae3db8e15509d0ac/users/41bce23fb7204d37abc583101f746622/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:17.498097 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd282b-8b1c-48e4-82a5-18cc3cb435a4 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:17.498228 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-563f74e9-81fe-4409-8d31-649f1cf7fed4 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:17.498900 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-563f74e9-81fe-4409-8d31-649f1cf7fed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:17.565902 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd282b-8b1c-48e4-82a5-18cc3cb435a4 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:17.566140 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 810/1611] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:17.566851 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f74e9-81fe-4409-8d31-649f1cf7fed4 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:17.573583 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa96a9-e685-4dc5-84f4-82eecbe27b07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:17.574289 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa96a9-e685-4dc5-84f4-82eecbe27b07 service cinder] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:17.574582 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa96a9-e685-4dc5-84f4-82eecbe27b07 service cinder] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:17.574861 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa96a9-e685-4dc5-84f4-82eecbe27b07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:17.577211 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f74e9-81fe-4409-8d31-649f1cf7fed4 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:17.582948 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ca35c-674f-4dd4-9732-659568afb1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:17.584368 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ca35c-674f-4dd4-9732-659568afb1a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:17.584656 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ca35c-674f-4dd4-9732-659568afb1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:17.584932 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ca35c-674f-4dd4-9732-659568afb1a1 admin admin] PATH_INFO: `/v3/projects/3b11a98bf8074dd5b6b073923b941132/users/572340f4eea9423a8579ab0003e5f35e/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:17.602501 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7ca35c-674f-4dd4-9732-659568afb1a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b11a98bf8074dd5b6b073923b941132, user_id=572340f4eea9423a8579ab0003e5f35e, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:17.605728 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7ca35c-674f-4dd4-9732-659568afb1a1 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:17.622113 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 811/1612] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:48:17 2022] PUT /identity/v3/projects/3b11a98bf8074dd5b6b073923b941132/users/572340f4eea9423a8579ab0003e5f35e/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:17.623478 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9de149-c967-4f1e-85b4-df9a038fc306 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:17.623847 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9de149-c967-4f1e-85b4-df9a038fc306 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:17.624039 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9de149-c967-4f1e-85b4-df9a038fc306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:17.650151 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-cf9de149-c967-4f1e-85b4-df9a038fc306 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:17.651390 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-cf9de149-c967-4f1e-85b4-df9a038fc306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:17.672982 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaa96a9-e685-4dc5-84f4-82eecbe27b07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:17.675247 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaa96a9-e685-4dc5-84f4-82eecbe27b07 service cinder] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:17.689074 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 802/1613] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:48:17 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:48:17.689814 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa96a9-e685-4dc5-84f4-82eecbe27b07 service cinder] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:17.702935 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa96a9-e685-4dc5-84f4-82eecbe27b07 service cinder] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:17.735392 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 812/1614] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:17.736477 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9de149-c967-4f1e-85b4-df9a038fc306 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:17.741531 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:17.758527 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9de149-c967-4f1e-85b4-df9a038fc306 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:17.764399 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c79f98-9035-44a1-853d-7dd39d0a1a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:17.765365 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c79f98-9035-44a1-853d-7dd39d0a1a92 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:17.766044 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c79f98-9035-44a1-853d-7dd39d0a1a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:17.766369 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c79f98-9035-44a1-853d-7dd39d0a1a92 admin admin] PATH_INFO: `/v3/projects/0196ef65c7ad402188d215f0447037fa/users/9eb6ccabe7d9486196041062dcf0b518/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:17.770485 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:17.786485 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c79f98-9035-44a1-853d-7dd39d0a1a92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0196ef65c7ad402188d215f0447037fa, user_id=9eb6ccabe7d9486196041062dcf0b518, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:17.789948 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8783520-c7c3-4d41-924d-3f2f9eba036a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:17.790621 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c79f98-9035-44a1-853d-7dd39d0a1a92 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:17.791023 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8783520-c7c3-4d41-924d-3f2f9eba036a admin admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:17.791386 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8783520-c7c3-4d41-924d-3f2f9eba036a admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:17.791740 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8783520-c7c3-4d41-924d-3f2f9eba036a admin admin] PATH_INFO: `/v3/projects/2737e16ccd874352b9e731e7ed64ba90/users/7dc678cd12ee45809813046f76faf018/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:17.812747 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8783520-c7c3-4d41-924d-3f2f9eba036a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2737e16ccd874352b9e731e7ed64ba90, user_id=7dc678cd12ee45809813046f76faf018, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:17.815580 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8783520-c7c3-4d41-924d-3f2f9eba036a admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:17.822244 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 813/1615] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:48:17 2022] PUT /identity/v3/projects/0196ef65c7ad402188d215f0447037fa/users/9eb6ccabe7d9486196041062dcf0b518/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:17.823958 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb3acc5-db09-4615-bc44-f198af475c0e None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:17.824255 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb3acc5-db09-4615-bc44-f198af475c0e None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:17.824540 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb3acc5-db09-4615-bc44-f198af475c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:17.832395 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 803/1616] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:48:17 2022] PUT /identity/v3/projects/2737e16ccd874352b9e731e7ed64ba90/users/7dc678cd12ee45809813046f76faf018/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:17.834175 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8783520-c7c3-4d41-924d-3f2f9eba036a admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:17.859385 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-7cb3acc5-db09-4615-bc44-f198af475c0e None None] MFA Rules not processed for user `41bce23fb7204d37abc583101f746622`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:17.861647 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-7cb3acc5-db09-4615-bc44-f198af475c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:17.919409 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8783520-c7c3-4d41-924d-3f2f9eba036a admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:17.924235 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ac888-5b0b-4ba6-ae5d-b4addae9ab44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:17.925261 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ac888-5b0b-4ba6-ae5d-b4addae9ab44 service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:17.925598 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ac888-5b0b-4ba6-ae5d-b4addae9ab44 service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:17.925880 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ac888-5b0b-4ba6-ae5d-b4addae9ab44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:17.963107 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 814/1617] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:17 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:17.965158 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22e4b1-5d50-404b-ab76-ff8fdbb2fcbb None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:17.965445 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22e4b1-5d50-404b-ab76-ff8fdbb2fcbb None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:17.965724 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22e4b1-5d50-404b-ab76-ff8fdbb2fcbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:17.996424 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-5b22e4b1-5d50-404b-ab76-ff8fdbb2fcbb None None] MFA Rules not processed for user `572340f4eea9423a8579ab0003e5f35e`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:17.997682 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-5b22e4b1-5d50-404b-ab76-ff8fdbb2fcbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:18.035580 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7ac888-5b0b-4ba6-ae5d-b4addae9ab44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:18.038813 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7ac888-5b0b-4ba6-ae5d-b4addae9ab44 service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:18.052922 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 804/1618] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:48:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:48:18.057760 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ac888-5b0b-4ba6-ae5d-b4addae9ab44 service neutron] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:18.057760 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-0b7ac888-5b0b-4ba6-ae5d-b4addae9ab44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:18.074459 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ac888-5b0b-4ba6-ae5d-b4addae9ab44 service neutron] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:18.080906 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ade8ce-a40b-452a-a656-8c8ac034a2b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:18.082008 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ade8ce-a40b-452a-a656-8c8ac034a2b8 service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:18.082555 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ade8ce-a40b-452a-a656-8c8ac034a2b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:18.083075 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ade8ce-a40b-452a-a656-8c8ac034a2b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:18.103950 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ade8ce-a40b-452a-a656-8c8ac034a2b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:18.106147 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ade8ce-a40b-452a-a656-8c8ac034a2b8 service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:18.123691 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 805/1619] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:48:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:48:18.128719 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 815/1620] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:17 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:18.129143 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06743d48-c4c4-4b92-8ed1-57d94b651437 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:18.129143 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06743d48-c4c4-4b92-8ed1-57d94b651437 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:18.129143 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06743d48-c4c4-4b92-8ed1-57d94b651437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:18.129357 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8548262-17a0-4dca-9fac-db8114a90424 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:18.129357 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8548262-17a0-4dca-9fac-db8114a90424 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:18.129357 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8548262-17a0-4dca-9fac-db8114a90424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:18.168217 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-06743d48-c4c4-4b92-8ed1-57d94b651437 None None] MFA Rules not processed for user `9eb6ccabe7d9486196041062dcf0b518`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:18.169751 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-06743d48-c4c4-4b92-8ed1-57d94b651437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:18.175663 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-b8548262-17a0-4dca-9fac-db8114a90424 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:18.177140 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-b8548262-17a0-4dca-9fac-db8114a90424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:18.195438 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 816/1621] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:18.199684 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8548262-17a0-4dca-9fac-db8114a90424 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:18.293868 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8548262-17a0-4dca-9fac-db8114a90424 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:18.299081 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7449abf8-93e3-49ec-9b57-dbab3dea17d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:18.308715 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7449abf8-93e3-49ec-9b57-dbab3dea17d4 service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:18.308715 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7449abf8-93e3-49ec-9b57-dbab3dea17d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:18.308715 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7449abf8-93e3-49ec-9b57-dbab3dea17d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:18.308715 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:18.312271 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7449abf8-93e3-49ec-9b57-dbab3dea17d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:18.315943 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7449abf8-93e3-49ec-9b57-dbab3dea17d4 service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:18.336647 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:18.337170 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 817/1622] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:48:18 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:48:18.338637 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7449abf8-93e3-49ec-9b57-dbab3dea17d4 service cinder] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:18.362779 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 806/1623] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:18 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:18.366840 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06743d48-c4c4-4b92-8ed1-57d94b651437 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:18.373300 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7449abf8-93e3-49ec-9b57-dbab3dea17d4 service cinder] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:18.383231 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3950847-c905-4874-bcdb-86a711909fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:18.384377 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3950847-c905-4874-bcdb-86a711909fa2 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:18.384761 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3950847-c905-4874-bcdb-86a711909fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:18.385156 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3950847-c905-4874-bcdb-86a711909fa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:18.386588 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3950847-c905-4874-bcdb-86a711909fa2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:18.389178 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3950847-c905-4874-bcdb-86a711909fa2 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:18.405284 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06743d48-c4c4-4b92-8ed1-57d94b651437 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:18.415692 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ee67a-22b3-40e9-aa1a-3879e8a03b9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:18.418675 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ee67a-22b3-40e9-aa1a-3879e8a03b9a service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:18.419019 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ee67a-22b3-40e9-aa1a-3879e8a03b9a service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:18.419306 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ee67a-22b3-40e9-aa1a-3879e8a03b9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:18.440672 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ee67a-22b3-40e9-aa1a-3879e8a03b9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:18.443597 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ee67a-22b3-40e9-aa1a-3879e8a03b9a service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:18.450987 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 818/1624] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 08:48:18 2022] POST /identity/v3/projects => generated 365 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:18.454011 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3950847-c905-4874-bcdb-86a711909fa2 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:18.456926 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 807/1625] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:48:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:48:18.457916 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ee67a-22b3-40e9-aa1a-3879e8a03b9a service neutron] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:18.471362 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ee67a-22b3-40e9-aa1a-3879e8a03b9a service neutron] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:18.537226 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351e84bc-6fe9-4614-aeaa-de1c46234849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:18.538398 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e84bc-6fe9-4614-aeaa-de1c46234849 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:18.538520 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e84bc-6fe9-4614-aeaa-de1c46234849 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:18.538757 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e84bc-6fe9-4614-aeaa-de1c46234849 admin admin] PATH_INFO: `/v3/users/8a9cb369ad0d4d09b237fa6ea0c69871` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:18.540367 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351e84bc-6fe9-4614-aeaa-de1c46234849 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a9cb369ad0d4d09b237fa6ea0c69871)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:18.541627 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: WARNING py.warnings [None req-351e84bc-6fe9-4614-aeaa-de1c46234849 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 08:48:18.541627 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: warnings.warn(msg) Jun 22 08:48:18.541627 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: Jun 22 08:48:18.543067 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351e84bc-6fe9-4614-aeaa-de1c46234849 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:18.605266 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3950847-c905-4874-bcdb-86a711909fa2 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:18.612279 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91df01e0-c14c-4480-99d1-05cff7a6d07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:18.618969 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df01e0-c14c-4480-99d1-05cff7a6d07c admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:18.619349 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df01e0-c14c-4480-99d1-05cff7a6d07c admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:18.619690 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df01e0-c14c-4480-99d1-05cff7a6d07c admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:18.620733 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91df01e0-c14c-4480-99d1-05cff7a6d07c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:18.623123 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91df01e0-c14c-4480-99d1-05cff7a6d07c admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:18.654615 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-351e84bc-6fe9-4614-aeaa-de1c46234849 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a9cb369ad0d4d09b237fa6ea0c69871'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:18.692389 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-351e84bc-6fe9-4614-aeaa-de1c46234849 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a9cb369ad0d4d09b237fa6ea0c69871'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:18.692734 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-351e84bc-6fe9-4614-aeaa-de1c46234849 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a9cb369ad0d4d09b237fa6ea0c69871'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:18.702877 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 819/1626] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 08:48:18 2022] POST /identity/v3/projects => generated 403 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:18.703449 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91df01e0-c14c-4480-99d1-05cff7a6d07c admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:18.719404 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-351e84bc-6fe9-4614-aeaa-de1c46234849 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a9cb369ad0d4d09b237fa6ea0c69871'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:18.720980 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-351e84bc-6fe9-4614-aeaa-de1c46234849 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a9cb369ad0d4d09b237fa6ea0c69871'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:18.778151 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 808/1627] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 08:48:18 2022] DELETE /identity/v3/users/8a9cb369ad0d4d09b237fa6ea0c69871 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:18.779054 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351e84bc-6fe9-4614-aeaa-de1c46234849 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:18.783935 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-351e84bc-6fe9-4614-aeaa-de1c46234849 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:18.860567 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91df01e0-c14c-4480-99d1-05cff7a6d07c admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:18.936555 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351e84bc-6fe9-4614-aeaa-de1c46234849 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:18.953319 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8592f5f1-b23a-4d0c-aada-2711182f4659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:18.954021 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8592f5f1-b23a-4d0c-aada-2711182f4659 admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:18.954329 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8592f5f1-b23a-4d0c-aada-2711182f4659 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:18.954676 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8592f5f1-b23a-4d0c-aada-2711182f4659 admin admin] PATH_INFO: `/v3/users` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:18.955391 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8592f5f1-b23a-4d0c-aada-2711182f4659 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:18.960793 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8592f5f1-b23a-4d0c-aada-2711182f4659 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:18.977355 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:19.012755 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e92eea2-54e0-443b-9bd0-45ce15d660f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:19.013519 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e92eea2-54e0-443b-9bd0-45ce15d660f7 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:19.014034 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e92eea2-54e0-443b-9bd0-45ce15d660f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:19.014575 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e92eea2-54e0-443b-9bd0-45ce15d660f7 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:19.015914 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e92eea2-54e0-443b-9bd0-45ce15d660f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:19.018285 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e92eea2-54e0-443b-9bd0-45ce15d660f7 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:19.021784 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 809/1628] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 08:48:18 2022] POST /identity/v3/users => generated 308 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:19.023185 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf84c7af-cde6-4676-a197-27da6d3b5605 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:19.023477 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf84c7af-cde6-4676-a197-27da6d3b5605 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:19.023755 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf84c7af-cde6-4676-a197-27da6d3b5605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:19.050911 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:19.058592 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-bf84c7af-cde6-4676-a197-27da6d3b5605 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:19.060389 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-bf84c7af-cde6-4676-a197-27da6d3b5605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:19.070646 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 820/1629] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 08:48:18 2022] POST /identity/v3/users => generated 289 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:19.070646 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e92eea2-54e0-443b-9bd0-45ce15d660f7 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:19.092487 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 810/1630] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:19.092487 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf84c7af-cde6-4676-a197-27da6d3b5605 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:19.106417 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e92eea2-54e0-443b-9bd0-45ce15d660f7 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:19.108859 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-bf84c7af-cde6-4676-a197-27da6d3b5605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:19.119855 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b38de0-deb9-402e-9f59-74fb71bd2ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:19.120548 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b38de0-deb9-402e-9f59-74fb71bd2ab9 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:19.120840 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b38de0-deb9-402e-9f59-74fb71bd2ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:19.125753 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b38de0-deb9-402e-9f59-74fb71bd2ab9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:19.126675 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b38de0-deb9-402e-9f59-74fb71bd2ab9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:19.128247 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b38de0-deb9-402e-9f59-74fb71bd2ab9 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:19.154511 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf84c7af-cde6-4676-a197-27da6d3b5605 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:19.173724 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7008179c-c60d-43c9-87df-554df35de203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:19.174736 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 821/1631] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:48:19 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:48:19.178016 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008179c-c60d-43c9-87df-554df35de203 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:19.178016 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008179c-c60d-43c9-87df-554df35de203 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:19.178303 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008179c-c60d-43c9-87df-554df35de203 admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:19.178950 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7008179c-c60d-43c9-87df-554df35de203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:19.180607 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7008179c-c60d-43c9-87df-554df35de203 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:19.180835 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b38de0-deb9-402e-9f59-74fb71bd2ab9 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:19.184693 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-f2b38de0-deb9-402e-9f59-74fb71bd2ab9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:19.228491 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 811/1632] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:48:19 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:48:19.230694 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7008179c-c60d-43c9-87df-554df35de203 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:19.265028 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7008179c-c60d-43c9-87df-554df35de203 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:19.286899 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abbcc35-e659-4c39-8d25-247263269e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:19.287816 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abbcc35-e659-4c39-8d25-247263269e18 admin admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:19.288237 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abbcc35-e659-4c39-8d25-247263269e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:19.288529 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abbcc35-e659-4c39-8d25-247263269e18 admin admin] PATH_INFO: `/v3/projects/10acfedb64db47409bd74f9d8b375194/users/6a2d7c56654b4b5eaffbbde47ded1cef/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:19.359845 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abbcc35-e659-4c39-8d25-247263269e18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10acfedb64db47409bd74f9d8b375194, user_id=6a2d7c56654b4b5eaffbbde47ded1cef, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:19.373869 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abbcc35-e659-4c39-8d25-247263269e18 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:19.409812 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b38de0-deb9-402e-9f59-74fb71bd2ab9 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:19.411127 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 812/1633] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:48:19 2022] PUT /identity/v3/projects/10acfedb64db47409bd74f9d8b375194/users/6a2d7c56654b4b5eaffbbde47ded1cef/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:19.411785 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abbcc35-e659-4c39-8d25-247263269e18 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:19.541396 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f782e6df-13a0-4cc9-b2da-cd84bf0e2e83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:19.542194 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782e6df-13a0-4cc9-b2da-cd84bf0e2e83 service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:19.542526 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782e6df-13a0-4cc9-b2da-cd84bf0e2e83 service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:19.542958 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782e6df-13a0-4cc9-b2da-cd84bf0e2e83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:19.600798 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abbcc35-e659-4c39-8d25-247263269e18 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:19.612720 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64906646-c8c6-4c84-9362-18c7381f6013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:19.613581 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64906646-c8c6-4c84-9362-18c7381f6013 admin admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:19.613861 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64906646-c8c6-4c84-9362-18c7381f6013 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:19.614165 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64906646-c8c6-4c84-9362-18c7381f6013 admin admin] PATH_INFO: `/v3/projects/4a14a9ad54134d87b512ed900ff6cbf2/users/46440839b56840849d48429cbf4f80e2/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:19.639855 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64906646-c8c6-4c84-9362-18c7381f6013 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a14a9ad54134d87b512ed900ff6cbf2, user_id=46440839b56840849d48429cbf4f80e2, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:19.644563 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64906646-c8c6-4c84-9362-18c7381f6013 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:19.667884 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f782e6df-13a0-4cc9-b2da-cd84bf0e2e83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:19.672104 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f782e6df-13a0-4cc9-b2da-cd84bf0e2e83 service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:19.672301 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 813/1634] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:48:19 2022] PUT /identity/v3/projects/4a14a9ad54134d87b512ed900ff6cbf2/users/46440839b56840849d48429cbf4f80e2/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:19.672709 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64906646-c8c6-4c84-9362-18c7381f6013 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:19.697217 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 822/1635] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:48:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:48:19.698359 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f782e6df-13a0-4cc9-b2da-cd84bf0e2e83 service neutron] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:19.718890 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f782e6df-13a0-4cc9-b2da-cd84bf0e2e83 service neutron] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:19.752669 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64906646-c8c6-4c84-9362-18c7381f6013 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:19.762757 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2ed27-f1f2-4c0b-baa3-b0051d9a68b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:19.763737 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2ed27-f1f2-4c0b-baa3-b0051d9a68b8 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:19.765209 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2ed27-f1f2-4c0b-baa3-b0051d9a68b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:19.765209 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2ed27-f1f2-4c0b-baa3-b0051d9a68b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:19.765417 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d2ed27-f1f2-4c0b-baa3-b0051d9a68b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:19.767996 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d2ed27-f1f2-4c0b-baa3-b0051d9a68b8 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:19.781815 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 814/1636] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:48:19 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:48:19.785859 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2ed27-f1f2-4c0b-baa3-b0051d9a68b8 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:19.826433 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2ed27-f1f2-4c0b-baa3-b0051d9a68b8 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:19.828757 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:19.832248 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fda6fc1-0fb5-4dee-a766-3877ba86ecc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:19.834050 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda6fc1-0fb5-4dee-a766-3877ba86ecc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:19.834468 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda6fc1-0fb5-4dee-a766-3877ba86ecc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:19.834743 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda6fc1-0fb5-4dee-a766-3877ba86ecc4 admin admin] PATH_INFO: `/v3/projects/10acfedb64db47409bd74f9d8b375194/users/6a2d7c56654b4b5eaffbbde47ded1cef/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:19.838414 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fda6fc1-0fb5-4dee-a766-3877ba86ecc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10acfedb64db47409bd74f9d8b375194, user_id=6a2d7c56654b4b5eaffbbde47ded1cef, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:19.841259 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fda6fc1-0fb5-4dee-a766-3877ba86ecc4 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:19.855578 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060e7d66-e3cf-4672-a072-63a8ea0dca8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:19.857151 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e7d66-e3cf-4672-a072-63a8ea0dca8d admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:19.859007 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e7d66-e3cf-4672-a072-63a8ea0dca8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:19.860019 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e7d66-e3cf-4672-a072-63a8ea0dca8d admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:19.862317 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060e7d66-e3cf-4672-a072-63a8ea0dca8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:19.866802 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060e7d66-e3cf-4672-a072-63a8ea0dca8d admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:19.872704 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 815/1637] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:48:19 2022] PUT /identity/v3/projects/10acfedb64db47409bd74f9d8b375194/users/6a2d7c56654b4b5eaffbbde47ded1cef/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:19.885320 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dcf84c-3c07-4e01-b74a-1498e3e75adf None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:19.885800 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dcf84c-3c07-4e01-b74a-1498e3e75adf None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:19.885981 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dcf84c-3c07-4e01-b74a-1498e3e75adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:19.890951 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 823/1638] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:48:19 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:48:19.899132 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060e7d66-e3cf-4672-a072-63a8ea0dca8d admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:19.913401 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060e7d66-e3cf-4672-a072-63a8ea0dca8d admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:19.941777 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-a4dcf84c-3c07-4e01-b74a-1498e3e75adf None None] MFA Rules not processed for user `6a2d7c56654b4b5eaffbbde47ded1cef`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:19.943800 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-a4dcf84c-3c07-4e01-b74a-1498e3e75adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:19.953678 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:20.014605 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94abdc62-6ba7-4d06-97d0-c79954b3222b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:20.015872 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94abdc62-6ba7-4d06-97d0-c79954b3222b admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:20.016281 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94abdc62-6ba7-4d06-97d0-c79954b3222b admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:20.016831 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94abdc62-6ba7-4d06-97d0-c79954b3222b admin admin] PATH_INFO: `/v3/projects/4a14a9ad54134d87b512ed900ff6cbf2/users/46440839b56840849d48429cbf4f80e2/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:20.019352 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94abdc62-6ba7-4d06-97d0-c79954b3222b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a14a9ad54134d87b512ed900ff6cbf2, user_id=46440839b56840849d48429cbf4f80e2, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:20.023591 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94abdc62-6ba7-4d06-97d0-c79954b3222b admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:20.054769 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 824/1639] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:48:19 2022] PUT /identity/v3/projects/4a14a9ad54134d87b512ed900ff6cbf2/users/46440839b56840849d48429cbf4f80e2/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:20.058290 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 816/1640] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:19 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:20.058864 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663962f-b99e-43c6-8edd-f0851310b0c0 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:20.060167 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663962f-b99e-43c6-8edd-f0851310b0c0 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:20.060466 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663962f-b99e-43c6-8edd-f0851310b0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:20.070189 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dcf84c-3c07-4e01-b74a-1498e3e75adf None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:20.072104 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-a4dcf84c-3c07-4e01-b74a-1498e3e75adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:20.109878 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-7663962f-b99e-43c6-8edd-f0851310b0c0 None None] MFA Rules not processed for user `46440839b56840849d48429cbf4f80e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:20.111476 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-7663962f-b99e-43c6-8edd-f0851310b0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:20.195865 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dcf84c-3c07-4e01-b74a-1498e3e75adf None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:20.241085 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 825/1641] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:20 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 08:48:20.252287 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7663962f-b99e-43c6-8edd-f0851310b0c0 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:20.253760 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-7663962f-b99e-43c6-8edd-f0851310b0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:20.270617 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e59798-9123-4c42-8c37-4969957f3b96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:20.272077 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e59798-9123-4c42-8c37-4969957f3b96 service cinder] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:20.272262 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e59798-9123-4c42-8c37-4969957f3b96 service cinder] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:20.272533 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e59798-9123-4c42-8c37-4969957f3b96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:20.353202 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e59798-9123-4c42-8c37-4969957f3b96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:20.354813 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e59798-9123-4c42-8c37-4969957f3b96 service cinder] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:20.361658 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7663962f-b99e-43c6-8edd-f0851310b0c0 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:20.366296 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc629d2-4b67-4724-bff1-85366ffba1aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:20.366952 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc629d2-4b67-4724-bff1-85366ffba1aa service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:20.367133 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 817/1642] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:48:20 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:48:20.367259 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc629d2-4b67-4724-bff1-85366ffba1aa service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:20.367494 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc629d2-4b67-4724-bff1-85366ffba1aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:20.377827 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc629d2-4b67-4724-bff1-85366ffba1aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:20.379595 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc629d2-4b67-4724-bff1-85366ffba1aa service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:20.397194 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 826/1643] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:48:20 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:48:20.759265 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e59798-9123-4c42-8c37-4969957f3b96 service cinder] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:20.778011 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:21.012543 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e59798-9123-4c42-8c37-4969957f3b96 service cinder] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:21.012543 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625de3c3-aee8-41c3-8103-6ff8811b3cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:21.012543 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625de3c3-aee8-41c3-8103-6ff8811b3cc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:21.012543 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625de3c3-aee8-41c3-8103-6ff8811b3cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:21.017319 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625de3c3-aee8-41c3-8103-6ff8811b3cc9 admin admin] PATH_INFO: `/v3/users/9eb6ccabe7d9486196041062dcf0b518` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:21.017319 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625de3c3-aee8-41c3-8103-6ff8811b3cc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9eb6ccabe7d9486196041062dcf0b518)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:21.017319 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625de3c3-aee8-41c3-8103-6ff8811b3cc9 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:21.110551 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6194d-10dc-4ad2-9c28-9ce762775db7 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:21.111408 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6194d-10dc-4ad2-9c28-9ce762775db7 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:21.111787 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6194d-10dc-4ad2-9c28-9ce762775db7 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:21.112062 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-625de3c3-aee8-41c3-8103-6ff8811b3cc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9eb6ccabe7d9486196041062dcf0b518'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:21.113578 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 827/1644] 10.222.0.42 () {54 vars in 961 bytes} [Wed Jun 22 08:48:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:48:21.122146 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51794145-5a6f-4ffc-a7b1-d927d4492353 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:21.122415 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51794145-5a6f-4ffc-a7b1-d927d4492353 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:21.122703 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51794145-5a6f-4ffc-a7b1-d927d4492353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:21.125656 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-625de3c3-aee8-41c3-8103-6ff8811b3cc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9eb6ccabe7d9486196041062dcf0b518'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:21.127918 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-625de3c3-aee8-41c3-8103-6ff8811b3cc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9eb6ccabe7d9486196041062dcf0b518'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:21.151900 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-625de3c3-aee8-41c3-8103-6ff8811b3cc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9eb6ccabe7d9486196041062dcf0b518'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:21.152354 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:21.152988 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-625de3c3-aee8-41c3-8103-6ff8811b3cc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9eb6ccabe7d9486196041062dcf0b518'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:21.167131 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-51794145-5a6f-4ffc-a7b1-d927d4492353 None None] MFA Rules not processed for user `4f1809a35b244c1db7a185d82859369e`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:21.168498 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-51794145-5a6f-4ffc-a7b1-d927d4492353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:21.186434 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 818/1645] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 08:48:20 2022] DELETE /identity/v3/users/9eb6ccabe7d9486196041062dcf0b518 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:21.197182 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16785eab-d8d7-4572-ae06-e9befbc22049 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:21.197490 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16785eab-d8d7-4572-ae06-e9befbc22049 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:21.197771 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16785eab-d8d7-4572-ae06-e9befbc22049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:21.239308 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-16785eab-d8d7-4572-ae06-e9befbc22049 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:21.241102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-16785eab-d8d7-4572-ae06-e9befbc22049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:21.311599 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 828/1646] 10.222.0.42 () {58 vars in 1058 bytes} [Wed Jun 22 08:48:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jun 22 08:48:21.320656 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9cfa6-6200-4aed-9029-52f3ac8d14ab None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:21.320948 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9cfa6-6200-4aed-9029-52f3ac8d14ab None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:21.321227 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9cfa6-6200-4aed-9029-52f3ac8d14ab None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:21.323976 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 829/1647] 10.222.0.42 () {54 vars in 912 bytes} [Wed Jun 22 08:48:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:48:21.329489 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a419193-18a7-40a5-8874-7b6ff32ecb24 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:21.329783 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a419193-18a7-40a5-8874-7b6ff32ecb24 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:21.330142 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a419193-18a7-40a5-8874-7b6ff32ecb24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:21.368136 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-7a419193-18a7-40a5-8874-7b6ff32ecb24 None None] MFA Rules not processed for user `4f1809a35b244c1db7a185d82859369e`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:21.374908 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-7a419193-18a7-40a5-8874-7b6ff32ecb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:21.417317 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 819/1648] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:21.486622 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16785eab-d8d7-4572-ae06-e9befbc22049 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:21.489263 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-16785eab-d8d7-4572-ae06-e9befbc22049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:21.556572 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 830/1649] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Jun 22 08:48:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:21.572798 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:21.584848 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a419193-18a7-40a5-8874-7b6ff32ecb24 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:21.590476 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-7a419193-18a7-40a5-8874-7b6ff32ecb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:21.661780 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16785eab-d8d7-4572-ae06-e9befbc22049 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:21.672689 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b56804a-154d-4e3a-a913-68690af583f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:21.674319 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b56804a-154d-4e3a-a913-68690af583f7 service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:21.674647 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b56804a-154d-4e3a-a913-68690af583f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:21.675421 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b56804a-154d-4e3a-a913-68690af583f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:21.704972 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b56804a-154d-4e3a-a913-68690af583f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:21.707302 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b56804a-154d-4e3a-a913-68690af583f7 service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:21.732105 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 820/1650] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:48:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:48:21.735013 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a419193-18a7-40a5-8874-7b6ff32ecb24 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:21.744027 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff4af3-d32c-4c0d-9f17-6b590b598c36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:21.744869 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff4af3-d32c-4c0d-9f17-6b590b598c36 service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:21.745153 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff4af3-d32c-4c0d-9f17-6b590b598c36 service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:21.745428 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff4af3-d32c-4c0d-9f17-6b590b598c36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:21.761412 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ff4af3-d32c-4c0d-9f17-6b590b598c36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:21.763286 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ff4af3-d32c-4c0d-9f17-6b590b598c36 service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:21.784440 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 831/1651] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:48:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:48:22.329523 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b56804a-154d-4e3a-a913-68690af583f7 service neutron] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:22.331129 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-2b56804a-154d-4e3a-a913-68690af583f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:22.353847 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b56804a-154d-4e3a-a913-68690af583f7 service neutron] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:22.363598 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d3bb4-c7f0-4a3c-8837-58b080344215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:22.367912 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d3bb4-c7f0-4a3c-8837-58b080344215 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:22.368093 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d3bb4-c7f0-4a3c-8837-58b080344215 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:22.368389 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d3bb4-c7f0-4a3c-8837-58b080344215 admin admin] PATH_INFO: `/v3/projects/a1d4d027d5f540d6ac0ce56bcca26da0` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:22.372107 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374d3bb4-c7f0-4a3c-8837-58b080344215 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1d4d027d5f540d6ac0ce56bcca26da0)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:22.375287 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374d3bb4-c7f0-4a3c-8837-58b080344215 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:22.497724 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-374d3bb4-c7f0-4a3c-8837-58b080344215 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1d4d027d5f540d6ac0ce56bcca26da0', 'request_id': 'req-374d3bb4-c7f0-4a3c-8837-58b080344215'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:22.522807 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-374d3bb4-c7f0-4a3c-8837-58b080344215 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1d4d027d5f540d6ac0ce56bcca26da0', 'request_id': 'req-374d3bb4-c7f0-4a3c-8837-58b080344215'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:22.537151 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-374d3bb4-c7f0-4a3c-8837-58b080344215 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1d4d027d5f540d6ac0ce56bcca26da0', 'request_id': 'req-374d3bb4-c7f0-4a3c-8837-58b080344215'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:22.568773 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-374d3bb4-c7f0-4a3c-8837-58b080344215 admin admin] The token cache is being invalidate because project a1d4d027d5f540d6ac0ce56bcca26da0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 08:48:22.569067 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-374d3bb4-c7f0-4a3c-8837-58b080344215 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:22.606636 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-374d3bb4-c7f0-4a3c-8837-58b080344215 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:22.606636 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 821/1652] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 08:48:22 2022] DELETE /identity/v3/projects/a1d4d027d5f540d6ac0ce56bcca26da0 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:22.607444 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff4af3-d32c-4c0d-9f17-6b590b598c36 service cinder] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:22.624579 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff4af3-d32c-4c0d-9f17-6b590b598c36 service cinder] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:22.793836 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:22.913078 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b7bca-193f-466c-b71d-1515758dac64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:22.913905 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b7bca-193f-466c-b71d-1515758dac64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:22.914220 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b7bca-193f-466c-b71d-1515758dac64 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:22.914500 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b7bca-193f-466c-b71d-1515758dac64 admin admin] PATH_INFO: `/v3/users/26fe5e737b5b4e84a1ba2d387aa6c6e4` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:22.922592 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4b7bca-193f-466c-b71d-1515758dac64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26fe5e737b5b4e84a1ba2d387aa6c6e4)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:22.924609 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4b7bca-193f-466c-b71d-1515758dac64 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:23.076024 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-7d4b7bca-193f-466c-b71d-1515758dac64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26fe5e737b5b4e84a1ba2d387aa6c6e4'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:23.097002 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-7d4b7bca-193f-466c-b71d-1515758dac64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26fe5e737b5b4e84a1ba2d387aa6c6e4'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:23.101556 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-7d4b7bca-193f-466c-b71d-1515758dac64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26fe5e737b5b4e84a1ba2d387aa6c6e4'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:23.129596 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-7d4b7bca-193f-466c-b71d-1515758dac64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26fe5e737b5b4e84a1ba2d387aa6c6e4'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:23.130545 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-7d4b7bca-193f-466c-b71d-1515758dac64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26fe5e737b5b4e84a1ba2d387aa6c6e4'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:23.177689 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 832/1653] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 08:48:22 2022] DELETE /identity/v3/users/26fe5e737b5b4e84a1ba2d387aa6c6e4 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:23.378371 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5482e15-830a-4648-89af-f5e8bfb29789 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:23.379643 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5482e15-830a-4648-89af-f5e8bfb29789 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:23.380118 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5482e15-830a-4648-89af-f5e8bfb29789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:23.450671 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-f5482e15-830a-4648-89af-f5e8bfb29789 None None] MFA Rules not processed for user `b26c58f2e12a4824abb71088f1f3b2c8`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:23.451932 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-f5482e15-830a-4648-89af-f5e8bfb29789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:23.530510 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b7bca-193f-466c-b71d-1515758dac64 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:23.532825 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-7d4b7bca-193f-466c-b71d-1515758dac64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:23.631802 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 822/1654] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:23 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:23.632960 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5482e15-830a-4648-89af-f5e8bfb29789 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:23.637458 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-f5482e15-830a-4648-89af-f5e8bfb29789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:23.716988 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b7bca-193f-466c-b71d-1515758dac64 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:23.731050 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a002af5-34e6-4916-a728-23fbecc52978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:23.731958 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a002af5-34e6-4916-a728-23fbecc52978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:23.732548 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a002af5-34e6-4916-a728-23fbecc52978 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:23.733130 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a002af5-34e6-4916-a728-23fbecc52978 admin admin] PATH_INFO: `/v3/users/572340f4eea9423a8579ab0003e5f35e` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:23.735069 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a002af5-34e6-4916-a728-23fbecc52978 admin admin] RBAC: Authorizing `identity:delete_user(user_id=572340f4eea9423a8579ab0003e5f35e)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:23.740428 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a002af5-34e6-4916-a728-23fbecc52978 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:23.742585 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:23.797571 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5482e15-830a-4648-89af-f5e8bfb29789 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:23.810599 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb351d-52fe-49ce-8ae1-ab8f45cad70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:23.813236 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb351d-52fe-49ce-8ae1-ab8f45cad70f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:23.813536 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb351d-52fe-49ce-8ae1-ab8f45cad70f admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:23.814590 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb351d-52fe-49ce-8ae1-ab8f45cad70f admin admin] PATH_INFO: `/v3/projects/0196ef65c7ad402188d215f0447037fa` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:23.818789 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb351d-52fe-49ce-8ae1-ab8f45cad70f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0196ef65c7ad402188d215f0447037fa)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:23.824336 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb351d-52fe-49ce-8ae1-ab8f45cad70f admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:23.832997 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-3a002af5-34e6-4916-a728-23fbecc52978 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '572340f4eea9423a8579ab0003e5f35e'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:23.845457 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:23.850307 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-3a002af5-34e6-4916-a728-23fbecc52978 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '572340f4eea9423a8579ab0003e5f35e'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:23.852419 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-3a002af5-34e6-4916-a728-23fbecc52978 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '572340f4eea9423a8579ab0003e5f35e'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:23.870488 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-3a002af5-34e6-4916-a728-23fbecc52978 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '572340f4eea9423a8579ab0003e5f35e'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:23.871886 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-3a002af5-34e6-4916-a728-23fbecc52978 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '572340f4eea9423a8579ab0003e5f35e'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:23.914917 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 833/1655] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 08:48:23 2022] DELETE /identity/v3/users/572340f4eea9423a8579ab0003e5f35e => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:23.921971 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a002af5-34e6-4916-a728-23fbecc52978 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:23.926023 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-3a002af5-34e6-4916-a728-23fbecc52978 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:23.928499 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-81bb351d-52fe-49ce-8ae1-ab8f45cad70f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0196ef65c7ad402188d215f0447037fa', 'request_id': 'req-81bb351d-52fe-49ce-8ae1-ab8f45cad70f'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:23.948942 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-81bb351d-52fe-49ce-8ae1-ab8f45cad70f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0196ef65c7ad402188d215f0447037fa', 'request_id': 'req-81bb351d-52fe-49ce-8ae1-ab8f45cad70f'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:23.974639 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-81bb351d-52fe-49ce-8ae1-ab8f45cad70f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0196ef65c7ad402188d215f0447037fa', 'request_id': 'req-81bb351d-52fe-49ce-8ae1-ab8f45cad70f'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:24.007127 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-81bb351d-52fe-49ce-8ae1-ab8f45cad70f admin admin] The token cache is being invalidate because project 0196ef65c7ad402188d215f0447037fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 08:48:24.007438 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-81bb351d-52fe-49ce-8ae1-ab8f45cad70f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:24.008188 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-81bb351d-52fe-49ce-8ae1-ab8f45cad70f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:24.014170 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 823/1656] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 08:48:23 2022] DELETE /identity/v3/projects/0196ef65c7ad402188d215f0447037fa => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:24.016347 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092cb86-04d1-44ca-b599-a746bad64528 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:24.016347 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092cb86-04d1-44ca-b599-a746bad64528 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:24.016526 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092cb86-04d1-44ca-b599-a746bad64528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:24.075402 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-d092cb86-04d1-44ca-b599-a746bad64528 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:24.077551 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-d092cb86-04d1-44ca-b599-a746bad64528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:24.113280 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a002af5-34e6-4916-a728-23fbecc52978 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:24.126130 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b438465-39dd-4537-89ac-1d88473c42a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:24.127043 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b438465-39dd-4537-89ac-1d88473c42a2 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:24.127690 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b438465-39dd-4537-89ac-1d88473c42a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:24.129503 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b438465-39dd-4537-89ac-1d88473c42a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:24.131392 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b438465-39dd-4537-89ac-1d88473c42a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:24.134900 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b438465-39dd-4537-89ac-1d88473c42a2 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:24.190660 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 834/1657] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 08:48:23 2022] POST /identity/v3/projects => generated 405 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:24.192497 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b438465-39dd-4537-89ac-1d88473c42a2 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:24.196714 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-4b438465-39dd-4537-89ac-1d88473c42a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:24.231015 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 824/1658] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:24.232145 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d092cb86-04d1-44ca-b599-a746bad64528 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:24.233662 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-d092cb86-04d1-44ca-b599-a746bad64528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:24.274408 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d092cb86-04d1-44ca-b599-a746bad64528 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:24.349989 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b438465-39dd-4537-89ac-1d88473c42a2 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:24.364507 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abc4f0a-a9a3-439e-8603-9d98f950c2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:24.365368 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc4f0a-a9a3-439e-8603-9d98f950c2af admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:24.365654 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc4f0a-a9a3-439e-8603-9d98f950c2af admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:24.365932 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc4f0a-a9a3-439e-8603-9d98f950c2af admin admin] PATH_INFO: `/v3/users/6a2d7c56654b4b5eaffbbde47ded1cef` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:24.372461 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abc4f0a-a9a3-439e-8603-9d98f950c2af admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a2d7c56654b4b5eaffbbde47ded1cef)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:24.375574 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abc4f0a-a9a3-439e-8603-9d98f950c2af admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:24.390355 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d3623-f4aa-4743-b37f-a883899215f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:24.392381 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d3623-f4aa-4743-b37f-a883899215f6 admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:24.392817 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d3623-f4aa-4743-b37f-a883899215f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:24.393311 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d3623-f4aa-4743-b37f-a883899215f6 admin admin] PATH_INFO: `/v3/users` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:24.397313 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3d3623-f4aa-4743-b37f-a883899215f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:24.401528 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3d3623-f4aa-4743-b37f-a883899215f6 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:24.447328 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 825/1659] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 08:48:24 2022] POST /identity/v3/users => generated 309 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:24.447608 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-1abc4f0a-a9a3-439e-8603-9d98f950c2af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a2d7c56654b4b5eaffbbde47ded1cef'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:24.450740 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d3623-f4aa-4743-b37f-a883899215f6 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:24.457138 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-ab3d3623-f4aa-4743-b37f-a883899215f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:24.460989 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-1abc4f0a-a9a3-439e-8603-9d98f950c2af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a2d7c56654b4b5eaffbbde47ded1cef'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:24.461907 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-1abc4f0a-a9a3-439e-8603-9d98f950c2af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a2d7c56654b4b5eaffbbde47ded1cef'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:24.465615 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:24.471808 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:24.478507 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-1abc4f0a-a9a3-439e-8603-9d98f950c2af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a2d7c56654b4b5eaffbbde47ded1cef'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:24.479071 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-1abc4f0a-a9a3-439e-8603-9d98f950c2af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a2d7c56654b4b5eaffbbde47ded1cef'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:24.514191 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 835/1660] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 08:48:24 2022] DELETE /identity/v3/users/6a2d7c56654b4b5eaffbbde47ded1cef => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:24.516855 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13823cd-9ca4-4451-9113-5f109f605ec9 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:24.518387 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13823cd-9ca4-4451-9113-5f109f605ec9 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:24.518870 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13823cd-9ca4-4451-9113-5f109f605ec9 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:24.521734 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 836/1661] 10.222.0.42 () {54 vars in 961 bytes} [Wed Jun 22 08:48:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:48:24.522721 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13823cd-9ca4-4451-9113-5f109f605ec9 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:24.524683 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-d13823cd-9ca4-4451-9113-5f109f605ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:24.618101 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13823cd-9ca4-4451-9113-5f109f605ec9 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:24.625654 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2747c73c-ff60-4a3d-a77c-2a94a67d85dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:24.626884 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747c73c-ff60-4a3d-a77c-2a94a67d85dc admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:24.627337 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747c73c-ff60-4a3d-a77c-2a94a67d85dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:24.627876 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747c73c-ff60-4a3d-a77c-2a94a67d85dc admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:24.628195 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d3623-f4aa-4743-b37f-a883899215f6 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:24.629004 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2747c73c-ff60-4a3d-a77c-2a94a67d85dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:24.631707 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2747c73c-ff60-4a3d-a77c-2a94a67d85dc admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:24.646762 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 837/1662] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:48:24 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:48:24.649939 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e65762-8edd-4b6f-a9c2-cfcd4132fae2 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:24.651445 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e65762-8edd-4b6f-a9c2-cfcd4132fae2 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:24.651743 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e65762-8edd-4b6f-a9c2-cfcd4132fae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:24.682662 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-a0e65762-8edd-4b6f-a9c2-cfcd4132fae2 None None] MFA Rules not processed for user `4f1809a35b244c1db7a185d82859369e`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:24.683937 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-a0e65762-8edd-4b6f-a9c2-cfcd4132fae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:24.778744 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dbd454-ef8f-492b-9626-13350cbae405 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:24.780680 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dbd454-ef8f-492b-9626-13350cbae405 service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:24.780939 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dbd454-ef8f-492b-9626-13350cbae405 service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:24.781249 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dbd454-ef8f-492b-9626-13350cbae405 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:24.785266 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 838/1663] 10.222.0.42 () {58 vars in 1058 bytes} [Wed Jun 22 08:48:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:24.790037 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-d0dbd454-ef8f-492b-9626-13350cbae405 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:24.790162 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e65762-8edd-4b6f-a9c2-cfcd4132fae2 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:24.815599 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dbd454-ef8f-492b-9626-13350cbae405 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:24.817072 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dbd454-ef8f-492b-9626-13350cbae405 service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:24.843665 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e65762-8edd-4b6f-a9c2-cfcd4132fae2 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:24.844519 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 826/1664] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:48:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:48:24.847734 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133a886-1796-4edf-86e0-d4f457237a39 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:24.849462 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133a886-1796-4edf-86e0-d4f457237a39 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:24.849573 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133a886-1796-4edf-86e0-d4f457237a39 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:24.854360 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 827/1665] 10.222.0.42 () {54 vars in 912 bytes} [Wed Jun 22 08:48:24 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:48:24.859564 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7147023-560c-4c7e-b933-4022e76305c2 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:24.859864 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7147023-560c-4c7e-b933-4022e76305c2 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:24.860144 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7147023-560c-4c7e-b933-4022e76305c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:24.865515 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae50ab62-9806-4055-9b8e-e4f8f937b3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:24.866666 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae50ab62-9806-4055-9b8e-e4f8f937b3e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:24.867121 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae50ab62-9806-4055-9b8e-e4f8f937b3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:24.868863 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae50ab62-9806-4055-9b8e-e4f8f937b3e3 admin admin] PATH_INFO: `/v3/projects/545b2970f1b14a908b0960fa578d6ea7/users/bb06f03883b44b2ea752603ae08bc864/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:24.908586 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-b7147023-560c-4c7e-b933-4022e76305c2 None None] MFA Rules not processed for user `4f1809a35b244c1db7a185d82859369e`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:24.909851 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-b7147023-560c-4c7e-b933-4022e76305c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:24.914911 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae50ab62-9806-4055-9b8e-e4f8f937b3e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=545b2970f1b14a908b0960fa578d6ea7, user_id=bb06f03883b44b2ea752603ae08bc864, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:24.923242 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae50ab62-9806-4055-9b8e-e4f8f937b3e3 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:24.935802 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 828/1666] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Jun 22 08:48:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:24.952076 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 839/1667] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:48:24 2022] PUT /identity/v3/projects/545b2970f1b14a908b0960fa578d6ea7/users/bb06f03883b44b2ea752603ae08bc864/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:24.955756 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae50ab62-9806-4055-9b8e-e4f8f937b3e3 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:24.956022 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7147023-560c-4c7e-b933-4022e76305c2 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:24.957537 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-b7147023-560c-4c7e-b933-4022e76305c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:25.085533 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:25.127675 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7147023-560c-4c7e-b933-4022e76305c2 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:25.170616 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae50ab62-9806-4055-9b8e-e4f8f937b3e3 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:25.189167 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10441f4-aa71-40ae-9210-0951094d93a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:25.189868 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10441f4-aa71-40ae-9210-0951094d93a8 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:25.192457 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10441f4-aa71-40ae-9210-0951094d93a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:25.193385 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10441f4-aa71-40ae-9210-0951094d93a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:25.194194 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10441f4-aa71-40ae-9210-0951094d93a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:25.195862 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10441f4-aa71-40ae-9210-0951094d93a8 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:25.237299 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 840/1668] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:48:24 2022] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:48:25.239128 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10441f4-aa71-40ae-9210-0951094d93a8 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:25.254840 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b835c08-ae35-4a13-a2da-f2a24be7fc9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:25.256053 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b835c08-ae35-4a13-a2da-f2a24be7fc9c service cinder] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:25.256338 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b835c08-ae35-4a13-a2da-f2a24be7fc9c service cinder] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:25.256619 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b835c08-ae35-4a13-a2da-f2a24be7fc9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:25.273115 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10441f4-aa71-40ae-9210-0951094d93a8 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:25.285949 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7887563-ed58-46d6-bb17-f82351ca93fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:25.288612 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7887563-ed58-46d6-bb17-f82351ca93fa admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:25.291514 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7887563-ed58-46d6-bb17-f82351ca93fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:25.291828 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7887563-ed58-46d6-bb17-f82351ca93fa admin admin] PATH_INFO: `/v3/projects/545b2970f1b14a908b0960fa578d6ea7/users/bb06f03883b44b2ea752603ae08bc864/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:25.298610 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7887563-ed58-46d6-bb17-f82351ca93fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=545b2970f1b14a908b0960fa578d6ea7, user_id=bb06f03883b44b2ea752603ae08bc864, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:25.306452 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7887563-ed58-46d6-bb17-f82351ca93fa admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:25.316062 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:25.342698 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 841/1669] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:48:25 2022] PUT /identity/v3/projects/545b2970f1b14a908b0960fa578d6ea7/users/bb06f03883b44b2ea752603ae08bc864/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:25.439476 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b835c08-ae35-4a13-a2da-f2a24be7fc9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:25.444817 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b835c08-ae35-4a13-a2da-f2a24be7fc9c service cinder] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:25.480054 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 829/1670] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:48:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:48:25.722818 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7887563-ed58-46d6-bb17-f82351ca93fa admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:25.724551 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-a7887563-ed58-46d6-bb17-f82351ca93fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:25.945422 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7887563-ed58-46d6-bb17-f82351ca93fa admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:25.973004 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a5172b-ffaa-46ef-bbc3-a373d1df642b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:25.974602 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5172b-ffaa-46ef-bbc3-a373d1df642b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:25.974878 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5172b-ffaa-46ef-bbc3-a373d1df642b admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:25.975159 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5172b-ffaa-46ef-bbc3-a373d1df642b admin admin] PATH_INFO: `/v3/projects/10acfedb64db47409bd74f9d8b375194` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:25.983734 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a5172b-ffaa-46ef-bbc3-a373d1df642b admin admin] RBAC: Authorizing `identity:delete_project(project_id=10acfedb64db47409bd74f9d8b375194)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:25.984824 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: WARNING py.warnings [None req-83a5172b-ffaa-46ef-bbc3-a373d1df642b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 08:48:25.984824 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: warnings.warn(msg) Jun 22 08:48:25.984824 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: Jun 22 08:48:25.986056 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a5172b-ffaa-46ef-bbc3-a373d1df642b admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:26.104313 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-83a5172b-ffaa-46ef-bbc3-a373d1df642b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10acfedb64db47409bd74f9d8b375194', 'request_id': 'req-83a5172b-ffaa-46ef-bbc3-a373d1df642b'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:26.112177 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-83a5172b-ffaa-46ef-bbc3-a373d1df642b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10acfedb64db47409bd74f9d8b375194', 'request_id': 'req-83a5172b-ffaa-46ef-bbc3-a373d1df642b'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:26.134702 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-83a5172b-ffaa-46ef-bbc3-a373d1df642b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10acfedb64db47409bd74f9d8b375194', 'request_id': 'req-83a5172b-ffaa-46ef-bbc3-a373d1df642b'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:26.157806 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-83a5172b-ffaa-46ef-bbc3-a373d1df642b admin admin] The token cache is being invalidate because project 10acfedb64db47409bd74f9d8b375194 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 08:48:26.159842 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-83a5172b-ffaa-46ef-bbc3-a373d1df642b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:26.160888 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-83a5172b-ffaa-46ef-bbc3-a373d1df642b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:26.167120 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 842/1671] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 08:48:25 2022] DELETE /identity/v3/projects/10acfedb64db47409bd74f9d8b375194 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:26.169668 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8176fd-bf75-4c19-aaf5-97e7f5d6bc8f None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:26.169974 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8176fd-bf75-4c19-aaf5-97e7f5d6bc8f None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:26.170226 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8176fd-bf75-4c19-aaf5-97e7f5d6bc8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:26.208462 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-db8176fd-bf75-4c19-aaf5-97e7f5d6bc8f None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:26.210050 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-db8176fd-bf75-4c19-aaf5-97e7f5d6bc8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:26.328441 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a5172b-ffaa-46ef-bbc3-a373d1df642b admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:26.331159 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-83a5172b-ffaa-46ef-bbc3-a373d1df642b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:26.408618 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 830/1672] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:26.410611 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241de9b4-83e4-49cc-96f7-6c2f2403d8dd None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:26.412437 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241de9b4-83e4-49cc-96f7-6c2f2403d8dd None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:26.413557 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241de9b4-83e4-49cc-96f7-6c2f2403d8dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:26.510905 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:26.533628 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a5172b-ffaa-46ef-bbc3-a373d1df642b admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:26.546999 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a730e1df-7911-4c3a-8d50-368d188c7925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:26.551068 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730e1df-7911-4c3a-8d50-368d188c7925 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:26.552870 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730e1df-7911-4c3a-8d50-368d188c7925 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:26.553273 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730e1df-7911-4c3a-8d50-368d188c7925 admin admin] PATH_INFO: `/v3/projects/3b11a98bf8074dd5b6b073923b941132` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:26.558470 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a730e1df-7911-4c3a-8d50-368d188c7925 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b11a98bf8074dd5b6b073923b941132)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:26.562697 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a730e1df-7911-4c3a-8d50-368d188c7925 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:26.578500 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-241de9b4-83e4-49cc-96f7-6c2f2403d8dd None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:26.585257 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-241de9b4-83e4-49cc-96f7-6c2f2403d8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:26.610963 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 831/1673] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 08:48:26.612357 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241de9b4-83e4-49cc-96f7-6c2f2403d8dd None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:26.635659 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241de9b4-83e4-49cc-96f7-6c2f2403d8dd None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:26.656359 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fc276b-5718-4acd-ade9-acce97748bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:26.659262 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc276b-5718-4acd-ade9-acce97748bcb admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:26.659565 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc276b-5718-4acd-ade9-acce97748bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:26.663407 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc276b-5718-4acd-ade9-acce97748bcb admin admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:26.665829 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fc276b-5718-4acd-ade9-acce97748bcb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:26.668772 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fc276b-5718-4acd-ade9-acce97748bcb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:26.676878 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fc276b-5718-4acd-ade9-acce97748bcb admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:26.682908 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-a730e1df-7911-4c3a-8d50-368d188c7925 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b11a98bf8074dd5b6b073923b941132', 'request_id': 'req-a730e1df-7911-4c3a-8d50-368d188c7925'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:26.690260 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-a730e1df-7911-4c3a-8d50-368d188c7925 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b11a98bf8074dd5b6b073923b941132', 'request_id': 'req-a730e1df-7911-4c3a-8d50-368d188c7925'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:26.703690 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-a730e1df-7911-4c3a-8d50-368d188c7925 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b11a98bf8074dd5b6b073923b941132', 'request_id': 'req-a730e1df-7911-4c3a-8d50-368d188c7925'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:26.736447 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-a730e1df-7911-4c3a-8d50-368d188c7925 admin admin] The token cache is being invalidate because project 3b11a98bf8074dd5b6b073923b941132 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 08:48:26.736793 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-a730e1df-7911-4c3a-8d50-368d188c7925 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:26.737425 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-a730e1df-7911-4c3a-8d50-368d188c7925 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:26.745130 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 843/1674] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 08:48:26 2022] DELETE /identity/v3/projects/3b11a98bf8074dd5b6b073923b941132 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:26.751334 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a730e1df-7911-4c3a-8d50-368d188c7925 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:26.758490 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 832/1675] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Jun 22 08:48:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:26.760679 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fc276b-5718-4acd-ade9-acce97748bcb admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:26.760794 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-a730e1df-7911-4c3a-8d50-368d188c7925 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:26.765758 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-21fc276b-5718-4acd-ade9-acce97748bcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:26.828603 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fc276b-5718-4acd-ade9-acce97748bcb admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:26.974392 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a730e1df-7911-4c3a-8d50-368d188c7925 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:26.984950 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be59af7d-a255-4ade-a6be-8b9560558128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:26.986581 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be59af7d-a255-4ade-a6be-8b9560558128 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:26.986885 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be59af7d-a255-4ade-a6be-8b9560558128 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:26.987365 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be59af7d-a255-4ade-a6be-8b9560558128 admin admin] PATH_INFO: `/v3/users/46440839b56840849d48429cbf4f80e2` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:26.990396 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be59af7d-a255-4ade-a6be-8b9560558128 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46440839b56840849d48429cbf4f80e2)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:26.993177 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be59af7d-a255-4ade-a6be-8b9560558128 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:27.001623 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8fba4e-4bfb-4622-ac6a-88f739ceaf5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:27.002765 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8fba4e-4bfb-4622-ac6a-88f739ceaf5a admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:27.003273 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8fba4e-4bfb-4622-ac6a-88f739ceaf5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:27.003766 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8fba4e-4bfb-4622-ac6a-88f739ceaf5a admin admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:27.004708 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8fba4e-4bfb-4622-ac6a-88f739ceaf5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:27.008046 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8fba4e-4bfb-4622-ac6a-88f739ceaf5a admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:27.080321 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 833/1676] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 08:48:26 2022] POST /identity/v3/projects => generated 389 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 08:48:27.081326 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8fba4e-4bfb-4622-ac6a-88f739ceaf5a admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:27.087669 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-1c8fba4e-4bfb-4622-ac6a-88f739ceaf5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:27.132182 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-be59af7d-a255-4ade-a6be-8b9560558128 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46440839b56840849d48429cbf4f80e2'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:27.143858 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:27.181637 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-be59af7d-a255-4ade-a6be-8b9560558128 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46440839b56840849d48429cbf4f80e2'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:27.183622 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-be59af7d-a255-4ade-a6be-8b9560558128 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46440839b56840849d48429cbf4f80e2'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:27.207378 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-be59af7d-a255-4ade-a6be-8b9560558128 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46440839b56840849d48429cbf4f80e2'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:27.208892 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-be59af7d-a255-4ade-a6be-8b9560558128 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46440839b56840849d48429cbf4f80e2'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:27.250050 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8fba4e-4bfb-4622-ac6a-88f739ceaf5a admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:27.259442 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 844/1677] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 08:48:26 2022] DELETE /identity/v3/users/46440839b56840849d48429cbf4f80e2 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:27.260664 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be59af7d-a255-4ade-a6be-8b9560558128 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:27.262875 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-be59af7d-a255-4ade-a6be-8b9560558128 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:27.276403 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:27.366752 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6782e56a-fb38-4f2b-9ee1-64dc350c2dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:27.367624 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6782e56a-fb38-4f2b-9ee1-64dc350c2dfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:27.367906 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6782e56a-fb38-4f2b-9ee1-64dc350c2dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:27.368180 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6782e56a-fb38-4f2b-9ee1-64dc350c2dfa admin admin] PATH_INFO: `/v3/projects/62c6c4043b9a40c68822ea688501c484` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:27.370108 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6782e56a-fb38-4f2b-9ee1-64dc350c2dfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=62c6c4043b9a40c68822ea688501c484)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:27.372054 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6782e56a-fb38-4f2b-9ee1-64dc350c2dfa admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:27.437246 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be59af7d-a255-4ade-a6be-8b9560558128 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:27.453972 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2728842a-f1a8-45c0-be5d-91decb97f7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:27.456617 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728842a-f1a8-45c0-be5d-91decb97f7d2 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:27.457260 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728842a-f1a8-45c0-be5d-91decb97f7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:27.457561 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728842a-f1a8-45c0-be5d-91decb97f7d2 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:27.459986 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2728842a-f1a8-45c0-be5d-91decb97f7d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:27.463613 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2728842a-f1a8-45c0-be5d-91decb97f7d2 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:27.481968 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-6782e56a-fb38-4f2b-9ee1-64dc350c2dfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62c6c4043b9a40c68822ea688501c484', 'request_id': 'req-6782e56a-fb38-4f2b-9ee1-64dc350c2dfa'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:27.494061 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-6782e56a-fb38-4f2b-9ee1-64dc350c2dfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62c6c4043b9a40c68822ea688501c484', 'request_id': 'req-6782e56a-fb38-4f2b-9ee1-64dc350c2dfa'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:27.507004 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-6782e56a-fb38-4f2b-9ee1-64dc350c2dfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62c6c4043b9a40c68822ea688501c484', 'request_id': 'req-6782e56a-fb38-4f2b-9ee1-64dc350c2dfa'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:27.519151 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 845/1678] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 08:48:27 2022] POST /identity/v3/users => generated 295 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:27.520822 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2728842a-f1a8-45c0-be5d-91decb97f7d2 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:27.535521 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-6782e56a-fb38-4f2b-9ee1-64dc350c2dfa admin admin] The token cache is being invalidate because project 62c6c4043b9a40c68822ea688501c484 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 08:48:27.536090 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-6782e56a-fb38-4f2b-9ee1-64dc350c2dfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:27.537559 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-6782e56a-fb38-4f2b-9ee1-64dc350c2dfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:27.541401 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 834/1679] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 08:48:27 2022] DELETE /identity/v3/projects/62c6c4043b9a40c68822ea688501c484 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:27.544656 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2728842a-f1a8-45c0-be5d-91decb97f7d2 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:27.547040 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a5b36-57c0-4b5e-910c-c861ddda9f02 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:27.547688 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a5b36-57c0-4b5e-910c-c861ddda9f02 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:27.548158 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a5b36-57c0-4b5e-910c-c861ddda9f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:27.584096 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-ab4a5b36-57c0-4b5e-910c-c861ddda9f02 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:27.586603 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-ab4a5b36-57c0-4b5e-910c-c861ddda9f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:27.673889 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:27.700094 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 835/1680] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:27.703872 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c14866-9edf-4718-9442-2ed6b44a1fe4 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:27.704121 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c14866-9edf-4718-9442-2ed6b44a1fe4 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:27.704901 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c14866-9edf-4718-9442-2ed6b44a1fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:27.746357 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3128998-c394-4bca-88e1-94feffa8978e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:27.746963 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3128998-c394-4bca-88e1-94feffa8978e admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:27.747360 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3128998-c394-4bca-88e1-94feffa8978e admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:27.747767 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3128998-c394-4bca-88e1-94feffa8978e admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:27.748632 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3128998-c394-4bca-88e1-94feffa8978e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:27.752742 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3128998-c394-4bca-88e1-94feffa8978e admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:27.753744 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-f6c14866-9edf-4718-9442-2ed6b44a1fe4 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:27.757401 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-f6c14866-9edf-4718-9442-2ed6b44a1fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:27.783477 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 836/1681] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:27.788490 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c14866-9edf-4718-9442-2ed6b44a1fe4 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:27.790284 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 846/1682] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:48:27.794142 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3128998-c394-4bca-88e1-94feffa8978e admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:27.806837 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-b3128998-c394-4bca-88e1-94feffa8978e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:27.811946 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c14866-9edf-4718-9442-2ed6b44a1fe4 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:27.828247 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3128998-c394-4bca-88e1-94feffa8978e admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:27.834721 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f58403-822a-4c22-973d-08fa5cec5939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:27.835355 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f58403-822a-4c22-973d-08fa5cec5939 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:27.835590 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f58403-822a-4c22-973d-08fa5cec5939 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:27.839581 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f58403-822a-4c22-973d-08fa5cec5939 admin admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:27.841347 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f58403-822a-4c22-973d-08fa5cec5939 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:27.841669 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f58403-822a-4c22-973d-08fa5cec5939 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:27.841757 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d957e0d-efcc-4d03-8330-956c78fea85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:27.842597 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d957e0d-efcc-4d03-8330-956c78fea85e admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:27.842903 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d957e0d-efcc-4d03-8330-956c78fea85e admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:27.843288 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d957e0d-efcc-4d03-8330-956c78fea85e admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:27.843389 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f58403-822a-4c22-973d-08fa5cec5939 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:27.844201 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d957e0d-efcc-4d03-8330-956c78fea85e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:27.845909 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d957e0d-efcc-4d03-8330-956c78fea85e admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:27.873092 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 847/1683] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 08:48:27.874575 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ad7b6-10bb-4305-bc3b-f253ca4fcb58 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:27.874865 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ad7b6-10bb-4305-bc3b-f253ca4fcb58 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:27.875147 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ad7b6-10bb-4305-bc3b-f253ca4fcb58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:27.878956 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 837/1684] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Jun 22 08:48:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:27.879946 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f58403-822a-4c22-973d-08fa5cec5939 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:27.913305 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f58403-822a-4c22-973d-08fa5cec5939 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:27.922664 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9749917d-7761-44b7-8b2d-9c9bd9662811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:27.923716 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9749917d-7761-44b7-8b2d-9c9bd9662811 admin admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:27.924108 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9749917d-7761-44b7-8b2d-9c9bd9662811 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:27.924498 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9749917d-7761-44b7-8b2d-9c9bd9662811 admin admin] PATH_INFO: `/v3/projects/a25acf73bbfd460780252657a794db93/users/2804fa2e96bf4c6981c1100c536521dc/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:27.941972 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-e56ad7b6-10bb-4305-bc3b-f253ca4fcb58 None None] MFA Rules not processed for user `bb06f03883b44b2ea752603ae08bc864`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:27.943340 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-e56ad7b6-10bb-4305-bc3b-f253ca4fcb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:27.945321 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9749917d-7761-44b7-8b2d-9c9bd9662811 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a25acf73bbfd460780252657a794db93, user_id=2804fa2e96bf4c6981c1100c536521dc, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:27.948648 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9749917d-7761-44b7-8b2d-9c9bd9662811 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:27.975025 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 838/1685] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:48:27 2022] PUT /identity/v3/projects/a25acf73bbfd460780252657a794db93/users/2804fa2e96bf4c6981c1100c536521dc/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:27.976253 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9749917d-7761-44b7-8b2d-9c9bd9662811 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:28.105594 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9749917d-7761-44b7-8b2d-9c9bd9662811 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:28.125050 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4fb119-a36a-48f7-bdc3-33bb2cd88a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:28.125865 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4fb119-a36a-48f7-bdc3-33bb2cd88a16 admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:28.126307 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4fb119-a36a-48f7-bdc3-33bb2cd88a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:28.126699 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4fb119-a36a-48f7-bdc3-33bb2cd88a16 admin admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:28.127545 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4fb119-a36a-48f7-bdc3-33bb2cd88a16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:28.129585 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4fb119-a36a-48f7-bdc3-33bb2cd88a16 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:28.172189 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 848/1686] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:27 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:28.187201 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0b7b3-691c-4e81-927d-cb702bfed4d7 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:28.187652 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0b7b3-691c-4e81-927d-cb702bfed4d7 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:28.187942 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0b7b3-691c-4e81-927d-cb702bfed4d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:28.196014 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 839/1687] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 08:48:27 2022] POST /identity/v3/projects => generated 355 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:28.200346 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4fb119-a36a-48f7-bdc3-33bb2cd88a16 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:28.202314 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:28.253874 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-60b0b7b3-691c-4e81-927d-cb702bfed4d7 None None] MFA Rules not processed for user `2804fa2e96bf4c6981c1100c536521dc`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:28.256276 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-60b0b7b3-691c-4e81-927d-cb702bfed4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:28.306329 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4fb119-a36a-48f7-bdc3-33bb2cd88a16 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:28.314555 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ed720-4357-423a-8e0b-8b04ebeaf29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:28.315946 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ed720-4357-423a-8e0b-8b04ebeaf29b admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:28.316370 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ed720-4357-423a-8e0b-8b04ebeaf29b admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:28.316809 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ed720-4357-423a-8e0b-8b04ebeaf29b admin admin] PATH_INFO: `/v3/users` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:28.318537 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2ed720-4357-423a-8e0b-8b04ebeaf29b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:28.321602 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2ed720-4357-423a-8e0b-8b04ebeaf29b admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:28.364270 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 840/1688] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 08:48:28 2022] POST /identity/v3/users => generated 278 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:28.376280 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ed720-4357-423a-8e0b-8b04ebeaf29b admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:28.415335 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ed720-4357-423a-8e0b-8b04ebeaf29b admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:28.430122 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad33de-6e80-4e1e-9650-b98fec64f460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:28.432378 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad33de-6e80-4e1e-9650-b98fec64f460 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:28.432813 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad33de-6e80-4e1e-9650-b98fec64f460 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:28.434368 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad33de-6e80-4e1e-9650-b98fec64f460 admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:28.436720 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ad33de-6e80-4e1e-9650-b98fec64f460 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:28.441291 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ad33de-6e80-4e1e-9650-b98fec64f460 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:28.449791 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 849/1689] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:28.451608 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0b7b3-691c-4e81-927d-cb702bfed4d7 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:28.453721 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-60b0b7b3-691c-4e81-927d-cb702bfed4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:28.469555 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 841/1690] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:48:28 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:48:28.471594 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad33de-6e80-4e1e-9650-b98fec64f460 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:28.486619 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0b7b3-691c-4e81-927d-cb702bfed4d7 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:28.498040 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d827110d-f4b7-4868-b8d9-276d87e7a507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:28.499760 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827110d-f4b7-4868-b8d9-276d87e7a507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:28.501254 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827110d-f4b7-4868-b8d9-276d87e7a507 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:28.501591 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827110d-f4b7-4868-b8d9-276d87e7a507 admin admin] PATH_INFO: `/v3/projects/4a14a9ad54134d87b512ed900ff6cbf2` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:28.504352 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d827110d-f4b7-4868-b8d9-276d87e7a507 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a14a9ad54134d87b512ed900ff6cbf2)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:28.508736 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad33de-6e80-4e1e-9650-b98fec64f460 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:28.512781 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d827110d-f4b7-4868-b8d9-276d87e7a507 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:28.524345 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a57b6ad-0f98-4c04-9b75-6c22ab2c055a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:28.524897 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a57b6ad-0f98-4c04-9b75-6c22ab2c055a admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:28.525188 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a57b6ad-0f98-4c04-9b75-6c22ab2c055a admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:28.525472 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a57b6ad-0f98-4c04-9b75-6c22ab2c055a admin admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:28.526248 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a57b6ad-0f98-4c04-9b75-6c22ab2c055a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:28.528218 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a57b6ad-0f98-4c04-9b75-6c22ab2c055a admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:28.589470 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:28.624575 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 842/1691] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 08:48:28 2022] POST /identity/v3/projects => generated 387 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:28.632177 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a57b6ad-0f98-4c04-9b75-6c22ab2c055a admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:28.633289 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-d827110d-f4b7-4868-b8d9-276d87e7a507 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a14a9ad54134d87b512ed900ff6cbf2', 'request_id': 'req-d827110d-f4b7-4868-b8d9-276d87e7a507'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:28.647284 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-d827110d-f4b7-4868-b8d9-276d87e7a507 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a14a9ad54134d87b512ed900ff6cbf2', 'request_id': 'req-d827110d-f4b7-4868-b8d9-276d87e7a507'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:28.657622 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-d827110d-f4b7-4868-b8d9-276d87e7a507 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a14a9ad54134d87b512ed900ff6cbf2', 'request_id': 'req-d827110d-f4b7-4868-b8d9-276d87e7a507'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:28.684145 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-d827110d-f4b7-4868-b8d9-276d87e7a507 admin admin] The token cache is being invalidate because project 4a14a9ad54134d87b512ed900ff6cbf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 08:48:28.684446 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-d827110d-f4b7-4868-b8d9-276d87e7a507 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:28.686489 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-d827110d-f4b7-4868-b8d9-276d87e7a507 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:28.691992 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 850/1692] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 08:48:28 2022] DELETE /identity/v3/projects/4a14a9ad54134d87b512ed900ff6cbf2 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:28.691992 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d827110d-f4b7-4868-b8d9-276d87e7a507 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:28.695421 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-d827110d-f4b7-4868-b8d9-276d87e7a507 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:28.786897 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a57b6ad-0f98-4c04-9b75-6c22ab2c055a admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:28.801418 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a90c0-7a22-4d78-ad1b-4372eb30ef59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:28.805575 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a90c0-7a22-4d78-ad1b-4372eb30ef59 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:28.805873 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a90c0-7a22-4d78-ad1b-4372eb30ef59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:28.806185 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a90c0-7a22-4d78-ad1b-4372eb30ef59 admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:28.806948 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34a90c0-7a22-4d78-ad1b-4372eb30ef59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:28.810914 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34a90c0-7a22-4d78-ad1b-4372eb30ef59 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:28.835553 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 843/1693] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:48:28 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:48:28.841335 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e6e6f-0529-4933-b80d-97af75bb7e55 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:28.841784 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e6e6f-0529-4933-b80d-97af75bb7e55 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:28.842233 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e6e6f-0529-4933-b80d-97af75bb7e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:28.845425 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d827110d-f4b7-4868-b8d9-276d87e7a507 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:28.864846 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470d76b7-fad9-45a6-aadf-f07064cb7187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:28.865536 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470d76b7-fad9-45a6-aadf-f07064cb7187 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:28.865817 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470d76b7-fad9-45a6-aadf-f07064cb7187 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:28.866113 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470d76b7-fad9-45a6-aadf-f07064cb7187 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:28.866832 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470d76b7-fad9-45a6-aadf-f07064cb7187 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:28.868847 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470d76b7-fad9-45a6-aadf-f07064cb7187 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:28.892689 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-306e6e6f-0529-4933-b80d-97af75bb7e55 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:28.895511 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-306e6e6f-0529-4933-b80d-97af75bb7e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:28.916556 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 851/1694] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 08:48:28 2022] POST /identity/v3/users => generated 300 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:28.916895 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 844/1695] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:28.917692 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470d76b7-fad9-45a6-aadf-f07064cb7187 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:28.918059 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306e6e6f-0529-4933-b80d-97af75bb7e55 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:28.923868 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-470d76b7-fad9-45a6-aadf-f07064cb7187 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:28.940216 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306e6e6f-0529-4933-b80d-97af75bb7e55 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:28.941942 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:28.950972 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470d76b7-fad9-45a6-aadf-f07064cb7187 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:28.955812 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8308415a-0c1f-4e98-bcc7-d81d79d5f9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:28.956507 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308415a-0c1f-4e98-bcc7-d81d79d5f9c1 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:28.956793 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308415a-0c1f-4e98-bcc7-d81d79d5f9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:28.957076 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308415a-0c1f-4e98-bcc7-d81d79d5f9c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:28.957857 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8308415a-0c1f-4e98-bcc7-d81d79d5f9c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:28.963878 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8308415a-0c1f-4e98-bcc7-d81d79d5f9c1 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:28.968043 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85feb66-af21-4bfc-90ea-1a14884084d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:28.968965 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85feb66-af21-4bfc-90ea-1a14884084d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:28.969250 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85feb66-af21-4bfc-90ea-1a14884084d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:28.969527 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85feb66-af21-4bfc-90ea-1a14884084d5 admin admin] PATH_INFO: `/v3/projects/b47a7735531849e38c2b6b2daa203c87/users/c574b3e92dd941e9b524821bf2611a5a/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:28.988393 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 845/1696] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:48:28 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:48:28.992283 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6165422-40d6-4838-9371-abc8f20707b6 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:28.992583 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6165422-40d6-4838-9371-abc8f20707b6 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:28.992868 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6165422-40d6-4838-9371-abc8f20707b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:29.010658 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85feb66-af21-4bfc-90ea-1a14884084d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b47a7735531849e38c2b6b2daa203c87, user_id=c574b3e92dd941e9b524821bf2611a5a, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:29.013583 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85feb66-af21-4bfc-90ea-1a14884084d5 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:29.038843 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-e6165422-40d6-4838-9371-abc8f20707b6 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:29.040309 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 852/1697] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:48:28 2022] PUT /identity/v3/projects/b47a7735531849e38c2b6b2daa203c87/users/c574b3e92dd941e9b524821bf2611a5a/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:29.040934 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85feb66-af21-4bfc-90ea-1a14884084d5 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:29.041663 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-e6165422-40d6-4838-9371-abc8f20707b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:29.159970 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 846/1698] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:29.163284 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211624c6-5bc3-4f33-ba8a-d53b874c2cac None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:29.163284 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211624c6-5bc3-4f33-ba8a-d53b874c2cac None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:29.163284 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211624c6-5bc3-4f33-ba8a-d53b874c2cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:29.166635 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85feb66-af21-4bfc-90ea-1a14884084d5 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:29.189990 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f94755-3eba-46a2-89d7-3921b619c68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:29.191373 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f94755-3eba-46a2-89d7-3921b619c68c admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:29.191663 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f94755-3eba-46a2-89d7-3921b619c68c admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:29.191949 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f94755-3eba-46a2-89d7-3921b619c68c admin admin] PATH_INFO: `/v3/projects/dc788fef8b8149b2b8afb764eae18c3e/users/9d367544b8e74f73be47424df9d5d8b9/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:29.207088 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-211624c6-5bc3-4f33-ba8a-d53b874c2cac None None] MFA Rules not processed for user `c574b3e92dd941e9b524821bf2611a5a`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:29.224030 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f94755-3eba-46a2-89d7-3921b619c68c admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc788fef8b8149b2b8afb764eae18c3e, user_id=9d367544b8e74f73be47424df9d5d8b9, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:29.229454 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f94755-3eba-46a2-89d7-3921b619c68c admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:29.236741 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-211624c6-5bc3-4f33-ba8a-d53b874c2cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:29.253288 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 853/1699] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:48:29 2022] PUT /identity/v3/projects/dc788fef8b8149b2b8afb764eae18c3e/users/9d367544b8e74f73be47424df9d5d8b9/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:29.254296 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f94755-3eba-46a2-89d7-3921b619c68c admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:29.341303 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f94755-3eba-46a2-89d7-3921b619c68c admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:29.346618 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e065a4-b531-46c0-bef6-2282837dde4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:29.347386 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e065a4-b531-46c0-bef6-2282837dde4a admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:29.347746 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e065a4-b531-46c0-bef6-2282837dde4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:29.348099 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e065a4-b531-46c0-bef6-2282837dde4a admin admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:29.348951 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e065a4-b531-46c0-bef6-2282837dde4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:29.349859 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e065a4-b531-46c0-bef6-2282837dde4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:29.352598 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e065a4-b531-46c0-bef6-2282837dde4a admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:29.372935 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 854/1700] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Jun 22 08:48:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:29.372935 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e065a4-b531-46c0-bef6-2282837dde4a admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:29.387101 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e065a4-b531-46c0-bef6-2282837dde4a admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:29.395797 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdd1e41-9867-4307-b73f-d58265405ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:29.397177 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd1e41-9867-4307-b73f-d58265405ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:29.397593 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd1e41-9867-4307-b73f-d58265405ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:29.397985 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd1e41-9867-4307-b73f-d58265405ee5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:29.398886 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdd1e41-9867-4307-b73f-d58265405ee5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:29.400721 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdd1e41-9867-4307-b73f-d58265405ee5 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:29.430800 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 855/1701] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:48:29.430800 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdd1e41-9867-4307-b73f-d58265405ee5 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:29.441870 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdd1e41-9867-4307-b73f-d58265405ee5 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:29.450217 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 847/1702] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:29 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:29.451441 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211624c6-5bc3-4f33-ba8a-d53b874c2cac None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:29.452279 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb58b81-cab3-4a95-93e2-38847e9a28bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:29.453210 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb58b81-cab3-4a95-93e2-38847e9a28bc admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:29.453611 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb58b81-cab3-4a95-93e2-38847e9a28bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:29.454159 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb58b81-cab3-4a95-93e2-38847e9a28bc admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:29.455452 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb58b81-cab3-4a95-93e2-38847e9a28bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:29.457588 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb58b81-cab3-4a95-93e2-38847e9a28bc admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:29.458903 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:29.466361 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211624c6-5bc3-4f33-ba8a-d53b874c2cac None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:29.474675 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28a713-f854-472a-aeb0-f90ee739c131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:29.476008 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28a713-f854-472a-aeb0-f90ee739c131 admin admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:29.476483 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28a713-f854-472a-aeb0-f90ee739c131 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:29.476940 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28a713-f854-472a-aeb0-f90ee739c131 admin admin] PATH_INFO: `/v3/projects/dc788fef8b8149b2b8afb764eae18c3e/users/9d367544b8e74f73be47424df9d5d8b9/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:29.479459 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba28a713-f854-472a-aeb0-f90ee739c131 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc788fef8b8149b2b8afb764eae18c3e, user_id=9d367544b8e74f73be47424df9d5d8b9, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:29.483087 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba28a713-f854-472a-aeb0-f90ee739c131 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:29.504015 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 856/1703] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 08:48:29 2022] POST /identity/v3/projects => generated 385 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:29.505961 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb58b81-cab3-4a95-93e2-38847e9a28bc admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:29.520127 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 848/1704] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:48:29 2022] PUT /identity/v3/projects/dc788fef8b8149b2b8afb764eae18c3e/users/9d367544b8e74f73be47424df9d5d8b9/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:29.520127 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28a713-f854-472a-aeb0-f90ee739c131 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:29.583741 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:29.679613 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb58b81-cab3-4a95-93e2-38847e9a28bc admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:29.681039 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28a713-f854-472a-aeb0-f90ee739c131 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:29.687957 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a89a64-d2be-4310-be55-46d6975f069d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:29.691291 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a89a64-d2be-4310-be55-46d6975f069d admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:29.691605 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a89a64-d2be-4310-be55-46d6975f069d admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:29.691894 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a89a64-d2be-4310-be55-46d6975f069d admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:29.692667 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a89a64-d2be-4310-be55-46d6975f069d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:29.697091 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a89a64-d2be-4310-be55-46d6975f069d admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:29.698421 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e728d4e-c937-4202-bd2e-d4d0d139cb82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:29.699124 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e728d4e-c937-4202-bd2e-d4d0d139cb82 admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:29.699410 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e728d4e-c937-4202-bd2e-d4d0d139cb82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:29.699689 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e728d4e-c937-4202-bd2e-d4d0d139cb82 admin admin] PATH_INFO: `/v3/users` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:29.706661 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e728d4e-c937-4202-bd2e-d4d0d139cb82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:29.708821 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e728d4e-c937-4202-bd2e-d4d0d139cb82 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:29.738610 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 849/1705] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 08:48:29 2022] POST /identity/v3/users => generated 293 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:29.742743 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e102db3-d1c6-493f-b218-9bd4b17370c5 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:29.743049 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e102db3-d1c6-493f-b218-9bd4b17370c5 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:29.743339 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e102db3-d1c6-493f-b218-9bd4b17370c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:29.770559 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 857/1706] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 08:48:29 2022] POST /identity/v3/projects => generated 355 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:29.772272 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff7d61-6ff4-42be-87ca-c064a4b78651 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:29.772637 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff7d61-6ff4-42be-87ca-c064a4b78651 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:29.773061 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff7d61-6ff4-42be-87ca-c064a4b78651 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:29.774981 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 858/1707] 10.222.0.42 () {54 vars in 921 bytes} [Wed Jun 22 08:48:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:48:29.775975 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eff7d61-6ff4-42be-87ca-c064a4b78651 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:29.810759 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-8e102db3-d1c6-493f-b218-9bd4b17370c5 None None] MFA Rules not processed for user `9d367544b8e74f73be47424df9d5d8b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:29.812100 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-8e102db3-d1c6-493f-b218-9bd4b17370c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:29.941278 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eff7d61-6ff4-42be-87ca-c064a4b78651 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:29.958508 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5153f610-61b6-4690-95f2-7fe497a86c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:29.959101 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153f610-61b6-4690-95f2-7fe497a86c0f admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:29.959387 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153f610-61b6-4690-95f2-7fe497a86c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:29.959666 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153f610-61b6-4690-95f2-7fe497a86c0f admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:29.961614 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5153f610-61b6-4690-95f2-7fe497a86c0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:29.964754 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5153f610-61b6-4690-95f2-7fe497a86c0f admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:29.999123 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 859/1708] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:48:30.000784 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5153f610-61b6-4690-95f2-7fe497a86c0f admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:30.013409 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 850/1709] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:29 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:30.016828 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989be269-3610-4d5f-b101-57c12417edc3 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:30.017418 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989be269-3610-4d5f-b101-57c12417edc3 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:30.018371 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989be269-3610-4d5f-b101-57c12417edc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:30.024107 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5153f610-61b6-4690-95f2-7fe497a86c0f admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:30.031207 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9d1652-b21c-41cc-9f07-b112db0762f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:30.031932 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d1652-b21c-41cc-9f07-b112db0762f2 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:30.032186 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d1652-b21c-41cc-9f07-b112db0762f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:30.032592 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d1652-b21c-41cc-9f07-b112db0762f2 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:30.033308 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9d1652-b21c-41cc-9f07-b112db0762f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:30.037414 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9d1652-b21c-41cc-9f07-b112db0762f2 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:30.056752 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-989be269-3610-4d5f-b101-57c12417edc3 None None] MFA Rules not processed for user `ec2627e3cdc94ec38d7cc3b1bc670ef1`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:30.058319 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-989be269-3610-4d5f-b101-57c12417edc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:30.071098 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 860/1710] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 08:48:29 2022] POST /identity/v3/users => generated 284 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:30.072524 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9d1652-b21c-41cc-9f07-b112db0762f2 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:30.099901 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9d1652-b21c-41cc-9f07-b112db0762f2 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:30.107661 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474c7da4-7469-498f-b8d3-3e585d24467d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:30.108875 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c7da4-7469-498f-b8d3-3e585d24467d admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:30.109770 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c7da4-7469-498f-b8d3-3e585d24467d admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:30.110282 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c7da4-7469-498f-b8d3-3e585d24467d admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:30.111372 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474c7da4-7469-498f-b8d3-3e585d24467d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:30.113767 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474c7da4-7469-498f-b8d3-3e585d24467d admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:30.135935 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 861/1711] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:48:30.137806 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474c7da4-7469-498f-b8d3-3e585d24467d admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:30.140406 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-474c7da4-7469-498f-b8d3-3e585d24467d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:30.182507 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:30.204534 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 851/1712] 10.222.0.42 () {58 vars in 1018 bytes} [Wed Jun 22 08:48:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:30.205411 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989be269-3610-4d5f-b101-57c12417edc3 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:30.231576 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989be269-3610-4d5f-b101-57c12417edc3 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:30.244864 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6716a75-6772-4b27-9887-a8dbb8d1b554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:30.247841 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474c7da4-7469-498f-b8d3-3e585d24467d admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:30.248277 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6716a75-6772-4b27-9887-a8dbb8d1b554 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:30.248277 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6716a75-6772-4b27-9887-a8dbb8d1b554 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:30.248612 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6716a75-6772-4b27-9887-a8dbb8d1b554 admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:30.250024 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6716a75-6772-4b27-9887-a8dbb8d1b554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:30.252884 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6716a75-6772-4b27-9887-a8dbb8d1b554 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:30.257927 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83b0a94-ce81-4e71-be93-d35f685637c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:30.260343 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b0a94-ce81-4e71-be93-d35f685637c8 service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:30.260343 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b0a94-ce81-4e71-be93-d35f685637c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:30.261907 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b0a94-ce81-4e71-be93-d35f685637c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:30.282720 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 852/1713] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:48:30.287466 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83b0a94-ce81-4e71-be93-d35f685637c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:30.287974 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6716a75-6772-4b27-9887-a8dbb8d1b554 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:30.291588 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83b0a94-ce81-4e71-be93-d35f685637c8 service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:30.313922 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6716a75-6772-4b27-9887-a8dbb8d1b554 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:30.317899 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 862/1714] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:48:30 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:48:30.335301 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180c1d5-db8d-46fb-90a2-eefd388c34cb None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:30.335651 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180c1d5-db8d-46fb-90a2-eefd388c34cb None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:30.337555 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180c1d5-db8d-46fb-90a2-eefd388c34cb None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:30.337913 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf76431a-fdd7-4349-8ae3-b1e8f8589c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:30.339762 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf76431a-fdd7-4349-8ae3-b1e8f8589c13 admin admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:30.340060 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf76431a-fdd7-4349-8ae3-b1e8f8589c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:30.340349 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf76431a-fdd7-4349-8ae3-b1e8f8589c13 admin admin] PATH_INFO: `/v3/projects/bb5ba2c905a4464eb8a050794be350a1/users/e27ba46b52644c12b1a7a7cdf2c10d6e/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:30.342681 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 863/1715] 10.222.0.42 () {54 vars in 960 bytes} [Wed Jun 22 08:48:30 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:48:30.355490 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6180c1d5-db8d-46fb-90a2-eefd388c34cb None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:30.376431 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6180c1d5-db8d-46fb-90a2-eefd388c34cb None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:30.383207 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a47d875-a74a-416f-a1c1-15e005cd4a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:30.384261 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47d875-a74a-416f-a1c1-15e005cd4a63 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:30.384765 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47d875-a74a-416f-a1c1-15e005cd4a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:30.385144 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47d875-a74a-416f-a1c1-15e005cd4a63 admin admin] PATH_INFO: `/v3/projects/e4d08d5af5ed46f38e319867713edfbc/users/4f630870f8e7403abda9851224ba15ec/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:30.396125 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf76431a-fdd7-4349-8ae3-b1e8f8589c13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb5ba2c905a4464eb8a050794be350a1, user_id=e27ba46b52644c12b1a7a7cdf2c10d6e, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:30.406351 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf76431a-fdd7-4349-8ae3-b1e8f8589c13 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:30.411910 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a47d875-a74a-416f-a1c1-15e005cd4a63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4d08d5af5ed46f38e319867713edfbc, user_id=4f630870f8e7403abda9851224ba15ec, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:30.415978 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a47d875-a74a-416f-a1c1-15e005cd4a63 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:30.425327 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:30.450667 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 864/1716] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:48:30 2022] PUT /identity/v3/projects/e4d08d5af5ed46f38e319867713edfbc/users/4f630870f8e7403abda9851224ba15ec/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:30.452414 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a5073-a981-42c0-a306-bbdd1d670013 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:30.452975 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a5073-a981-42c0-a306-bbdd1d670013 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:30.453733 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a5073-a981-42c0-a306-bbdd1d670013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:30.454147 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 853/1717] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:48:30 2022] PUT /identity/v3/projects/bb5ba2c905a4464eb8a050794be350a1/users/e27ba46b52644c12b1a7a7cdf2c10d6e/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:30.457159 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf76431a-fdd7-4349-8ae3-b1e8f8589c13 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:30.484242 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-004a5073-a981-42c0-a306-bbdd1d670013 None None] MFA Rules not processed for user `ec2627e3cdc94ec38d7cc3b1bc670ef1`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:30.486275 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-004a5073-a981-42c0-a306-bbdd1d670013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:30.593608 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf76431a-fdd7-4349-8ae3-b1e8f8589c13 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:30.627698 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 865/1718] 10.222.0.42 () {58 vars in 1057 bytes} [Wed Jun 22 08:48:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:30.630438 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc2085-7c4a-4f9a-a7ff-eadd958fb6e3 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:30.632078 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc2085-7c4a-4f9a-a7ff-eadd958fb6e3 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:30.632593 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc2085-7c4a-4f9a-a7ff-eadd958fb6e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:30.710335 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-b6bc2085-7c4a-4f9a-a7ff-eadd958fb6e3 None None] MFA Rules not processed for user `e27ba46b52644c12b1a7a7cdf2c10d6e`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:30.713064 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-b6bc2085-7c4a-4f9a-a7ff-eadd958fb6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:30.735866 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f15133-6ef2-40e6-a0e4-048a2356d6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:30.736677 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f15133-6ef2-40e6-a0e4-048a2356d6af admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:30.737098 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f15133-6ef2-40e6-a0e4-048a2356d6af admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:30.738158 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f15133-6ef2-40e6-a0e4-048a2356d6af admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:30.738859 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f15133-6ef2-40e6-a0e4-048a2356d6af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:30.740750 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f15133-6ef2-40e6-a0e4-048a2356d6af admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:30.759736 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 854/1719] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:48:30.759736 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f15133-6ef2-40e6-a0e4-048a2356d6af admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:30.774778 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f15133-6ef2-40e6-a0e4-048a2356d6af admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:30.782026 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71905705-fad6-4496-885e-ab44dfd096ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:30.783183 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71905705-fad6-4496-885e-ab44dfd096ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:30.783626 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71905705-fad6-4496-885e-ab44dfd096ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:30.784008 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71905705-fad6-4496-885e-ab44dfd096ea admin admin] PATH_INFO: `/v3/users/2804fa2e96bf4c6981c1100c536521dc` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:30.791522 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71905705-fad6-4496-885e-ab44dfd096ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=2804fa2e96bf4c6981c1100c536521dc)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:30.795191 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71905705-fad6-4496-885e-ab44dfd096ea admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:30.866305 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 866/1720] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:30.867582 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bc2085-7c4a-4f9a-a7ff-eadd958fb6e3 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:30.886134 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bc2085-7c4a-4f9a-a7ff-eadd958fb6e3 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:30.896034 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb52b830-2a30-4b66-9c3e-c16bcc5f69fc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec2627e3cdc94ec38d7cc3b1bc670ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:30.896818 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb52b830-2a30-4b66-9c3e-c16bcc5f69fc service placement] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:30.897220 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb52b830-2a30-4b66-9c3e-c16bcc5f69fc service placement] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:30.897611 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb52b830-2a30-4b66-9c3e-c16bcc5f69fc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:30.909098 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-71905705-fad6-4496-885e-ab44dfd096ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2804fa2e96bf4c6981c1100c536521dc'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:30.912716 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb52b830-2a30-4b66-9c3e-c16bcc5f69fc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:30.915368 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb52b830-2a30-4b66-9c3e-c16bcc5f69fc service placement] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:30.930335 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-71905705-fad6-4496-885e-ab44dfd096ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2804fa2e96bf4c6981c1100c536521dc'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:30.931669 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 867/1721] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:48:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:48:30.932317 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-71905705-fad6-4496-885e-ab44dfd096ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2804fa2e96bf4c6981c1100c536521dc'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:30.933984 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b970581-fa1b-4838-9088-d383587cd7f2 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:30.934843 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b970581-fa1b-4838-9088-d383587cd7f2 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:30.935566 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b970581-fa1b-4838-9088-d383587cd7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:30.951502 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-71905705-fad6-4496-885e-ab44dfd096ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2804fa2e96bf4c6981c1100c536521dc'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:30.952312 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-71905705-fad6-4496-885e-ab44dfd096ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2804fa2e96bf4c6981c1100c536521dc'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:30.954922 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:30.996043 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 855/1722] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 08:48:30 2022] DELETE /identity/v3/users/2804fa2e96bf4c6981c1100c536521dc => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:30.996043 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71905705-fad6-4496-885e-ab44dfd096ea admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:30.997417 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-71905705-fad6-4496-885e-ab44dfd096ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:31.013696 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-7b970581-fa1b-4838-9088-d383587cd7f2 None None] MFA Rules not processed for user `b5a4250771db454a88bbb1c88ed17b66`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:31.016662 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-7b970581-fa1b-4838-9088-d383587cd7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:31.175322 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:31.178836 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71905705-fad6-4496-885e-ab44dfd096ea admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:31.190240 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2470d674-1481-4d44-8aa8-401145185958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:31.190716 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 868/1723] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:31.191660 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b970581-fa1b-4838-9088-d383587cd7f2 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:31.192603 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470d674-1481-4d44-8aa8-401145185958 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:31.193519 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470d674-1481-4d44-8aa8-401145185958 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:31.193519 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470d674-1481-4d44-8aa8-401145185958 admin admin] PATH_INFO: `/v3/users/b26c58f2e12a4824abb71088f1f3b2c8` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:31.195235 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2470d674-1481-4d44-8aa8-401145185958 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b26c58f2e12a4824abb71088f1f3b2c8)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:31.199196 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2470d674-1481-4d44-8aa8-401145185958 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:31.208578 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-7b970581-fa1b-4838-9088-d383587cd7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:31.232087 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b970581-fa1b-4838-9088-d383587cd7f2 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:31.246440 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c681d388-0a95-451a-b5e2-26215a6dae6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:31.247358 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c681d388-0a95-451a-b5e2-26215a6dae6a admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:31.247641 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c681d388-0a95-451a-b5e2-26215a6dae6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:31.247918 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c681d388-0a95-451a-b5e2-26215a6dae6a admin admin] PATH_INFO: `/v3/projects/e4d08d5af5ed46f38e319867713edfbc/users/4f630870f8e7403abda9851224ba15ec/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:31.260467 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c681d388-0a95-451a-b5e2-26215a6dae6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4d08d5af5ed46f38e319867713edfbc, user_id=4f630870f8e7403abda9851224ba15ec, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:31.263479 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c681d388-0a95-451a-b5e2-26215a6dae6a admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:31.288033 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 869/1724] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:48:31 2022] PUT /identity/v3/projects/e4d08d5af5ed46f38e319867713edfbc/users/4f630870f8e7403abda9851224ba15ec/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:31.288861 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c681d388-0a95-451a-b5e2-26215a6dae6a admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:31.296649 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-c681d388-0a95-451a-b5e2-26215a6dae6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:31.316831 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-2470d674-1481-4d44-8aa8-401145185958 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b26c58f2e12a4824abb71088f1f3b2c8'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:31.326416 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-2470d674-1481-4d44-8aa8-401145185958 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b26c58f2e12a4824abb71088f1f3b2c8'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:31.327931 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-2470d674-1481-4d44-8aa8-401145185958 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b26c58f2e12a4824abb71088f1f3b2c8'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:31.345405 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-2470d674-1481-4d44-8aa8-401145185958 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b26c58f2e12a4824abb71088f1f3b2c8'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:31.348077 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-2470d674-1481-4d44-8aa8-401145185958 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b26c58f2e12a4824abb71088f1f3b2c8'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:31.381604 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 856/1725] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 08:48:30 2022] DELETE /identity/v3/users/b26c58f2e12a4824abb71088f1f3b2c8 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:31.383952 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e23e4f-7824-414a-9ced-f46aee456ed3 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:31.384254 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e23e4f-7824-414a-9ced-f46aee456ed3 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:31.385119 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e23e4f-7824-414a-9ced-f46aee456ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:31.415376 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-29e23e4f-7824-414a-9ced-f46aee456ed3 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:31.416715 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-29e23e4f-7824-414a-9ced-f46aee456ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:31.457794 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c681d388-0a95-451a-b5e2-26215a6dae6a admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:31.516842 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:31.535552 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 857/1726] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:31.539914 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303e67d-3122-41c5-ab65-594895b4145e None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:31.540288 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303e67d-3122-41c5-ab65-594895b4145e None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:31.540600 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303e67d-3122-41c5-ab65-594895b4145e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:31.565261 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-4303e67d-3122-41c5-ab65-594895b4145e None None] MFA Rules not processed for user `b5a4250771db454a88bbb1c88ed17b66`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:31.566818 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-4303e67d-3122-41c5-ab65-594895b4145e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:31.580556 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533cc366-6328-492e-9d5d-4ccd1b7ef289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:31.581400 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533cc366-6328-492e-9d5d-4ccd1b7ef289 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:31.581685 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533cc366-6328-492e-9d5d-4ccd1b7ef289 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:31.581965 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533cc366-6328-492e-9d5d-4ccd1b7ef289 admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:31.582692 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533cc366-6328-492e-9d5d-4ccd1b7ef289 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:31.585183 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533cc366-6328-492e-9d5d-4ccd1b7ef289 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:31.641862 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 870/1727] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 08:48:31 2022] POST /identity/v3/projects => generated 387 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:31.643260 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e09df-5d9a-4bf6-bb3e-ca0857404ea6 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:31.644305 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e09df-5d9a-4bf6-bb3e-ca0857404ea6 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:31.648367 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e09df-5d9a-4bf6-bb3e-ca0857404ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:31.668856 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 858/1728] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:31.668856 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303e67d-3122-41c5-ab65-594895b4145e None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:31.669399 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-4303e67d-3122-41c5-ab65-594895b4145e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:31.734544 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-b27e09df-5d9a-4bf6-bb3e-ca0857404ea6 None None] MFA Rules not processed for user `4f630870f8e7403abda9851224ba15ec`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:31.735935 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-b27e09df-5d9a-4bf6-bb3e-ca0857404ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:31.769995 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303e67d-3122-41c5-ab65-594895b4145e None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:31.839980 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 871/1729] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:31 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:31.840932 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e09df-5d9a-4bf6-bb3e-ca0857404ea6 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:31.842403 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-b27e09df-5d9a-4bf6-bb3e-ca0857404ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:31.851835 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:31.868323 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cfcc61-278b-457c-92b5-73eac25caecc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:31.869147 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cfcc61-278b-457c-92b5-73eac25caecc service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:31.869441 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cfcc61-278b-457c-92b5-73eac25caecc service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:31.870443 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cfcc61-278b-457c-92b5-73eac25caecc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:31.941716 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e09df-5d9a-4bf6-bb3e-ca0857404ea6 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:31.950599 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392bed5-e9fd-47e3-b6dc-732e97a7dce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:31.951293 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392bed5-e9fd-47e3-b6dc-732e97a7dce5 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:31.951577 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392bed5-e9fd-47e3-b6dc-732e97a7dce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:31.951855 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392bed5-e9fd-47e3-b6dc-732e97a7dce5 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:31.952567 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4392bed5-e9fd-47e3-b6dc-732e97a7dce5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:31.955292 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4392bed5-e9fd-47e3-b6dc-732e97a7dce5 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:31.983333 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 872/1730] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 08:48:31 2022] POST /identity/v3/users => generated 300 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:31.984538 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392bed5-e9fd-47e3-b6dc-732e97a7dce5 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:31.987406 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-4392bed5-e9fd-47e3-b6dc-732e97a7dce5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:32.002552 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cfcc61-278b-457c-92b5-73eac25caecc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:32.007719 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cfcc61-278b-457c-92b5-73eac25caecc service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:32.044273 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 859/1731] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:48:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:48:32.046840 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cfcc61-278b-457c-92b5-73eac25caecc service neutron] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:32.048479 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-28cfcc61-278b-457c-92b5-73eac25caecc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:32.069173 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:32.157023 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392bed5-e9fd-47e3-b6dc-732e97a7dce5 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:32.164592 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cfcc61-278b-457c-92b5-73eac25caecc service neutron] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:32.166595 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d9b02-770a-40a2-9ed5-8c4cb796515c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f1809a35b244c1db7a185d82859369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:32.167538 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d9b02-770a-40a2-9ed5-8c4cb796515c service nova] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:32.167538 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d9b02-770a-40a2-9ed5-8c4cb796515c service nova] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:32.167892 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d9b02-770a-40a2-9ed5-8c4cb796515c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:32.169209 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98594761-7c9a-4b27-a40c-f0a8382d647f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:32.169878 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98594761-7c9a-4b27-a40c-f0a8382d647f service cinder] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:32.170192 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98594761-7c9a-4b27-a40c-f0a8382d647f service cinder] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:32.170475 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98594761-7c9a-4b27-a40c-f0a8382d647f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:32.174489 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-f87d9b02-770a-40a2-9ed5-8c4cb796515c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:32.195337 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98594761-7c9a-4b27-a40c-f0a8382d647f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:32.198307 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98594761-7c9a-4b27-a40c-f0a8382d647f service cinder] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:32.218551 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 860/1732] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:48:32 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:48:32.219513 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98594761-7c9a-4b27-a40c-f0a8382d647f service cinder] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:32.240652 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98594761-7c9a-4b27-a40c-f0a8382d647f service cinder] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:32.260306 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c54723-ef05-4e91-b4d4-2d850156f8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:32.262265 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c54723-ef05-4e91-b4d4-2d850156f8c1 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:32.262265 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c54723-ef05-4e91-b4d4-2d850156f8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:32.262265 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c54723-ef05-4e91-b4d4-2d850156f8c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:32.262629 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c54723-ef05-4e91-b4d4-2d850156f8c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:32.264554 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c54723-ef05-4e91-b4d4-2d850156f8c1 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:32.285021 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 861/1733] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:48:32.289370 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c54723-ef05-4e91-b4d4-2d850156f8c1 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:32.315815 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c54723-ef05-4e91-b4d4-2d850156f8c1 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:32.328853 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8825e5-4f62-46f1-a8a4-4fdb4c6d5ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:32.329761 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8825e5-4f62-46f1-a8a4-4fdb4c6d5ba5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:32.330041 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8825e5-4f62-46f1-a8a4-4fdb4c6d5ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:32.330345 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8825e5-4f62-46f1-a8a4-4fdb4c6d5ba5 admin admin] PATH_INFO: `/v3/projects/00b179ce05564f5cadd27bdd0f25d8d4/users/86876c245f2647e989347aa55722a5de/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:32.345372 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87d9b02-770a-40a2-9ed5-8c4cb796515c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:32.347884 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87d9b02-770a-40a2-9ed5-8c4cb796515c service nova] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:32.362379 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8825e5-4f62-46f1-a8a4-4fdb4c6d5ba5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00b179ce05564f5cadd27bdd0f25d8d4, user_id=86876c245f2647e989347aa55722a5de, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:32.365675 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8825e5-4f62-46f1-a8a4-4fdb4c6d5ba5 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:32.367985 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 873/1734] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:48:31 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:48:32.381814 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d9b02-770a-40a2-9ed5-8c4cb796515c service nova] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:32.389027 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-f87d9b02-770a-40a2-9ed5-8c4cb796515c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:32.390286 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 862/1735] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:48:32 2022] PUT /identity/v3/projects/00b179ce05564f5cadd27bdd0f25d8d4/users/86876c245f2647e989347aa55722a5de/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:32.394196 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8825e5-4f62-46f1-a8a4-4fdb4c6d5ba5 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:32.416499 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d9b02-770a-40a2-9ed5-8c4cb796515c service nova] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:32.485048 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:32.542265 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034ab09-9121-4adb-8190-685449a671cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:32.544289 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034ab09-9121-4adb-8190-685449a671cb service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:32.545182 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034ab09-9121-4adb-8190-685449a671cb service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:32.546334 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034ab09-9121-4adb-8190-685449a671cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:32.551305 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-1034ab09-9121-4adb-8190-685449a671cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:32.567861 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8825e5-4f62-46f1-a8a4-4fdb4c6d5ba5 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:32.575090 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01cc728-38c7-4d4e-ba84-5473b41f900b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:32.575633 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01cc728-38c7-4d4e-ba84-5473b41f900b admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:32.575926 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01cc728-38c7-4d4e-ba84-5473b41f900b admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:32.576211 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01cc728-38c7-4d4e-ba84-5473b41f900b admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:32.576959 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01cc728-38c7-4d4e-ba84-5473b41f900b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:32.579290 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01cc728-38c7-4d4e-ba84-5473b41f900b admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:32.618324 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 863/1736] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:48:32.619539 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01cc728-38c7-4d4e-ba84-5473b41f900b admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:32.623192 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-d01cc728-38c7-4d4e-ba84-5473b41f900b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:32.671908 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01cc728-38c7-4d4e-ba84-5473b41f900b admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:32.677632 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034ab09-9121-4adb-8190-685449a671cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:32.679708 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034ab09-9121-4adb-8190-685449a671cb service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:32.693375 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b02319-b8ab-4f40-8c78-36112c6d8b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:32.694323 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b02319-b8ab-4f40-8c78-36112c6d8b5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:32.694616 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b02319-b8ab-4f40-8c78-36112c6d8b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:32.696776 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b02319-b8ab-4f40-8c78-36112c6d8b5a admin admin] PATH_INFO: `/v3/projects/e9d0843b9dbe43a0b26741a5ebcde211` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:32.701869 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b02319-b8ab-4f40-8c78-36112c6d8b5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9d0843b9dbe43a0b26741a5ebcde211)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:32.702501 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 874/1737] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:48:32 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:48:32.703356 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034ab09-9121-4adb-8190-685449a671cb service cinder] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:32.704903 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b02319-b8ab-4f40-8c78-36112c6d8b5a admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:32.727487 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034ab09-9121-4adb-8190-685449a671cb service cinder] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:32.741459 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5618f21-3ed6-4933-8e0e-cdf9d87212b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:32.743106 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5618f21-3ed6-4933-8e0e-cdf9d87212b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:32.743405 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5618f21-3ed6-4933-8e0e-cdf9d87212b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:32.743691 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5618f21-3ed6-4933-8e0e-cdf9d87212b0 admin admin] PATH_INFO: `/v3/projects/00b179ce05564f5cadd27bdd0f25d8d4/users/86876c245f2647e989347aa55722a5de/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:32.746893 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5618f21-3ed6-4933-8e0e-cdf9d87212b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00b179ce05564f5cadd27bdd0f25d8d4, user_id=86876c245f2647e989347aa55722a5de, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:32.756272 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5618f21-3ed6-4933-8e0e-cdf9d87212b0 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:32.784382 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 875/1738] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:48:32 2022] PUT /identity/v3/projects/00b179ce05564f5cadd27bdd0f25d8d4/users/86876c245f2647e989347aa55722a5de/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:32.800406 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5537e-df5e-4192-a023-e12cc6f2cea3 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:32.800406 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5537e-df5e-4192-a023-e12cc6f2cea3 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:32.801082 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5537e-df5e-4192-a023-e12cc6f2cea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:32.866894 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-97d5537e-df5e-4192-a023-e12cc6f2cea3 None None] MFA Rules not processed for user `86876c245f2647e989347aa55722a5de`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:32.868144 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-97d5537e-df5e-4192-a023-e12cc6f2cea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:32.873699 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-f9b02319-b8ab-4f40-8c78-36112c6d8b5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9d0843b9dbe43a0b26741a5ebcde211', 'request_id': 'req-f9b02319-b8ab-4f40-8c78-36112c6d8b5a'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:32.885732 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-f9b02319-b8ab-4f40-8c78-36112c6d8b5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9d0843b9dbe43a0b26741a5ebcde211', 'request_id': 'req-f9b02319-b8ab-4f40-8c78-36112c6d8b5a'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:32.907576 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-f9b02319-b8ab-4f40-8c78-36112c6d8b5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9d0843b9dbe43a0b26741a5ebcde211', 'request_id': 'req-f9b02319-b8ab-4f40-8c78-36112c6d8b5a'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:32.930393 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:32.936730 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-f9b02319-b8ab-4f40-8c78-36112c6d8b5a admin admin] The token cache is being invalidate because project e9d0843b9dbe43a0b26741a5ebcde211 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 08:48:32.937045 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-f9b02319-b8ab-4f40-8c78-36112c6d8b5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:32.939165 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-f9b02319-b8ab-4f40-8c78-36112c6d8b5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:32.944209 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 864/1739] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 08:48:32 2022] DELETE /identity/v3/projects/e9d0843b9dbe43a0b26741a5ebcde211 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:32.949085 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b02319-b8ab-4f40-8c78-36112c6d8b5a admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:32.953277 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-f9b02319-b8ab-4f40-8c78-36112c6d8b5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:33.114796 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 876/1740] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:32 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:33.140346 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d5537e-df5e-4192-a023-e12cc6f2cea3 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:33.143456 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-97d5537e-df5e-4192-a023-e12cc6f2cea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:33.222942 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b02319-b8ab-4f40-8c78-36112c6d8b5a admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:33.259963 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f7b2f-4ff4-43ea-af6e-1a9452ad7052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:33.261330 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f7b2f-4ff4-43ea-af6e-1a9452ad7052 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:33.274403 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f7b2f-4ff4-43ea-af6e-1a9452ad7052 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:33.274818 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f7b2f-4ff4-43ea-af6e-1a9452ad7052 admin admin] PATH_INFO: `/v3/users/bb06f03883b44b2ea752603ae08bc864` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:33.283541 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982f7b2f-4ff4-43ea-af6e-1a9452ad7052 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb06f03883b44b2ea752603ae08bc864)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:33.287258 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982f7b2f-4ff4-43ea-af6e-1a9452ad7052 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:33.413608 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d5537e-df5e-4192-a023-e12cc6f2cea3 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:33.428527 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90086fba-67ab-45e4-8411-0b3bfccdb384 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:33.430449 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90086fba-67ab-45e4-8411-0b3bfccdb384 service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:33.430779 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90086fba-67ab-45e4-8411-0b3bfccdb384 service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:33.431068 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90086fba-67ab-45e4-8411-0b3bfccdb384 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:33.456563 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-982f7b2f-4ff4-43ea-af6e-1a9452ad7052 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb06f03883b44b2ea752603ae08bc864'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:33.460800 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90086fba-67ab-45e4-8411-0b3bfccdb384 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:33.470896 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90086fba-67ab-45e4-8411-0b3bfccdb384 service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:33.479146 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-982f7b2f-4ff4-43ea-af6e-1a9452ad7052 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb06f03883b44b2ea752603ae08bc864'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:33.481685 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-982f7b2f-4ff4-43ea-af6e-1a9452ad7052 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb06f03883b44b2ea752603ae08bc864'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:33.487371 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:33.505920 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 877/1741] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:48:33 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:48:33.510272 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90086fba-67ab-45e4-8411-0b3bfccdb384 service cinder] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:33.511284 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-982f7b2f-4ff4-43ea-af6e-1a9452ad7052 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb06f03883b44b2ea752603ae08bc864'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:33.515485 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-90086fba-67ab-45e4-8411-0b3bfccdb384 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:33.516155 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-982f7b2f-4ff4-43ea-af6e-1a9452ad7052 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb06f03883b44b2ea752603ae08bc864'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:33.563314 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 865/1742] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 08:48:32 2022] DELETE /identity/v3/users/bb06f03883b44b2ea752603ae08bc864 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 08:48:33.571290 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f7b2f-4ff4-43ea-af6e-1a9452ad7052 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:33.573488 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90086fba-67ab-45e4-8411-0b3bfccdb384 service cinder] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:33.575442 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-982f7b2f-4ff4-43ea-af6e-1a9452ad7052 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:33.741333 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b36edf-972b-40a3-aa62-cf44c940e173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:33.743468 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f7b2f-4ff4-43ea-af6e-1a9452ad7052 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:33.744358 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b36edf-972b-40a3-aa62-cf44c940e173 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:33.744649 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b36edf-972b-40a3-aa62-cf44c940e173 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:33.744933 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b36edf-972b-40a3-aa62-cf44c940e173 admin admin] PATH_INFO: `/v3/users/41bce23fb7204d37abc583101f746622` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:33.749591 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b36edf-972b-40a3-aa62-cf44c940e173 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41bce23fb7204d37abc583101f746622)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:33.755126 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b36edf-972b-40a3-aa62-cf44c940e173 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:33.756807 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61b7c76-422d-4f39-92eb-116f32cda7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:33.757742 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61b7c76-422d-4f39-92eb-116f32cda7c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:33.758027 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61b7c76-422d-4f39-92eb-116f32cda7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:33.758332 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61b7c76-422d-4f39-92eb-116f32cda7c3 admin admin] PATH_INFO: `/v3/users/e27ba46b52644c12b1a7a7cdf2c10d6e` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:33.760965 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61b7c76-422d-4f39-92eb-116f32cda7c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e27ba46b52644c12b1a7a7cdf2c10d6e)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:33.763253 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61b7c76-422d-4f39-92eb-116f32cda7c3 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:33.815000 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:33.889203 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-d61b7c76-422d-4f39-92eb-116f32cda7c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e27ba46b52644c12b1a7a7cdf2c10d6e'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:33.911811 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-d61b7c76-422d-4f39-92eb-116f32cda7c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e27ba46b52644c12b1a7a7cdf2c10d6e'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:33.912759 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-d61b7c76-422d-4f39-92eb-116f32cda7c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e27ba46b52644c12b1a7a7cdf2c10d6e'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:33.927430 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-d61b7c76-422d-4f39-92eb-116f32cda7c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e27ba46b52644c12b1a7a7cdf2c10d6e'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:33.928183 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-d61b7c76-422d-4f39-92eb-116f32cda7c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e27ba46b52644c12b1a7a7cdf2c10d6e'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:33.943751 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-35b36edf-972b-40a3-aa62-cf44c940e173 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41bce23fb7204d37abc583101f746622'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:33.961162 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-35b36edf-972b-40a3-aa62-cf44c940e173 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41bce23fb7204d37abc583101f746622'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:33.962017 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-35b36edf-972b-40a3-aa62-cf44c940e173 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41bce23fb7204d37abc583101f746622'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:33.966723 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 866/1743] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 08:48:33 2022] DELETE /identity/v3/users/e27ba46b52644c12b1a7a7cdf2c10d6e => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 08:48:33.968326 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b296a589-5b13-471f-a2ac-ab2698bcdb4c None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:33.968672 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b296a589-5b13-471f-a2ac-ab2698bcdb4c None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:33.970491 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b296a589-5b13-471f-a2ac-ab2698bcdb4c None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:33.974984 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 867/1744] 10.222.0.42 () {54 vars in 912 bytes} [Wed Jun 22 08:48:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:48:33.978121 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd5665-6d18-4815-a156-881003eca28e None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:33.979647 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd5665-6d18-4815-a156-881003eca28e None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:33.979893 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd5665-6d18-4815-a156-881003eca28e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:33.982692 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-35b36edf-972b-40a3-aa62-cf44c940e173 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41bce23fb7204d37abc583101f746622'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:33.983695 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-35b36edf-972b-40a3-aa62-cf44c940e173 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41bce23fb7204d37abc583101f746622'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:34.022645 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-34dd5665-6d18-4815-a156-881003eca28e None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:34.024106 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-34dd5665-6d18-4815-a156-881003eca28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:34.029855 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 878/1745] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 08:48:33 2022] DELETE /identity/v3/users/41bce23fb7204d37abc583101f746622 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:34.031455 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723396dd-cfda-4f49-a13c-6360a834c829 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:34.031752 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723396dd-cfda-4f49-a13c-6360a834c829 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:34.032140 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723396dd-cfda-4f49-a13c-6360a834c829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:34.110458 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-723396dd-cfda-4f49-a13c-6360a834c829 None None] MFA Rules not processed for user `751f037ff70d4eb8acb4e8d4c5c487ad`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:34.118887 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-723396dd-cfda-4f49-a13c-6360a834c829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:34.214396 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 879/1746] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Jun 22 08:48:34 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:34.215784 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abbda76-35da-48e7-a8c4-38ccb946564f None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:34.216079 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abbda76-35da-48e7-a8c4-38ccb946564f None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:34.216361 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abbda76-35da-48e7-a8c4-38ccb946564f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:34.269562 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 868/1747] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:34.275599 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-4abbda76-35da-48e7-a8c4-38ccb946564f None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:34.282753 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-4abbda76-35da-48e7-a8c4-38ccb946564f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:34.311750 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 880/1748] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:34.371974 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd5665-6d18-4815-a156-881003eca28e None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:34.378491 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-34dd5665-6d18-4815-a156-881003eca28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:34.412225 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd5665-6d18-4815-a156-881003eca28e None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:34.421255 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0498f3-577d-490f-89cf-b56be588d926 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:34.423098 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0498f3-577d-490f-89cf-b56be588d926 service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:34.423395 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0498f3-577d-490f-89cf-b56be588d926 service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:34.423678 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0498f3-577d-490f-89cf-b56be588d926 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:34.447088 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0498f3-577d-490f-89cf-b56be588d926 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:34.454553 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0498f3-577d-490f-89cf-b56be588d926 service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:34.485786 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 869/1749] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:48:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:48:34.490266 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abbda76-35da-48e7-a8c4-38ccb946564f None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:34.492417 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-4abbda76-35da-48e7-a8c4-38ccb946564f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:34.517306 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0498f3-577d-490f-89cf-b56be588d926 service neutron] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:34.519556 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-ac0498f3-577d-490f-89cf-b56be588d926 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:34.529589 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abbda76-35da-48e7-a8c4-38ccb946564f None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:34.537384 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0498f3-577d-490f-89cf-b56be588d926 service neutron] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:34.546163 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a56fbc5-e3fe-425d-896f-1d2c3210b5c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:34.547104 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56fbc5-e3fe-425d-896f-1d2c3210b5c3 service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:34.547620 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56fbc5-e3fe-425d-896f-1d2c3210b5c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:34.548143 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56fbc5-e3fe-425d-896f-1d2c3210b5c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:34.554890 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb14c7b-a6f4-493f-9bec-f98b844bbce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:34.556194 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb14c7b-a6f4-493f-9bec-f98b844bbce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:34.556478 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb14c7b-a6f4-493f-9bec-f98b844bbce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:34.556754 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb14c7b-a6f4-493f-9bec-f98b844bbce1 admin admin] PATH_INFO: `/v3/projects/a25acf73bbfd460780252657a794db93` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:34.558149 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb14c7b-a6f4-493f-9bec-f98b844bbce1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a25acf73bbfd460780252657a794db93)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:34.562679 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb14c7b-a6f4-493f-9bec-f98b844bbce1 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:34.565452 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:34.585365 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a56fbc5-e3fe-425d-896f-1d2c3210b5c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:34.586917 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a56fbc5-e3fe-425d-896f-1d2c3210b5c3 service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:34.619639 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 870/1750] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:48:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 08:48:34.697481 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-bdb14c7b-a6f4-493f-9bec-f98b844bbce1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a25acf73bbfd460780252657a794db93', 'request_id': 'req-bdb14c7b-a6f4-493f-9bec-f98b844bbce1'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:34.712843 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-bdb14c7b-a6f4-493f-9bec-f98b844bbce1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a25acf73bbfd460780252657a794db93', 'request_id': 'req-bdb14c7b-a6f4-493f-9bec-f98b844bbce1'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:34.731312 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-bdb14c7b-a6f4-493f-9bec-f98b844bbce1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a25acf73bbfd460780252657a794db93', 'request_id': 'req-bdb14c7b-a6f4-493f-9bec-f98b844bbce1'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:34.751888 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-bdb14c7b-a6f4-493f-9bec-f98b844bbce1 admin admin] The token cache is being invalidate because project a25acf73bbfd460780252657a794db93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 08:48:34.752186 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-bdb14c7b-a6f4-493f-9bec-f98b844bbce1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:34.763847 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-bdb14c7b-a6f4-493f-9bec-f98b844bbce1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:34.769269 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 881/1751] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 08:48:34 2022] DELETE /identity/v3/projects/a25acf73bbfd460780252657a794db93 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:34.770714 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a56fbc5-e3fe-425d-896f-1d2c3210b5c3 service neutron] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:34.785647 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a56fbc5-e3fe-425d-896f-1d2c3210b5c3 service neutron] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:34.928719 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c936c5b0-d126-4204-a376-0d67fa7b823e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:34.929735 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936c5b0-d126-4204-a376-0d67fa7b823e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:34.930023 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936c5b0-d126-4204-a376-0d67fa7b823e admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:34.930381 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936c5b0-d126-4204-a376-0d67fa7b823e admin admin] PATH_INFO: `/v3/users/9d367544b8e74f73be47424df9d5d8b9` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:34.930489 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb14c7b-a6f4-493f-9bec-f98b844bbce1 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:34.931869 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c936c5b0-d126-4204-a376-0d67fa7b823e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d367544b8e74f73be47424df9d5d8b9)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:34.932839 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-bdb14c7b-a6f4-493f-9bec-f98b844bbce1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:34.943183 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c936c5b0-d126-4204-a376-0d67fa7b823e admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:34.970994 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:35.039192 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-c936c5b0-d126-4204-a376-0d67fa7b823e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d367544b8e74f73be47424df9d5d8b9'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:35.047582 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-c936c5b0-d126-4204-a376-0d67fa7b823e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d367544b8e74f73be47424df9d5d8b9'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:35.048956 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-c936c5b0-d126-4204-a376-0d67fa7b823e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d367544b8e74f73be47424df9d5d8b9'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:35.049520 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb14c7b-a6f4-493f-9bec-f98b844bbce1 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:35.060972 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487fb0d-935a-4716-921a-6331a4017370 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:35.061908 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487fb0d-935a-4716-921a-6331a4017370 service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:35.061908 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487fb0d-935a-4716-921a-6331a4017370 service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:35.062274 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487fb0d-935a-4716-921a-6331a4017370 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:35.065582 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-c936c5b0-d126-4204-a376-0d67fa7b823e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d367544b8e74f73be47424df9d5d8b9'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:35.066735 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-b487fb0d-935a-4716-921a-6331a4017370 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:35.072283 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-c936c5b0-d126-4204-a376-0d67fa7b823e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d367544b8e74f73be47424df9d5d8b9'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:35.080402 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b487fb0d-935a-4716-921a-6331a4017370 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:35.081926 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b487fb0d-935a-4716-921a-6331a4017370 service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:35.100692 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 882/1752] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:48:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:48:35.106803 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487fb0d-935a-4716-921a-6331a4017370 service neutron] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:35.110252 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 871/1753] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 08:48:34 2022] DELETE /identity/v3/users/9d367544b8e74f73be47424df9d5d8b9 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:35.110252 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47149b4a-b345-4e1f-8013-699723862c4a None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:35.110252 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47149b4a-b345-4e1f-8013-699723862c4a None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:35.110252 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47149b4a-b345-4e1f-8013-699723862c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:35.111884 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-b487fb0d-935a-4716-921a-6331a4017370 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:35.141747 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487fb0d-935a-4716-921a-6331a4017370 service neutron] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:35.204064 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-47149b4a-b345-4e1f-8013-699723862c4a None None] MFA Rules not processed for user `0a2c3b8979a84abf933ab3228cdff26c`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:35.206553 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-47149b4a-b345-4e1f-8013-699723862c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:35.367398 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d7825-f813-481c-8234-7895ad544343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:35.369638 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d7825-f813-481c-8234-7895ad544343 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:35.371510 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d7825-f813-481c-8234-7895ad544343 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:35.372016 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d7825-f813-481c-8234-7895ad544343 admin admin] PATH_INFO: `/v3/projects/545b2970f1b14a908b0960fa578d6ea7` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:35.375902 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718d7825-f813-481c-8234-7895ad544343 admin admin] RBAC: Authorizing `identity:delete_project(project_id=545b2970f1b14a908b0960fa578d6ea7)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:35.381258 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718d7825-f813-481c-8234-7895ad544343 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:35.390940 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 872/1754] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:35.399056 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47149b4a-b345-4e1f-8013-699723862c4a None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:35.400632 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-47149b4a-b345-4e1f-8013-699723862c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:35.480339 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:35.498848 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-718d7825-f813-481c-8234-7895ad544343 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '545b2970f1b14a908b0960fa578d6ea7', 'request_id': 'req-718d7825-f813-481c-8234-7895ad544343'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:35.520643 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-718d7825-f813-481c-8234-7895ad544343 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '545b2970f1b14a908b0960fa578d6ea7', 'request_id': 'req-718d7825-f813-481c-8234-7895ad544343'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:35.545194 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-718d7825-f813-481c-8234-7895ad544343 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '545b2970f1b14a908b0960fa578d6ea7', 'request_id': 'req-718d7825-f813-481c-8234-7895ad544343'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:35.586117 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-718d7825-f813-481c-8234-7895ad544343 admin admin] The token cache is being invalidate because project 545b2970f1b14a908b0960fa578d6ea7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 08:48:35.586117 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-718d7825-f813-481c-8234-7895ad544343 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:35.586844 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-718d7825-f813-481c-8234-7895ad544343 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:35.588782 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 883/1755] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 08:48:35 2022] DELETE /identity/v3/projects/545b2970f1b14a908b0960fa578d6ea7 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:35.594352 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465dc093-7bd7-4f00-ae08-02a9d8d4c422 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:35.594627 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465dc093-7bd7-4f00-ae08-02a9d8d4c422 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:35.595014 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465dc093-7bd7-4f00-ae08-02a9d8d4c422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:35.650247 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-465dc093-7bd7-4f00-ae08-02a9d8d4c422 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:35.653353 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-465dc093-7bd7-4f00-ae08-02a9d8d4c422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:35.686424 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47149b4a-b345-4e1f-8013-699723862c4a None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:35.708335 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:35.799226 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63563c69-c542-4db3-835d-badd59dc512c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f1809a35b244c1db7a185d82859369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:35.813560 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63563c69-c542-4db3-835d-badd59dc512c service nova] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:35.813560 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63563c69-c542-4db3-835d-badd59dc512c service nova] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:35.813560 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63563c69-c542-4db3-835d-badd59dc512c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:35.813560 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-63563c69-c542-4db3-835d-badd59dc512c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:35.814821 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 884/1756] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 08:48:35.820519 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad64d3-c728-4032-b1b5-a1cc2f2bbb1f None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:35.821037 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad64d3-c728-4032-b1b5-a1cc2f2bbb1f None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:35.821476 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad64d3-c728-4032-b1b5-a1cc2f2bbb1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:35.842312 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-65ad64d3-c728-4032-b1b5-a1cc2f2bbb1f None None] MFA Rules not processed for user `b5a4250771db454a88bbb1c88ed17b66`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:35.843537 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-65ad64d3-c728-4032-b1b5-a1cc2f2bbb1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:35.927600 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63563c69-c542-4db3-835d-badd59dc512c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:35.936706 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63563c69-c542-4db3-835d-badd59dc512c service nova] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:35.937948 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 885/1757] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 08:48:35.941669 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9194cdc-8978-4a7c-bae1-8a39c0fc6a1f None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:35.942522 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9194cdc-8978-4a7c-bae1-8a39c0fc6a1f None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:35.943787 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9194cdc-8978-4a7c-bae1-8a39c0fc6a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:35.976495 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 873/1758] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:48:35 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:48:35.977362 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63563c69-c542-4db3-835d-badd59dc512c service nova] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:35.980532 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-63563c69-c542-4db3-835d-badd59dc512c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:36.032854 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-b9194cdc-8978-4a7c-bae1-8a39c0fc6a1f None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:36.038636 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-b9194cdc-8978-4a7c-bae1-8a39c0fc6a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:36.104040 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 886/1759] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:36.108563 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9194cdc-8978-4a7c-bae1-8a39c0fc6a1f None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:36.135894 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9194cdc-8978-4a7c-bae1-8a39c0fc6a1f None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:36.164590 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3bc159-c731-45cc-a9f8-fe1248c7968d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:36.165654 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3bc159-c731-45cc-a9f8-fe1248c7968d admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:36.165809 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3bc159-c731-45cc-a9f8-fe1248c7968d admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:36.166359 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3bc159-c731-45cc-a9f8-fe1248c7968d admin admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:36.167437 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3bc159-c731-45cc-a9f8-fe1248c7968d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:36.172071 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3bc159-c731-45cc-a9f8-fe1248c7968d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:36.181390 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3bc159-c731-45cc-a9f8-fe1248c7968d admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:36.213068 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 887/1760] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Jun 22 08:48:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:48:36.219458 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3bc159-c731-45cc-a9f8-fe1248c7968d admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:36.248054 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63563c69-c542-4db3-835d-badd59dc512c service nova] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:36.275688 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa01a7f-854e-40a9-a08d-950fbfd48e4f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec2627e3cdc94ec38d7cc3b1bc670ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:36.277840 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa01a7f-854e-40a9-a08d-950fbfd48e4f service placement] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:36.278332 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa01a7f-854e-40a9-a08d-950fbfd48e4f service placement] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:36.281101 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa01a7f-854e-40a9-a08d-950fbfd48e4f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:36.281647 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3bc159-c731-45cc-a9f8-fe1248c7968d admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:36.286470 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-0fa01a7f-854e-40a9-a08d-950fbfd48e4f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:36.289346 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d62fed-8570-43bd-8a62-9d2c741e3e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:36.290364 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d62fed-8570-43bd-8a62-9d2c741e3e0b admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:36.290665 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d62fed-8570-43bd-8a62-9d2c741e3e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:36.291034 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d62fed-8570-43bd-8a62-9d2c741e3e0b admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:36.291812 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d62fed-8570-43bd-8a62-9d2c741e3e0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:36.294558 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d62fed-8570-43bd-8a62-9d2c741e3e0b admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:36.314016 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa01a7f-854e-40a9-a08d-950fbfd48e4f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:36.315757 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa01a7f-854e-40a9-a08d-950fbfd48e4f service placement] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:36.348055 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 874/1761] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:48:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:48:36.349235 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa01a7f-854e-40a9-a08d-950fbfd48e4f service placement] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:36.351954 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-0fa01a7f-854e-40a9-a08d-950fbfd48e4f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:36.385044 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa01a7f-854e-40a9-a08d-950fbfd48e4f service placement] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:36.396380 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d41d75-3440-4803-a536-44e2b10270bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:36.397268 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d41d75-3440-4803-a536-44e2b10270bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:36.397550 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d41d75-3440-4803-a536-44e2b10270bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:36.397829 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d41d75-3440-4803-a536-44e2b10270bf admin admin] PATH_INFO: `/v3/projects/bb5ba2c905a4464eb8a050794be350a1` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:36.410406 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d41d75-3440-4803-a536-44e2b10270bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb5ba2c905a4464eb8a050794be350a1)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:36.412959 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d41d75-3440-4803-a536-44e2b10270bf admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:36.429620 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 888/1762] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 08:48:36 2022] POST /identity/v3/projects => generated 379 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:36.431637 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d62fed-8570-43bd-8a62-9d2c741e3e0b admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:36.558157 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:36.566690 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:36.583847 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-71d41d75-3440-4803-a536-44e2b10270bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb5ba2c905a4464eb8a050794be350a1', 'request_id': 'req-71d41d75-3440-4803-a536-44e2b10270bf'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:36.608613 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-71d41d75-3440-4803-a536-44e2b10270bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb5ba2c905a4464eb8a050794be350a1', 'request_id': 'req-71d41d75-3440-4803-a536-44e2b10270bf'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:36.622059 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-71d41d75-3440-4803-a536-44e2b10270bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb5ba2c905a4464eb8a050794be350a1', 'request_id': 'req-71d41d75-3440-4803-a536-44e2b10270bf'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:36.682327 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-71d41d75-3440-4803-a536-44e2b10270bf admin admin] The token cache is being invalidate because project bb5ba2c905a4464eb8a050794be350a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 08:48:36.691395 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-71d41d75-3440-4803-a536-44e2b10270bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:36.691727 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d62fed-8570-43bd-8a62-9d2c741e3e0b admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:36.695529 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-71d41d75-3440-4803-a536-44e2b10270bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:36.700117 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 875/1763] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 08:48:36 2022] DELETE /identity/v3/projects/bb5ba2c905a4464eb8a050794be350a1 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:36.706250 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d41d75-3440-4803-a536-44e2b10270bf admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:36.712058 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-71d41d75-3440-4803-a536-44e2b10270bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:36.937624 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1931ff-6bc3-4f4c-bb43-1209c26ac3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:36.938793 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1931ff-6bc3-4f4c-bb43-1209c26ac3a1 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:36.938793 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1931ff-6bc3-4f4c-bb43-1209c26ac3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:36.938949 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1931ff-6bc3-4f4c-bb43-1209c26ac3a1 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:36.939618 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1931ff-6bc3-4f4c-bb43-1209c26ac3a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:36.943070 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1931ff-6bc3-4f4c-bb43-1209c26ac3a1 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:36.959865 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d41d75-3440-4803-a536-44e2b10270bf admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:36.969715 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb2f6c1-df4d-4546-bf84-3cbf527547dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:36.970862 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2f6c1-df4d-4546-bf84-3cbf527547dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:36.971452 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2f6c1-df4d-4546-bf84-3cbf527547dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:36.971452 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2f6c1-df4d-4546-bf84-3cbf527547dc admin admin] PATH_INFO: `/v3/users/86876c245f2647e989347aa55722a5de` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:36.976369 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb2f6c1-df4d-4546-bf84-3cbf527547dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=86876c245f2647e989347aa55722a5de)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:36.981382 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb2f6c1-df4d-4546-bf84-3cbf527547dc admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:36.990121 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 889/1764] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 08:48:36 2022] POST /identity/v3/users => generated 290 bytes in 560 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:36.991405 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1931ff-6bc3-4f4c-bb43-1209c26ac3a1 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:36.996494 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-ec1931ff-6bc3-4f4c-bb43-1209c26ac3a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:37.037194 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1931ff-6bc3-4f4c-bb43-1209c26ac3a1 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:37.055647 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f609ddad-6055-4558-a14c-9f5f7cd18ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:37.056391 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f609ddad-6055-4558-a14c-9f5f7cd18ddc admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:37.056678 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f609ddad-6055-4558-a14c-9f5f7cd18ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:37.057001 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f609ddad-6055-4558-a14c-9f5f7cd18ddc admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:37.057754 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f609ddad-6055-4558-a14c-9f5f7cd18ddc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:37.064176 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f609ddad-6055-4558-a14c-9f5f7cd18ddc admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:37.103924 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 890/1765] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:48:36 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:48:37.110895 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f609ddad-6055-4558-a14c-9f5f7cd18ddc admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:37.122545 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-3fb2f6c1-df4d-4546-bf84-3cbf527547dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86876c245f2647e989347aa55722a5de'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:37.135412 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f609ddad-6055-4558-a14c-9f5f7cd18ddc admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:37.139076 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-3fb2f6c1-df4d-4546-bf84-3cbf527547dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86876c245f2647e989347aa55722a5de'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:37.139975 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-3fb2f6c1-df4d-4546-bf84-3cbf527547dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86876c245f2647e989347aa55722a5de'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:37.150042 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2852a8-e70d-421c-a912-6707dffdf4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:37.150613 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2852a8-e70d-421c-a912-6707dffdf4af admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:37.150893 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2852a8-e70d-421c-a912-6707dffdf4af admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:37.151232 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2852a8-e70d-421c-a912-6707dffdf4af admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:37.151975 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2852a8-e70d-421c-a912-6707dffdf4af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:37.153949 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2852a8-e70d-421c-a912-6707dffdf4af admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:37.158848 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-3fb2f6c1-df4d-4546-bf84-3cbf527547dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86876c245f2647e989347aa55722a5de'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:37.159477 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-3fb2f6c1-df4d-4546-bf84-3cbf527547dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86876c245f2647e989347aa55722a5de'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:37.184165 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 891/1766] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:48:37 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:48:37.184795 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2852a8-e70d-421c-a912-6707dffdf4af admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:37.189269 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-3b2852a8-e70d-421c-a912-6707dffdf4af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:37.201434 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 876/1767] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 08:48:36 2022] DELETE /identity/v3/users/86876c245f2647e989347aa55722a5de => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:37.212679 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2852a8-e70d-421c-a912-6707dffdf4af admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:37.310815 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ae2797-935c-4d33-8840-67ef5f6c8028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:37.313746 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae2797-935c-4d33-8840-67ef5f6c8028 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:37.314433 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae2797-935c-4d33-8840-67ef5f6c8028 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:37.314822 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae2797-935c-4d33-8840-67ef5f6c8028 admin admin] PATH_INFO: `/v3/projects/63966d32fce34983ac2fa378e2f09f7f/users/c670cfdf87284e0ba701e8d4fafc2e17/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:37.341918 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ae2797-935c-4d33-8840-67ef5f6c8028 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63966d32fce34983ac2fa378e2f09f7f, user_id=c670cfdf87284e0ba701e8d4fafc2e17, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:37.353753 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ae2797-935c-4d33-8840-67ef5f6c8028 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:37.380959 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 892/1768] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:48:37 2022] PUT /identity/v3/projects/63966d32fce34983ac2fa378e2f09f7f/users/c670cfdf87284e0ba701e8d4fafc2e17/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:37.391965 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97613139-8f21-4c5b-9524-35741a703077 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:37.392307 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97613139-8f21-4c5b-9524-35741a703077 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:37.392522 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97613139-8f21-4c5b-9524-35741a703077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:37.467920 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-97613139-8f21-4c5b-9524-35741a703077 None None] MFA Rules not processed for user `c670cfdf87284e0ba701e8d4fafc2e17`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:37.470556 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-97613139-8f21-4c5b-9524-35741a703077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:37.535639 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:37.606786 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 877/1769] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:37.609058 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ae2797-935c-4d33-8840-67ef5f6c8028 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:37.650993 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97613139-8f21-4c5b-9524-35741a703077 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:37.652483 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-97613139-8f21-4c5b-9524-35741a703077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:37.678722 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:37.821735 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ae2797-935c-4d33-8840-67ef5f6c8028 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:37.842037 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75691fdc-fb7a-4970-a749-2581e7fdd56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:37.843059 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75691fdc-fb7a-4970-a749-2581e7fdd56c admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:37.843618 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75691fdc-fb7a-4970-a749-2581e7fdd56c admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:37.845368 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75691fdc-fb7a-4970-a749-2581e7fdd56c admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:37.848671 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75691fdc-fb7a-4970-a749-2581e7fdd56c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:37.863379 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75691fdc-fb7a-4970-a749-2581e7fdd56c admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:37.886994 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97613139-8f21-4c5b-9524-35741a703077 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:37.928873 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbaaa11-e864-42b9-aeae-3ba31a5b1c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:37.935993 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbaaa11-e864-42b9-aeae-3ba31a5b1c37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:37.936904 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbaaa11-e864-42b9-aeae-3ba31a5b1c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:37.937510 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbaaa11-e864-42b9-aeae-3ba31a5b1c37 admin admin] PATH_INFO: `/v3/projects/dc788fef8b8149b2b8afb764eae18c3e` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:37.940372 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbaaa11-e864-42b9-aeae-3ba31a5b1c37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc788fef8b8149b2b8afb764eae18c3e)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:37.944290 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbaaa11-e864-42b9-aeae-3ba31a5b1c37 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:37.975017 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 893/1770] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 08:48:37 2022] POST /identity/v3/projects => generated 381 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:37.980467 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75691fdc-fb7a-4970-a749-2581e7fdd56c admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:38.194463 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-2fbaaa11-e864-42b9-aeae-3ba31a5b1c37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc788fef8b8149b2b8afb764eae18c3e', 'request_id': 'req-2fbaaa11-e864-42b9-aeae-3ba31a5b1c37'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:38.196517 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75691fdc-fb7a-4970-a749-2581e7fdd56c admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:38.221958 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-2fbaaa11-e864-42b9-aeae-3ba31a5b1c37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc788fef8b8149b2b8afb764eae18c3e', 'request_id': 'req-2fbaaa11-e864-42b9-aeae-3ba31a5b1c37'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:38.253808 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-2fbaaa11-e864-42b9-aeae-3ba31a5b1c37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc788fef8b8149b2b8afb764eae18c3e', 'request_id': 'req-2fbaaa11-e864-42b9-aeae-3ba31a5b1c37'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:38.287789 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-2fbaaa11-e864-42b9-aeae-3ba31a5b1c37 admin admin] The token cache is being invalidate because project dc788fef8b8149b2b8afb764eae18c3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 08:48:38.288138 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-2fbaaa11-e864-42b9-aeae-3ba31a5b1c37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:38.292385 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-2fbaaa11-e864-42b9-aeae-3ba31a5b1c37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:38.302391 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 878/1771] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 08:48:37 2022] DELETE /identity/v3/projects/dc788fef8b8149b2b8afb764eae18c3e => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:38.306444 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbaaa11-e864-42b9-aeae-3ba31a5b1c37 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:38.308985 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-2fbaaa11-e864-42b9-aeae-3ba31a5b1c37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:38.336661 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aee8bf-86d5-4ad9-9851-7a38f36479cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:38.337619 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aee8bf-86d5-4ad9-9851-7a38f36479cf admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:38.338356 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aee8bf-86d5-4ad9-9851-7a38f36479cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:38.338845 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aee8bf-86d5-4ad9-9851-7a38f36479cf admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:38.339767 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aee8bf-86d5-4ad9-9851-7a38f36479cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:38.341968 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aee8bf-86d5-4ad9-9851-7a38f36479cf admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:38.383695 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 894/1772] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 08:48:37 2022] POST /identity/v3/users => generated 297 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:38.385292 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd2250-3ddb-4149-9f45-48e20a8d768c None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:38.385718 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd2250-3ddb-4149-9f45-48e20a8d768c None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:38.386143 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd2250-3ddb-4149-9f45-48e20a8d768c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:38.411672 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-65cd2250-3ddb-4149-9f45-48e20a8d768c None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:38.413760 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-65cd2250-3ddb-4149-9f45-48e20a8d768c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:38.433427 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 895/1773] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:38.434697 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd2250-3ddb-4149-9f45-48e20a8d768c None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:38.436214 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-65cd2250-3ddb-4149-9f45-48e20a8d768c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:38.450839 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd2250-3ddb-4149-9f45-48e20a8d768c None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:38.463669 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab3c8a3-8336-4db7-adae-537f37003174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:38.471146 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3c8a3-8336-4db7-adae-537f37003174 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:38.480835 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3c8a3-8336-4db7-adae-537f37003174 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:38.481355 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3c8a3-8336-4db7-adae-537f37003174 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:38.482310 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab3c8a3-8336-4db7-adae-537f37003174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:38.484090 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab3c8a3-8336-4db7-adae-537f37003174 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:38.503087 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 896/1774] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:48:38 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:48:38.512600 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501648a-02d0-42d9-a12d-d711f7edbc8a None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:38.513421 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501648a-02d0-42d9-a12d-d711f7edbc8a None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:38.515089 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501648a-02d0-42d9-a12d-d711f7edbc8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:38.596030 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-8501648a-02d0-42d9-a12d-d711f7edbc8a None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:38.597471 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-8501648a-02d0-42d9-a12d-d711f7edbc8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:38.625023 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 897/1775] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:38.626051 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501648a-02d0-42d9-a12d-d711f7edbc8a None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:38.666282 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501648a-02d0-42d9-a12d-d711f7edbc8a None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:38.684862 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25de2e9-f2ce-48a0-af99-3d91954e4889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:38.685973 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25de2e9-f2ce-48a0-af99-3d91954e4889 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:38.686402 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25de2e9-f2ce-48a0-af99-3d91954e4889 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:38.686796 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25de2e9-f2ce-48a0-af99-3d91954e4889 admin admin] PATH_INFO: `/v3/projects/b7dc843cf0e64504b96b01cb3e043f44/users/6cc2b6cb18644a439bf17775105eeae2/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:38.717628 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbaaa11-e864-42b9-aeae-3ba31a5b1c37 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:38.720448 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25de2e9-f2ce-48a0-af99-3d91954e4889 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7dc843cf0e64504b96b01cb3e043f44, user_id=6cc2b6cb18644a439bf17775105eeae2, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:38.726067 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25de2e9-f2ce-48a0-af99-3d91954e4889 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:38.743195 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e810a-1cfe-4bc0-8d80-3d1f74cfc914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:38.745312 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:38.745876 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e810a-1cfe-4bc0-8d80-3d1f74cfc914 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:38.746250 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e810a-1cfe-4bc0-8d80-3d1f74cfc914 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:38.746805 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e810a-1cfe-4bc0-8d80-3d1f74cfc914 admin admin] PATH_INFO: `/v3/projects/49526a1986384fe1ae3db8e15509d0ac` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:38.760991 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 898/1776] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:48:38 2022] PUT /identity/v3/projects/b7dc843cf0e64504b96b01cb3e043f44/users/6cc2b6cb18644a439bf17775105eeae2/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:38.761162 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741e810a-1cfe-4bc0-8d80-3d1f74cfc914 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49526a1986384fe1ae3db8e15509d0ac)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:38.771378 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25de2e9-f2ce-48a0-af99-3d91954e4889 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:38.772657 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741e810a-1cfe-4bc0-8d80-3d1f74cfc914 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:38.817266 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:38.959541 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-741e810a-1cfe-4bc0-8d80-3d1f74cfc914 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49526a1986384fe1ae3db8e15509d0ac', 'request_id': 'req-741e810a-1cfe-4bc0-8d80-3d1f74cfc914'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:38.983115 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-741e810a-1cfe-4bc0-8d80-3d1f74cfc914 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49526a1986384fe1ae3db8e15509d0ac', 'request_id': 'req-741e810a-1cfe-4bc0-8d80-3d1f74cfc914'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:39.008793 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25de2e9-f2ce-48a0-af99-3d91954e4889 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:39.013255 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-741e810a-1cfe-4bc0-8d80-3d1f74cfc914 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49526a1986384fe1ae3db8e15509d0ac', 'request_id': 'req-741e810a-1cfe-4bc0-8d80-3d1f74cfc914'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:39.067465 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-741e810a-1cfe-4bc0-8d80-3d1f74cfc914 admin admin] The token cache is being invalidate because project 49526a1986384fe1ae3db8e15509d0ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 08:48:39.070145 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-741e810a-1cfe-4bc0-8d80-3d1f74cfc914 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:39.071748 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-741e810a-1cfe-4bc0-8d80-3d1f74cfc914 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:39.075402 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 879/1777] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 08:48:38 2022] DELETE /identity/v3/projects/49526a1986384fe1ae3db8e15509d0ac => generated 0 bytes in 772 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:39.081693 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e810a-1cfe-4bc0-8d80-3d1f74cfc914 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:39.090232 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-741e810a-1cfe-4bc0-8d80-3d1f74cfc914 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:39.193443 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a1a28-0055-4533-a322-abd97f7b1fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:39.194323 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a1a28-0055-4533-a322-abd97f7b1fc5 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:39.194720 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a1a28-0055-4533-a322-abd97f7b1fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:39.195200 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a1a28-0055-4533-a322-abd97f7b1fc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:39.196057 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50a1a28-0055-4533-a322-abd97f7b1fc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:39.196477 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50a1a28-0055-4533-a322-abd97f7b1fc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:39.198228 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50a1a28-0055-4533-a322-abd97f7b1fc5 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:39.240214 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 899/1778] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Jun 22 08:48:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 479 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:39.246859 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde8646-5893-4531-9bda-55f91e827ef0 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:39.250856 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde8646-5893-4531-9bda-55f91e827ef0 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:39.251307 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde8646-5893-4531-9bda-55f91e827ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:39.292308 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e810a-1cfe-4bc0-8d80-3d1f74cfc914 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:39.316490 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0e530d-1b34-4403-89fe-094734793405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:39.319075 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e530d-1b34-4403-89fe-094734793405 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:39.322130 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e530d-1b34-4403-89fe-094734793405 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:39.324422 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e530d-1b34-4403-89fe-094734793405 admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:39.326838 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-abde8646-5893-4531-9bda-55f91e827ef0 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:39.327477 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0e530d-1b34-4403-89fe-094734793405 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:39.329456 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0e530d-1b34-4403-89fe-094734793405 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:39.330798 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-abde8646-5893-4531-9bda-55f91e827ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:39.365106 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 900/1779] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:39.375135 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde8646-5893-4531-9bda-55f91e827ef0 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:39.376857 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 880/1780] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:48:39 2022] GET /identity/v3/roles => generated 1420 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:48:39.380858 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-abde8646-5893-4531-9bda-55f91e827ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:39.383212 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0e530d-1b34-4403-89fe-094734793405 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:39.388870 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-4a0e530d-1b34-4403-89fe-094734793405 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:39.419146 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde8646-5893-4531-9bda-55f91e827ef0 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:39.445577 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebae871-257d-41a7-b4f7-c822f563e0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:39.447910 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0e530d-1b34-4403-89fe-094734793405 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:39.448080 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebae871-257d-41a7-b4f7-c822f563e0b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:39.448080 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebae871-257d-41a7-b4f7-c822f563e0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:39.448080 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebae871-257d-41a7-b4f7-c822f563e0b7 admin admin] PATH_INFO: `/v3/projects/00b179ce05564f5cadd27bdd0f25d8d4` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:39.454926 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebae871-257d-41a7-b4f7-c822f563e0b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00b179ce05564f5cadd27bdd0f25d8d4)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:39.457031 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebae871-257d-41a7-b4f7-c822f563e0b7 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:39.465737 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ce02b-c83a-4982-8dcc-15a73bb8bbdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:39.474025 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ce02b-c83a-4982-8dcc-15a73bb8bbdb admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:39.474342 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ce02b-c83a-4982-8dcc-15a73bb8bbdb admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:39.474786 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ce02b-c83a-4982-8dcc-15a73bb8bbdb admin admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:39.475679 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542ce02b-c83a-4982-8dcc-15a73bb8bbdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:39.477772 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542ce02b-c83a-4982-8dcc-15a73bb8bbdb admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:39.552282 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 881/1781] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 08:48:39 2022] POST /identity/v3/projects => generated 377 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:39.558327 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ab418-e5d1-497c-9bd2-9378f06bbde9 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:39.558624 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ab418-e5d1-497c-9bd2-9378f06bbde9 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:39.559025 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ab418-e5d1-497c-9bd2-9378f06bbde9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:39.581324 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-9d8ab418-e5d1-497c-9bd2-9378f06bbde9 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:39.583356 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-9d8ab418-e5d1-497c-9bd2-9378f06bbde9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:39.613593 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-3ebae871-257d-41a7-b4f7-c822f563e0b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00b179ce05564f5cadd27bdd0f25d8d4', 'request_id': 'req-3ebae871-257d-41a7-b4f7-c822f563e0b7'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:39.642732 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-3ebae871-257d-41a7-b4f7-c822f563e0b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00b179ce05564f5cadd27bdd0f25d8d4', 'request_id': 'req-3ebae871-257d-41a7-b4f7-c822f563e0b7'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:39.655694 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-3ebae871-257d-41a7-b4f7-c822f563e0b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00b179ce05564f5cadd27bdd0f25d8d4', 'request_id': 'req-3ebae871-257d-41a7-b4f7-c822f563e0b7'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:39.693960 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-3ebae871-257d-41a7-b4f7-c822f563e0b7 admin admin] The token cache is being invalidate because project 00b179ce05564f5cadd27bdd0f25d8d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 08:48:39.694444 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-3ebae871-257d-41a7-b4f7-c822f563e0b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:39.696881 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-3ebae871-257d-41a7-b4f7-c822f563e0b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:39.698323 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 901/1782] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 08:48:39 2022] DELETE /identity/v3/projects/00b179ce05564f5cadd27bdd0f25d8d4 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:39.699221 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebae871-257d-41a7-b4f7-c822f563e0b7 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:39.704600 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-3ebae871-257d-41a7-b4f7-c822f563e0b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:39.749443 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 882/1783] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:39.754584 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c1548-b7bd-400f-a076-b171a368c73f None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:39.754895 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c1548-b7bd-400f-a076-b171a368c73f None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:39.755156 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c1548-b7bd-400f-a076-b171a368c73f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:39.758626 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:39.811748 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:39.843108 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-5f3c1548-b7bd-400f-a076-b171a368c73f None None] MFA Rules not processed for user `7dc678cd12ee45809813046f76faf018`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:39.847676 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-5f3c1548-b7bd-400f-a076-b171a368c73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:39.876677 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebae871-257d-41a7-b4f7-c822f563e0b7 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:39.893190 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e23a19-71c9-44a7-88f4-58c3ad97bf61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:39.894530 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e23a19-71c9-44a7-88f4-58c3ad97bf61 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:39.895599 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e23a19-71c9-44a7-88f4-58c3ad97bf61 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:39.896132 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e23a19-71c9-44a7-88f4-58c3ad97bf61 admin admin] PATH_INFO: `/v3/projects/b7dc843cf0e64504b96b01cb3e043f44/users/6cc2b6cb18644a439bf17775105eeae2/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:39.899671 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e23a19-71c9-44a7-88f4-58c3ad97bf61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7dc843cf0e64504b96b01cb3e043f44, user_id=6cc2b6cb18644a439bf17775105eeae2, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:39.904953 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e23a19-71c9-44a7-88f4-58c3ad97bf61 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:39.936482 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 902/1784] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:48:39 2022] PUT /identity/v3/projects/b7dc843cf0e64504b96b01cb3e043f44/users/6cc2b6cb18644a439bf17775105eeae2/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:39.939076 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e23a19-71c9-44a7-88f4-58c3ad97bf61 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:39.950510 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-a7e23a19-71c9-44a7-88f4-58c3ad97bf61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:40.113607 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e23a19-71c9-44a7-88f4-58c3ad97bf61 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:40.120651 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a73b56-6675-4b3c-ace9-aa00c3a62592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:40.121524 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a73b56-6675-4b3c-ace9-aa00c3a62592 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:40.121928 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a73b56-6675-4b3c-ace9-aa00c3a62592 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:40.122341 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a73b56-6675-4b3c-ace9-aa00c3a62592 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:40.123201 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a73b56-6675-4b3c-ace9-aa00c3a62592 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:40.128081 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a73b56-6675-4b3c-ace9-aa00c3a62592 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:40.194106 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 903/1785] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 08:48:39 2022] POST /identity/v3/users => generated 289 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:40.194106 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488d7c7-f0df-4339-b7f5-2aa10d863015 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:40.194417 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 883/1786] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 433 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:40.194509 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488d7c7-f0df-4339-b7f5-2aa10d863015 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:40.194509 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488d7c7-f0df-4339-b7f5-2aa10d863015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:40.194688 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3c1548-b7bd-400f-a076-b171a368c73f None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:40.208622 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3c1548-b7bd-400f-a076-b171a368c73f None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:40.214769 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ea125-fb7b-4b89-9bbc-79e689ba44f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:40.215639 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ea125-fb7b-4b89-9bbc-79e689ba44f8 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:40.215923 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ea125-fb7b-4b89-9bbc-79e689ba44f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:40.216203 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ea125-fb7b-4b89-9bbc-79e689ba44f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:40.217540 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ea125-fb7b-4b89-9bbc-79e689ba44f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:40.217853 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ea125-fb7b-4b89-9bbc-79e689ba44f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:40.219701 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ea125-fb7b-4b89-9bbc-79e689ba44f8 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:40.225737 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-8488d7c7-f0df-4339-b7f5-2aa10d863015 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:40.227206 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-8488d7c7-f0df-4339-b7f5-2aa10d863015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:40.249081 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 904/1787] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:40.249081 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa9533-05e4-4438-8b61-7b820ec51af7 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:40.249337 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 884/1788] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Jun 22 08:48:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:40.249426 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa9533-05e4-4438-8b61-7b820ec51af7 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:40.249426 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa9533-05e4-4438-8b61-7b820ec51af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:40.249582 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ea125-fb7b-4b89-9bbc-79e689ba44f8 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:40.294780 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ea125-fb7b-4b89-9bbc-79e689ba44f8 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:40.299868 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-10aa9533-05e4-4438-8b61-7b820ec51af7 None None] MFA Rules not processed for user `6cc2b6cb18644a439bf17775105eeae2`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:40.301411 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-10aa9533-05e4-4438-8b61-7b820ec51af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:40.303927 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b0a738-6b1d-4ba8-8bf0-18d16b74bb5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:40.308679 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b0a738-6b1d-4ba8-8bf0-18d16b74bb5e admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:40.309167 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b0a738-6b1d-4ba8-8bf0-18d16b74bb5e admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:40.310096 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b0a738-6b1d-4ba8-8bf0-18d16b74bb5e admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:40.311080 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b0a738-6b1d-4ba8-8bf0-18d16b74bb5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:40.315033 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b0a738-6b1d-4ba8-8bf0-18d16b74bb5e admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:40.352019 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 885/1789] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:48:40 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:48:40.355393 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b24a34-78ad-42d5-b311-12866bc5f008 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:40.355824 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b24a34-78ad-42d5-b311-12866bc5f008 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:40.356221 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b24a34-78ad-42d5-b311-12866bc5f008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:40.384198 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-d6b24a34-78ad-42d5-b311-12866bc5f008 None None] MFA Rules not processed for user `7dc678cd12ee45809813046f76faf018`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:40.385821 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-d6b24a34-78ad-42d5-b311-12866bc5f008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:40.480918 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 905/1790] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:40 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:40.486394 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c023e6-5e6d-4ac3-bc0d-dad0f5cff31a None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:40.486394 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c023e6-5e6d-4ac3-bc0d-dad0f5cff31a None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:40.486394 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c023e6-5e6d-4ac3-bc0d-dad0f5cff31a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:40.531720 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-07c023e6-5e6d-4ac3-bc0d-dad0f5cff31a None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:40.536034 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-07c023e6-5e6d-4ac3-bc0d-dad0f5cff31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:40.550453 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 886/1791] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:40.550453 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b24a34-78ad-42d5-b311-12866bc5f008 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:40.569710 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b24a34-78ad-42d5-b311-12866bc5f008 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:40.572158 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 906/1792] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:40.575481 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c023e6-5e6d-4ac3-bc0d-dad0f5cff31a None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:40.584217 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a58a8d6-3447-4f62-bba8-a8be93f69ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:40.585188 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a58a8d6-3447-4f62-bba8-a8be93f69ee8 admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:40.585584 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a58a8d6-3447-4f62-bba8-a8be93f69ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:40.585971 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a58a8d6-3447-4f62-bba8-a8be93f69ee8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:40.586996 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a58a8d6-3447-4f62-bba8-a8be93f69ee8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:40.591813 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a58a8d6-3447-4f62-bba8-a8be93f69ee8 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:40.605995 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c023e6-5e6d-4ac3-bc0d-dad0f5cff31a None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:40.613076 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1799ee-61c3-455a-834d-bdcfa2131ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:40.614612 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1799ee-61c3-455a-834d-bdcfa2131ce4 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:40.615047 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1799ee-61c3-455a-834d-bdcfa2131ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:40.615472 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1799ee-61c3-455a-834d-bdcfa2131ce4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:40.616369 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1799ee-61c3-455a-834d-bdcfa2131ce4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:40.621925 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1799ee-61c3-455a-834d-bdcfa2131ce4 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:40.633443 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:40.649868 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 907/1793] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:48:40 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:48:40.652739 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1799ee-61c3-455a-834d-bdcfa2131ce4 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:40.655116 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-cd1799ee-61c3-455a-834d-bdcfa2131ce4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:40.703295 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 887/1794] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 08:48:40 2022] POST /identity/v3/projects => generated 375 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:40.707712 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a58a8d6-3447-4f62-bba8-a8be93f69ee8 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:40.721940 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-3a58a8d6-3447-4f62-bba8-a8be93f69ee8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:40.797280 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1799ee-61c3-455a-834d-bdcfa2131ce4 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:40.885125 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:40.941199 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a58a8d6-3447-4f62-bba8-a8be93f69ee8 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:40.952802 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c308d02-5bd5-40f2-bd45-cbc134c8aba2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:40.953629 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c308d02-5bd5-40f2-bd45-cbc134c8aba2 service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:40.955857 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c308d02-5bd5-40f2-bd45-cbc134c8aba2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:40.957227 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c308d02-5bd5-40f2-bd45-cbc134c8aba2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:40.971737 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd75a92-12b7-4ebc-ac17-a4472a727615 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f1809a35b244c1db7a185d82859369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:40.972467 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd75a92-12b7-4ebc-ac17-a4472a727615 service nova] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:40.972760 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd75a92-12b7-4ebc-ac17-a4472a727615 service nova] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:40.973588 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd75a92-12b7-4ebc-ac17-a4472a727615 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:41.132347 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c308d02-5bd5-40f2-bd45-cbc134c8aba2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:41.136861 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c308d02-5bd5-40f2-bd45-cbc134c8aba2 service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:41.166572 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 908/1795] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:48:40 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:48:41.169143 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd75a92-12b7-4ebc-ac17-a4472a727615 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:41.170125 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c308d02-5bd5-40f2-bd45-cbc134c8aba2 service cinder] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:41.183305 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd75a92-12b7-4ebc-ac17-a4472a727615 service nova] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:41.216775 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 888/1796] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:48:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:48:41.219968 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e7c46b-213f-4e77-8b2f-48a56238bba0 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:41.222488 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e7c46b-213f-4e77-8b2f-48a56238bba0 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:41.224368 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e7c46b-213f-4e77-8b2f-48a56238bba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:41.271973 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-e5e7c46b-213f-4e77-8b2f-48a56238bba0 None None] MFA Rules not processed for user `2bf91272d78b4e8f854c760622465af9`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:41.273645 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-e5e7c46b-213f-4e77-8b2f-48a56238bba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:41.363260 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c308d02-5bd5-40f2-bd45-cbc134c8aba2 service cinder] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:41.380636 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7054b874-5850-4597-92cc-22e32dbb779f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:41.381183 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054b874-5850-4597-92cc-22e32dbb779f admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:41.381475 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054b874-5850-4597-92cc-22e32dbb779f admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:41.381760 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054b874-5850-4597-92cc-22e32dbb779f admin admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:41.382562 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7054b874-5850-4597-92cc-22e32dbb779f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:41.382878 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7054b874-5850-4597-92cc-22e32dbb779f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:41.384539 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7054b874-5850-4597-92cc-22e32dbb779f admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:41.408141 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:41.423898 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 909/1797] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Jun 22 08:48:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:41.425115 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7054b874-5850-4597-92cc-22e32dbb779f admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:41.444890 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7054b874-5850-4597-92cc-22e32dbb779f admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:41.459459 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21c742-027f-4254-93bc-a43e9a3cff25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:41.460624 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21c742-027f-4254-93bc-a43e9a3cff25 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:41.461065 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21c742-027f-4254-93bc-a43e9a3cff25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:41.461203 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 889/1798] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Jun 22 08:48:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:41.461969 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21c742-027f-4254-93bc-a43e9a3cff25 admin admin] PATH_INFO: `/v3/projects/498c6993aaa84655a68b6e5724b596c1/users/39ef7b6b22c649858e3516977f2176b9/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:41.479674 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e7c46b-213f-4e77-8b2f-48a56238bba0 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:41.488780 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a21c742-027f-4254-93bc-a43e9a3cff25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=498c6993aaa84655a68b6e5724b596c1, user_id=39ef7b6b22c649858e3516977f2176b9, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:41.493603 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a21c742-027f-4254-93bc-a43e9a3cff25 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:41.504256 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e7c46b-213f-4e77-8b2f-48a56238bba0 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:41.527009 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 910/1799] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:48:41 2022] PUT /identity/v3/projects/498c6993aaa84655a68b6e5724b596c1/users/39ef7b6b22c649858e3516977f2176b9/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:41.527594 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d895a20-bd4a-4d05-8e21-54cd97a30348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:41.528878 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d895a20-bd4a-4d05-8e21-54cd97a30348 admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:41.528878 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d895a20-bd4a-4d05-8e21-54cd97a30348 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:41.529186 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21c742-027f-4254-93bc-a43e9a3cff25 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:41.529421 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d895a20-bd4a-4d05-8e21-54cd97a30348 admin admin] PATH_INFO: `/v3/users` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:41.531298 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d895a20-bd4a-4d05-8e21-54cd97a30348 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:41.533744 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d895a20-bd4a-4d05-8e21-54cd97a30348 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:41.571239 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 890/1800] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 08:48:41 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:41.574310 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d895a20-bd4a-4d05-8e21-54cd97a30348 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:41.607828 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d895a20-bd4a-4d05-8e21-54cd97a30348 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:41.688150 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21c742-027f-4254-93bc-a43e9a3cff25 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:41.697402 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e3291-9046-4d3b-be87-15ecddcdccf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:41.698285 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e3291-9046-4d3b-be87-15ecddcdccf3 admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:41.699468 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e3291-9046-4d3b-be87-15ecddcdccf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:41.699976 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e3291-9046-4d3b-be87-15ecddcdccf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:41.700936 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42e3291-9046-4d3b-be87-15ecddcdccf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:41.703277 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0414f0-01dc-4c4b-915b-6b183bb08e21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:41.703882 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42e3291-9046-4d3b-be87-15ecddcdccf3 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:41.707118 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0414f0-01dc-4c4b-915b-6b183bb08e21 service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:41.710036 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0414f0-01dc-4c4b-915b-6b183bb08e21 service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:41.710411 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0414f0-01dc-4c4b-915b-6b183bb08e21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:41.717720 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-1b0414f0-01dc-4c4b-915b-6b183bb08e21 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:41.759502 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 891/1801] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 08:48:41 2022] POST /identity/v3/projects => generated 393 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:41.769762 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf9af2-bfa1-4886-884a-1915a09aa090 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:41.770771 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf9af2-bfa1-4886-884a-1915a09aa090 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:41.771166 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf9af2-bfa1-4886-884a-1915a09aa090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:41.816198 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:41.841603 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-2daf9af2-bfa1-4886-884a-1915a09aa090 None None] MFA Rules not processed for user `39ef7b6b22c649858e3516977f2176b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:41.843028 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-2daf9af2-bfa1-4886-884a-1915a09aa090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:41.870857 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0414f0-01dc-4c4b-915b-6b183bb08e21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:41.872400 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0414f0-01dc-4c4b-915b-6b183bb08e21 service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:41.885511 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 911/1802] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:48:41 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:48:41.887301 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0414f0-01dc-4c4b-915b-6b183bb08e21 service cinder] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:41.920895 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0414f0-01dc-4c4b-915b-6b183bb08e21 service cinder] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:42.023944 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed1e382-53aa-4e16-b57c-bfdc61dec5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:42.024746 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed1e382-53aa-4e16-b57c-bfdc61dec5ae admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:42.025142 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed1e382-53aa-4e16-b57c-bfdc61dec5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:42.025436 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed1e382-53aa-4e16-b57c-bfdc61dec5ae admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:42.028305 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed1e382-53aa-4e16-b57c-bfdc61dec5ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:42.031901 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed1e382-53aa-4e16-b57c-bfdc61dec5ae admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:42.047038 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 892/1803] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:42.048260 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf9af2-bfa1-4886-884a-1915a09aa090 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:42.059238 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 912/1804] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:48:41 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:48:42.061790 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed1e382-53aa-4e16-b57c-bfdc61dec5ae admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:42.066537 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-6ed1e382-53aa-4e16-b57c-bfdc61dec5ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:42.099080 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf9af2-bfa1-4886-884a-1915a09aa090 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:42.105376 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec0640d-b677-475e-8215-4513225b0c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:42.111685 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0640d-b677-475e-8215-4513225b0c4c admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:42.112347 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0640d-b677-475e-8215-4513225b0c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:42.112848 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0640d-b677-475e-8215-4513225b0c4c admin admin] PATH_INFO: `/v3/users` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:42.114347 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec0640d-b677-475e-8215-4513225b0c4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:42.118462 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec0640d-b677-475e-8215-4513225b0c4c admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:42.170446 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 893/1805] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 08:48:42 2022] POST /identity/v3/users => generated 297 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:42.171480 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec0640d-b677-475e-8215-4513225b0c4c admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:42.176031 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:42.201411 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec0640d-b677-475e-8215-4513225b0c4c admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:42.217104 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e125a3-ca1e-433e-a2fb-b47de9c480aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:42.217828 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e125a3-ca1e-433e-a2fb-b47de9c480aa admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:42.220352 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e125a3-ca1e-433e-a2fb-b47de9c480aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:42.221408 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e125a3-ca1e-433e-a2fb-b47de9c480aa admin admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:42.225520 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e125a3-ca1e-433e-a2fb-b47de9c480aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:42.227870 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e125a3-ca1e-433e-a2fb-b47de9c480aa admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:42.269216 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed1e382-53aa-4e16-b57c-bfdc61dec5ae admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:42.300177 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e23699-c6f1-48b4-91d0-d97dcf047e07 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4403cea84ff646b88cdb785975b20346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:42.302929 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e23699-c6f1-48b4-91d0-d97dcf047e07 service swift] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:42.303235 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e23699-c6f1-48b4-91d0-d97dcf047e07 service swift] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:42.303530 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e23699-c6f1-48b4-91d0-d97dcf047e07 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:42.306606 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 894/1806] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 08:48:42 2022] POST /identity/v3/projects => generated 379 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:42.307857 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e125a3-ca1e-433e-a2fb-b47de9c480aa admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:42.553830 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e23699-c6f1-48b4-91d0-d97dcf047e07 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:42.566275 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e23699-c6f1-48b4-91d0-d97dcf047e07 service swift] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:42.614810 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 913/1807] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Jun 22 08:48:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 08:48:42.618469 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e23699-c6f1-48b4-91d0-d97dcf047e07 service swift] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:42.647286 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e125a3-ca1e-433e-a2fb-b47de9c480aa admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:42.674800 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e7f8a8-4d2a-49ea-b090-73df98884d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:42.680169 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e7f8a8-4d2a-49ea-b090-73df98884d70 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:42.683690 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e7f8a8-4d2a-49ea-b090-73df98884d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:42.684219 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e7f8a8-4d2a-49ea-b090-73df98884d70 admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:42.685616 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e7f8a8-4d2a-49ea-b090-73df98884d70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:42.698491 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e7f8a8-4d2a-49ea-b090-73df98884d70 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:42.701610 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e23699-c6f1-48b4-91d0-d97dcf047e07 service swift] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:42.742521 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efa25be-5d63-4c12-9f84-5939ac16539b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:42.744238 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa25be-5d63-4c12-9f84-5939ac16539b admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:42.751512 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa25be-5d63-4c12-9f84-5939ac16539b admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:42.755380 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa25be-5d63-4c12-9f84-5939ac16539b admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:42.762592 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efa25be-5d63-4c12-9f84-5939ac16539b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:42.765914 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efa25be-5d63-4c12-9f84-5939ac16539b admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:42.796665 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 895/1808] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:48:42 2022] GET /identity/v3/roles => generated 1420 bytes in 489 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:48:42.804479 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e7f8a8-4d2a-49ea-b090-73df98884d70 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:42.867619 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 914/1809] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:48:42 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:48:42.882052 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44ce14-cacc-442e-942e-bf88db7995ba None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:42.885734 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44ce14-cacc-442e-942e-bf88db7995ba None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:42.887727 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e7f8a8-4d2a-49ea-b090-73df98884d70 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:42.893816 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44ce14-cacc-442e-942e-bf88db7995ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:42.899398 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1089c518-fbe5-427e-885a-99c7a10687c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:42.901285 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089c518-fbe5-427e-885a-99c7a10687c1 admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:42.902358 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089c518-fbe5-427e-885a-99c7a10687c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:42.903373 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089c518-fbe5-427e-885a-99c7a10687c1 admin admin] PATH_INFO: `/v3/users` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:42.911118 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1089c518-fbe5-427e-885a-99c7a10687c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:42.916966 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1089c518-fbe5-427e-885a-99c7a10687c1 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:42.985631 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 896/1810] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 08:48:42 2022] POST /identity/v3/users => generated 290 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:42.985631 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5918450c-82e4-4985-b03d-55bc651306dc None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:42.986193 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5918450c-82e4-4985-b03d-55bc651306dc None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:42.987305 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5918450c-82e4-4985-b03d-55bc651306dc None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:42.992528 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 897/1811] 10.222.0.42 () {54 vars in 912 bytes} [Wed Jun 22 08:48:42 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:48:43.001907 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5918450c-82e4-4985-b03d-55bc651306dc None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:43.025507 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-3d44ce14-cacc-442e-942e-bf88db7995ba None None] MFA Rules not processed for user `0a2c3b8979a84abf933ab3228cdff26c`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:43.028247 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-3d44ce14-cacc-442e-942e-bf88db7995ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:43.037315 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5918450c-82e4-4985-b03d-55bc651306dc None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:43.053123 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48c7741-ee05-48f1-998e-5333631139bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:43.053914 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c7741-ee05-48f1-998e-5333631139bd admin admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:43.055068 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c7741-ee05-48f1-998e-5333631139bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:43.055068 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c7741-ee05-48f1-998e-5333631139bd admin admin] PATH_INFO: `/v3/projects/c68de9512b8349ea93559702cb355c19/users/bf5ff89158f849fb87b620acde6706f1/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:43.114898 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48c7741-ee05-48f1-998e-5333631139bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c68de9512b8349ea93559702cb355c19, user_id=bf5ff89158f849fb87b620acde6706f1, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:43.119111 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48c7741-ee05-48f1-998e-5333631139bd admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:43.196042 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 898/1812] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:48:42 2022] PUT /identity/v3/projects/c68de9512b8349ea93559702cb355c19/users/bf5ff89158f849fb87b620acde6706f1/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:43.197233 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48c7741-ee05-48f1-998e-5333631139bd admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:43.233604 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:43.326637 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 915/1813] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 458 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:43.327521 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44ce14-cacc-442e-942e-bf88db7995ba None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:43.370819 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44ce14-cacc-442e-942e-bf88db7995ba None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:43.518106 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48c7741-ee05-48f1-998e-5333631139bd admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:43.550900 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4195ba-ea9a-4d2d-905e-de0797009aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:43.552193 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4195ba-ea9a-4d2d-905e-de0797009aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:43.552491 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4195ba-ea9a-4d2d-905e-de0797009aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:43.552903 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4195ba-ea9a-4d2d-905e-de0797009aa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:43.553689 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4195ba-ea9a-4d2d-905e-de0797009aa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:43.555307 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4195ba-ea9a-4d2d-905e-de0797009aa8 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:43.598424 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 899/1814] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:48:43 2022] GET /identity/v3/roles => generated 1420 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:48:43.599816 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66740b5-9a53-454b-84ba-d23178c3020c None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:43.600105 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66740b5-9a53-454b-84ba-d23178c3020c None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:43.600380 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66740b5-9a53-454b-84ba-d23178c3020c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:43.654477 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47ae330-a4af-4919-9275-2d724ab08fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:43.655906 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ae330-a4af-4919-9275-2d724ab08fbb admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:43.656960 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ae330-a4af-4919-9275-2d724ab08fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:43.657262 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ae330-a4af-4919-9275-2d724ab08fbb admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:43.659522 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47ae330-a4af-4919-9275-2d724ab08fbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:43.661216 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47ae330-a4af-4919-9275-2d724ab08fbb admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:43.673057 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:43.688776 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 916/1815] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:48:43 2022] GET /identity/v3/roles => generated 1420 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:48:43.690153 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8b093-d6ca-4f5d-8bbc-7838d40b65e4 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:43.690451 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8b093-d6ca-4f5d-8bbc-7838d40b65e4 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:43.690750 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8b093-d6ca-4f5d-8bbc-7838d40b65e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:43.698281 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-f66740b5-9a53-454b-84ba-d23178c3020c None None] MFA Rules not processed for user `751f037ff70d4eb8acb4e8d4c5c487ad`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:43.704239 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-f66740b5-9a53-454b-84ba-d23178c3020c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:43.756794 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-ecd8b093-d6ca-4f5d-8bbc-7838d40b65e4 None None] MFA Rules not processed for user `bf5ff89158f849fb87b620acde6706f1`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:43.758924 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-ecd8b093-d6ca-4f5d-8bbc-7838d40b65e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:43.942165 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 900/1816] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Jun 22 08:48:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:43.943031 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66740b5-9a53-454b-84ba-d23178c3020c None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:43.963259 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66740b5-9a53-454b-84ba-d23178c3020c None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:43.977354 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 917/1817] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:43.978671 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323ad520-22ea-46ad-8edb-8280cd38c138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:43.979577 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ad520-22ea-46ad-8edb-8280cd38c138 admin admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:43.979947 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd8b093-d6ca-4f5d-8bbc-7838d40b65e4 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:43.980062 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ad520-22ea-46ad-8edb-8280cd38c138 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:43.980340 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ad520-22ea-46ad-8edb-8280cd38c138 admin admin] PATH_INFO: `/v3/projects/f89baef685b641b683fb2c1cfe8799c5/users/030e4abf98af4e47b260e0213f89596b/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:44.023053 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323ad520-22ea-46ad-8edb-8280cd38c138 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f89baef685b641b683fb2c1cfe8799c5, user_id=030e4abf98af4e47b260e0213f89596b, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:44.023945 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd8b093-d6ca-4f5d-8bbc-7838d40b65e4 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:44.025768 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323ad520-22ea-46ad-8edb-8280cd38c138 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:44.047290 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a278b-862b-49fe-a3a3-b42fe7045460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:44.047953 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a278b-862b-49fe-a3a3-b42fe7045460 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:44.048290 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a278b-862b-49fe-a3a3-b42fe7045460 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:44.048779 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a278b-862b-49fe-a3a3-b42fe7045460 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:44.050350 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179a278b-862b-49fe-a3a3-b42fe7045460 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:44.057679 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179a278b-862b-49fe-a3a3-b42fe7045460 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:44.078320 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 901/1818] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:48:43 2022] PUT /identity/v3/projects/f89baef685b641b683fb2c1cfe8799c5/users/030e4abf98af4e47b260e0213f89596b/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:44.088458 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e522d-4113-4b0d-8030-be2b4f7f3b2a None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:44.088844 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e522d-4113-4b0d-8030-be2b4f7f3b2a None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:44.089202 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e522d-4113-4b0d-8030-be2b4f7f3b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:44.101536 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 918/1819] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:48:43 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:48:44.101536 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a278b-862b-49fe-a3a3-b42fe7045460 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:44.121053 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-179a278b-862b-49fe-a3a3-b42fe7045460 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:44.175487 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-060e522d-4113-4b0d-8030-be2b4f7f3b2a None None] MFA Rules not processed for user `751f037ff70d4eb8acb4e8d4c5c487ad`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:44.177410 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-060e522d-4113-4b0d-8030-be2b4f7f3b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:44.186717 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a278b-862b-49fe-a3a3-b42fe7045460 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:44.319140 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 902/1820] 10.222.0.26 () {58 vars in 1015 bytes} [Wed Jun 22 08:48:44 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:44.322865 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e598f28-175c-446d-bb74-387b82e4258c None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:44.324908 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e598f28-175c-446d-bb74-387b82e4258c None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:44.325914 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e598f28-175c-446d-bb74-387b82e4258c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:44.340578 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72973c66-d305-464f-b03e-b407ec70280e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:44.341314 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72973c66-d305-464f-b03e-b407ec70280e service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:44.341656 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72973c66-d305-464f-b03e-b407ec70280e service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:44.341879 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72973c66-d305-464f-b03e-b407ec70280e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:44.379861 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72973c66-d305-464f-b03e-b407ec70280e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:44.379861 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72973c66-d305-464f-b03e-b407ec70280e service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:44.411553 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 919/1821] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:48:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:48:44.414932 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72973c66-d305-464f-b03e-b407ec70280e service neutron] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:44.435397 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-4e598f28-175c-446d-bb74-387b82e4258c None None] MFA Rules not processed for user `030e4abf98af4e47b260e0213f89596b`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:44.436657 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-4e598f28-175c-446d-bb74-387b82e4258c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:44.529245 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:44.589820 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 903/1822] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:44.594257 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e598f28-175c-446d-bb74-387b82e4258c None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:44.612615 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e598f28-175c-446d-bb74-387b82e4258c None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:44.616908 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a7ce9b-4eba-4f2a-95f8-4505e55c5f41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:44.617643 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7ce9b-4eba-4f2a-95f8-4505e55c5f41 service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:44.617936 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7ce9b-4eba-4f2a-95f8-4505e55c5f41 service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:44.618254 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7ce9b-4eba-4f2a-95f8-4505e55c5f41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:44.628809 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72973c66-d305-464f-b03e-b407ec70280e service neutron] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:44.632233 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a7ce9b-4eba-4f2a-95f8-4505e55c5f41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:44.635001 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a7ce9b-4eba-4f2a-95f8-4505e55c5f41 service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:44.650378 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 904/1823] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:48:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:48:44.651184 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e4eee-e987-4c48-b274-5c8395d1597d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:44.651925 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a7ce9b-4eba-4f2a-95f8-4505e55c5f41 service neutron] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:44.654706 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e4eee-e987-4c48-b274-5c8395d1597d admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:44.655665 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e4eee-e987-4c48-b274-5c8395d1597d admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:44.656182 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e4eee-e987-4c48-b274-5c8395d1597d admin admin] PATH_INFO: `/v3/projects/dfd1367e7ece429ca347681ba4721926/users/adcfda220c2a4dfd9849f84baf2409e0/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:44.668022 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a7ce9b-4eba-4f2a-95f8-4505e55c5f41 service neutron] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:44.676610 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8ea71d-d605-4e0f-a175-c101b2e679f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:44.677977 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ea71d-d605-4e0f-a175-c101b2e679f3 admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:44.678500 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ea71d-d605-4e0f-a175-c101b2e679f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:44.678801 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ea71d-d605-4e0f-a175-c101b2e679f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:44.680775 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8ea71d-d605-4e0f-a175-c101b2e679f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:44.683007 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8ea71d-d605-4e0f-a175-c101b2e679f3 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:44.739061 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342e4eee-e987-4c48-b274-5c8395d1597d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfd1367e7ece429ca347681ba4721926, user_id=adcfda220c2a4dfd9849f84baf2409e0, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:44.743361 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 905/1824] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 08:48:44 2022] POST /identity/v3/projects => generated 393 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:44.744342 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8ea71d-d605-4e0f-a175-c101b2e679f3 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:44.752870 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342e4eee-e987-4c48-b274-5c8395d1597d admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:44.824200 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 920/1825] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:48:44 2022] PUT /identity/v3/projects/dfd1367e7ece429ca347681ba4721926/users/adcfda220c2a4dfd9849f84baf2409e0/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:44.839776 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb591114-606a-4116-ae83-3f26c536b852 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:44.840101 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb591114-606a-4116-ae83-3f26c536b852 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:44.840396 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb591114-606a-4116-ae83-3f26c536b852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:44.866417 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:44.917419 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-bb591114-606a-4116-ae83-3f26c536b852 None None] MFA Rules not processed for user `adcfda220c2a4dfd9849f84baf2409e0`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:44.919267 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-bb591114-606a-4116-ae83-3f26c536b852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:45.047100 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8ea71d-d605-4e0f-a175-c101b2e679f3 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:45.078854 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 921/1826] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:45.085286 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb591114-606a-4116-ae83-3f26c536b852 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:45.321479 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8eadf-6078-416d-8dba-4526e34a2ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:45.322200 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8eadf-6078-416d-8dba-4526e34a2ea3 admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:45.322475 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8eadf-6078-416d-8dba-4526e34a2ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:45.322771 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8eadf-6078-416d-8dba-4526e34a2ea3 admin admin] PATH_INFO: `/v3/users` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:45.323473 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e8eadf-6078-416d-8dba-4526e34a2ea3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:45.325962 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e8eadf-6078-416d-8dba-4526e34a2ea3 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:45.356584 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb591114-606a-4116-ae83-3f26c536b852 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:45.370680 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7bf8c8-5ce1-4188-8256-7d6f3ab95a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:45.372859 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7bf8c8-5ce1-4188-8256-7d6f3ab95a2f admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:45.373489 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7bf8c8-5ce1-4188-8256-7d6f3ab95a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:45.373803 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7bf8c8-5ce1-4188-8256-7d6f3ab95a2f admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:45.375906 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7bf8c8-5ce1-4188-8256-7d6f3ab95a2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:45.381551 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7bf8c8-5ce1-4188-8256-7d6f3ab95a2f admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:45.405149 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 906/1827] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 08:48:44 2022] POST /identity/v3/users => generated 303 bytes in 661 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:45.414869 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8eadf-6078-416d-8dba-4526e34a2ea3 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:45.451038 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8eadf-6078-416d-8dba-4526e34a2ea3 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:45.462992 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 922/1828] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 08:48:45 2022] POST /identity/v3/projects => generated 379 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 08:48:45.465690 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7bf8c8-5ce1-4188-8256-7d6f3ab95a2f admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:45.476725 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65af13e-6707-483a-ae77-1937be2480ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:45.479332 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65af13e-6707-483a-ae77-1937be2480ef admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:45.479624 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65af13e-6707-483a-ae77-1937be2480ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:45.480075 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65af13e-6707-483a-ae77-1937be2480ef admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:45.494902 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65af13e-6707-483a-ae77-1937be2480ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:45.496748 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65af13e-6707-483a-ae77-1937be2480ef admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:45.545902 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 907/1829] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:48:45.546878 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65af13e-6707-483a-ae77-1937be2480ef admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:45.572795 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65af13e-6707-483a-ae77-1937be2480ef admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:45.640297 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:45.675358 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7bf8c8-5ce1-4188-8256-7d6f3ab95a2f admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:45.686680 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231007a6-5f1e-4b6f-89d7-1fed5b16472c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:45.690097 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231007a6-5f1e-4b6f-89d7-1fed5b16472c admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:45.690097 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231007a6-5f1e-4b6f-89d7-1fed5b16472c admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:45.690097 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231007a6-5f1e-4b6f-89d7-1fed5b16472c admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:45.691853 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231007a6-5f1e-4b6f-89d7-1fed5b16472c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:45.695401 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231007a6-5f1e-4b6f-89d7-1fed5b16472c admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:45.749547 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 923/1830] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 08:48:45 2022] POST /identity/v3/users => generated 296 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:45.750931 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231007a6-5f1e-4b6f-89d7-1fed5b16472c admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:45.765423 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d001fa14-5e46-4254-baa5-679c36d7f3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:45.766407 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d001fa14-5e46-4254-baa5-679c36d7f3d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:45.766691 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d001fa14-5e46-4254-baa5-679c36d7f3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:45.766969 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d001fa14-5e46-4254-baa5-679c36d7f3d0 admin admin] PATH_INFO: `/v3/projects/16febdf691ff41e0b31bd4a272cbe2c2/users/6c2d062b90a84513a8c6d3eb1e9f12a7/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:45.775796 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231007a6-5f1e-4b6f-89d7-1fed5b16472c admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:45.787271 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fef03b6-17aa-4967-a56c-76455caddf7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:45.788039 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef03b6-17aa-4967-a56c-76455caddf7a admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:45.788329 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef03b6-17aa-4967-a56c-76455caddf7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:45.788682 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef03b6-17aa-4967-a56c-76455caddf7a admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:45.789437 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fef03b6-17aa-4967-a56c-76455caddf7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:45.791098 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fef03b6-17aa-4967-a56c-76455caddf7a admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:45.793587 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:45.804289 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d001fa14-5e46-4254-baa5-679c36d7f3d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16febdf691ff41e0b31bd4a272cbe2c2, user_id=6c2d062b90a84513a8c6d3eb1e9f12a7, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:45.807176 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d001fa14-5e46-4254-baa5-679c36d7f3d0 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:45.827088 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 924/1831] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:48:45.828086 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fef03b6-17aa-4967-a56c-76455caddf7a admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:45.837856 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 908/1832] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:48:45 2022] PUT /identity/v3/projects/16febdf691ff41e0b31bd4a272cbe2c2/users/6c2d062b90a84513a8c6d3eb1e9f12a7/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 08:48:45.841994 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d001fa14-5e46-4254-baa5-679c36d7f3d0 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:45.858478 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fef03b6-17aa-4967-a56c-76455caddf7a admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:46.027406 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef73ed-239a-443d-ba70-699fc70ad179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:46.028376 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef73ed-239a-443d-ba70-699fc70ad179 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:46.028702 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef73ed-239a-443d-ba70-699fc70ad179 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:46.029053 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef73ed-239a-443d-ba70-699fc70ad179 admin admin] PATH_INFO: `/v3/projects/91df6e603dac44e9bc8e85cbd136f4cf/users/265096dcd09b462db0c0cb861c0cbf71/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:46.090674 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ef73ed-239a-443d-ba70-699fc70ad179 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91df6e603dac44e9bc8e85cbd136f4cf, user_id=265096dcd09b462db0c0cb861c0cbf71, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:46.095391 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ef73ed-239a-443d-ba70-699fc70ad179 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:46.106852 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d001fa14-5e46-4254-baa5-679c36d7f3d0 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:46.135989 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc86d88-1112-4a78-952c-65d12a88b9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:46.138983 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc86d88-1112-4a78-952c-65d12a88b9ec admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:46.140724 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc86d88-1112-4a78-952c-65d12a88b9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:46.142554 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc86d88-1112-4a78-952c-65d12a88b9ec admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:46.144848 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 925/1833] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:48:45 2022] PUT /identity/v3/projects/91df6e603dac44e9bc8e85cbd136f4cf/users/265096dcd09b462db0c0cb861c0cbf71/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:46.145321 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc86d88-1112-4a78-952c-65d12a88b9ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:46.145617 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef73ed-239a-443d-ba70-699fc70ad179 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:46.149843 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc86d88-1112-4a78-952c-65d12a88b9ec admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:46.193736 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 909/1834] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 08:48:46.196111 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc86d88-1112-4a78-952c-65d12a88b9ec admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:46.233079 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc86d88-1112-4a78-952c-65d12a88b9ec admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:46.454399 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf09903-3aad-44fd-8437-f8c277718869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:46.458522 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf09903-3aad-44fd-8437-f8c277718869 admin admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:46.461538 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf09903-3aad-44fd-8437-f8c277718869 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:46.463216 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf09903-3aad-44fd-8437-f8c277718869 admin admin] PATH_INFO: `/v3/projects/16febdf691ff41e0b31bd4a272cbe2c2/users/6c2d062b90a84513a8c6d3eb1e9f12a7/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:46.474123 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf09903-3aad-44fd-8437-f8c277718869 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16febdf691ff41e0b31bd4a272cbe2c2, user_id=6c2d062b90a84513a8c6d3eb1e9f12a7, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:46.482757 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef73ed-239a-443d-ba70-699fc70ad179 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:46.498858 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf09903-3aad-44fd-8437-f8c277718869 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:46.528471 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e503c9-588d-4a6e-adfb-bd4efd80ab8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:46.529196 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e503c9-588d-4a6e-adfb-bd4efd80ab8c admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:46.529488 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e503c9-588d-4a6e-adfb-bd4efd80ab8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:46.529771 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e503c9-588d-4a6e-adfb-bd4efd80ab8c admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:46.539689 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e503c9-588d-4a6e-adfb-bd4efd80ab8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:46.549956 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e503c9-588d-4a6e-adfb-bd4efd80ab8c admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:46.576352 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 910/1835] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:48:46 2022] PUT /identity/v3/projects/16febdf691ff41e0b31bd4a272cbe2c2/users/6c2d062b90a84513a8c6d3eb1e9f12a7/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:46.577496 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf09903-3aad-44fd-8437-f8c277718869 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:46.580759 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-bcf09903-3aad-44fd-8437-f8c277718869 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:46.600782 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 926/1836] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:48:46 2022] GET /identity/v3/roles => generated 1420 bytes in 456 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:48:46.632461 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1540ac-4656-4e0a-8313-19e0a6ef6b89 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:46.632761 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1540ac-4656-4e0a-8313-19e0a6ef6b89 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:46.633046 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1540ac-4656-4e0a-8313-19e0a6ef6b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:46.678961 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:46.745210 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf09903-3aad-44fd-8437-f8c277718869 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:46.752911 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec7e739-2a99-496f-a985-066a346e57c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f1809a35b244c1db7a185d82859369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:46.753707 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7e739-2a99-496f-a985-066a346e57c8 service nova] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:46.754290 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7e739-2a99-496f-a985-066a346e57c8 service nova] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:46.755036 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7e739-2a99-496f-a985-066a346e57c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:46.794319 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-ca1540ac-4656-4e0a-8313-19e0a6ef6b89 None None] MFA Rules not processed for user `6c2d062b90a84513a8c6d3eb1e9f12a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:46.802823 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-ca1540ac-4656-4e0a-8313-19e0a6ef6b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:46.870462 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec7e739-2a99-496f-a985-066a346e57c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:46.874165 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec7e739-2a99-496f-a985-066a346e57c8 service nova] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:46.897074 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 911/1837] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:48:46 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:48:46.898252 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec7e739-2a99-496f-a985-066a346e57c8 service nova] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:46.995513 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec7e739-2a99-496f-a985-066a346e57c8 service nova] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:47.001382 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4922bb-f699-4cf0-aeea-ca5064395c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:47.004589 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4922bb-f699-4cf0-aeea-ca5064395c85 admin admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:47.006493 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4922bb-f699-4cf0-aeea-ca5064395c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:47.007826 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4922bb-f699-4cf0-aeea-ca5064395c85 admin admin] PATH_INFO: `/v3/projects/91df6e603dac44e9bc8e85cbd136f4cf/users/265096dcd09b462db0c0cb861c0cbf71/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:47.026250 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4922bb-f699-4cf0-aeea-ca5064395c85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91df6e603dac44e9bc8e85cbd136f4cf, user_id=265096dcd09b462db0c0cb861c0cbf71, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:47.034275 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4922bb-f699-4cf0-aeea-ca5064395c85 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:47.065539 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 912/1838] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:48:46 2022] PUT /identity/v3/projects/91df6e603dac44e9bc8e85cbd136f4cf/users/265096dcd09b462db0c0cb861c0cbf71/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:47.076566 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915148d2-b088-487e-b9ce-1ea54f52ef26 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:47.077231 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915148d2-b088-487e-b9ce-1ea54f52ef26 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:47.077925 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915148d2-b088-487e-b9ce-1ea54f52ef26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:47.126037 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:47.138447 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 927/1839] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:46 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 507 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:47.150673 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1540ac-4656-4e0a-8313-19e0a6ef6b89 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:47.153761 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-ca1540ac-4656-4e0a-8313-19e0a6ef6b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:47.170301 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-915148d2-b088-487e-b9ce-1ea54f52ef26 None None] MFA Rules not processed for user `265096dcd09b462db0c0cb861c0cbf71`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:47.173419 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-915148d2-b088-487e-b9ce-1ea54f52ef26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:47.333843 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:47.350312 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 913/1840] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:47 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 08:48:47.432075 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1540ac-4656-4e0a-8313-19e0a6ef6b89 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:47.661213 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7ddb02-403e-4b61-88c7-a352802ec609 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:47.661978 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ddb02-403e-4b61-88c7-a352802ec609 service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:47.667218 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ddb02-403e-4b61-88c7-a352802ec609 service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:47.667640 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ddb02-403e-4b61-88c7-a352802ec609 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:47.881525 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915148d2-b088-487e-b9ce-1ea54f52ef26 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:47.902226 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7ddb02-403e-4b61-88c7-a352802ec609 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:47.906401 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915148d2-b088-487e-b9ce-1ea54f52ef26 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:47.907704 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7ddb02-403e-4b61-88c7-a352802ec609 service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:47.922414 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7264286f-7f4e-408a-8d9a-25fcaa42499b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:47.924832 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264286f-7f4e-408a-8d9a-25fcaa42499b service cinder] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:47.925742 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264286f-7f4e-408a-8d9a-25fcaa42499b service cinder] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:47.931687 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264286f-7f4e-408a-8d9a-25fcaa42499b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:47.942625 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 928/1841] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:48:47 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 786 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:48:47.975318 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7264286f-7f4e-408a-8d9a-25fcaa42499b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:47.979227 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7264286f-7f4e-408a-8d9a-25fcaa42499b service cinder] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:48.004950 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 914/1842] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:48:47 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:48:48.271815 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7ddb02-403e-4b61-88c7-a352802ec609 service cinder] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:48.279279 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7264286f-7f4e-408a-8d9a-25fcaa42499b service cinder] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:48.291667 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7264286f-7f4e-408a-8d9a-25fcaa42499b service cinder] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:48.295631 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23438a31-26ee-4047-b640-eb57d42b2203 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:48.296305 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23438a31-26ee-4047-b640-eb57d42b2203 service cinder] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:48.296589 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23438a31-26ee-4047-b640-eb57d42b2203 service cinder] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:48.296864 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23438a31-26ee-4047-b640-eb57d42b2203 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:48.298348 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7ddb02-403e-4b61-88c7-a352802ec609 service cinder] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:48.314411 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e54d4-ab86-45bc-a177-ddb6fdaeef8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:48.315736 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e54d4-ab86-45bc-a177-ddb6fdaeef8e service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:48.316421 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e54d4-ab86-45bc-a177-ddb6fdaeef8e service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:48.317558 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e54d4-ab86-45bc-a177-ddb6fdaeef8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:48.499849 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23438a31-26ee-4047-b640-eb57d42b2203 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:48.501583 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23438a31-26ee-4047-b640-eb57d42b2203 service cinder] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:48.563689 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00e54d4-ab86-45bc-a177-ddb6fdaeef8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:48.565166 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00e54d4-ab86-45bc-a177-ddb6fdaeef8e service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:48.582248 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 915/1843] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:48:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 08:48:48.620845 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 929/1844] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:48:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:48:48.679215 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1a038-d1b1-46f9-86fa-09e5978845a0 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:48.679716 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1a038-d1b1-46f9-86fa-09e5978845a0 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:48.680155 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1a038-d1b1-46f9-86fa-09e5978845a0 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:48.682046 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 916/1845] 10.222.0.42 () {54 vars in 921 bytes} [Wed Jun 22 08:48:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:48:48.744870 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f33c0c-ddc5-414d-b32d-1e19bb792b75 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:48.745416 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f33c0c-ddc5-414d-b32d-1e19bb792b75 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:48.745996 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f33c0c-ddc5-414d-b32d-1e19bb792b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:48.770679 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:48.798904 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-c1f33c0c-ddc5-414d-b32d-1e19bb792b75 None None] MFA Rules not processed for user `4f1809a35b244c1db7a185d82859369e`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:48.802678 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-c1f33c0c-ddc5-414d-b32d-1e19bb792b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:49.021727 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1a038-d1b1-46f9-86fa-09e5978845a0 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:49.024888 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 930/1846] 10.222.0.42 () {58 vars in 1018 bytes} [Wed Jun 22 08:48:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:49.084370 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1a038-d1b1-46f9-86fa-09e5978845a0 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:49.115856 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b3e285-75a2-45d1-8855-cdf06d526e6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f1809a35b244c1db7a185d82859369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:49.118845 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3e285-75a2-45d1-8855-cdf06d526e6b service nova] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:49.119136 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3e285-75a2-45d1-8855-cdf06d526e6b service nova] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:49.120904 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3e285-75a2-45d1-8855-cdf06d526e6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:49.159465 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b3e285-75a2-45d1-8855-cdf06d526e6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:49.163200 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b3e285-75a2-45d1-8855-cdf06d526e6b service nova] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:49.191277 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 917/1847] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:48:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 08:48:49.317499 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f33c0c-ddc5-414d-b32d-1e19bb792b75 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:49.399293 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f33c0c-ddc5-414d-b32d-1e19bb792b75 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:49.415953 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73193f61-1a89-4570-8788-b20beb6791d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:49.418834 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73193f61-1a89-4570-8788-b20beb6791d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:49.419371 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73193f61-1a89-4570-8788-b20beb6791d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:49.420022 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73193f61-1a89-4570-8788-b20beb6791d5 admin admin] PATH_INFO: `/v3/users/bf5ff89158f849fb87b620acde6706f1` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:49.422274 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73193f61-1a89-4570-8788-b20beb6791d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf5ff89158f849fb87b620acde6706f1)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:49.425175 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73193f61-1a89-4570-8788-b20beb6791d5 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:49.572487 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-73193f61-1a89-4570-8788-b20beb6791d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf5ff89158f849fb87b620acde6706f1'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:49.605295 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-73193f61-1a89-4570-8788-b20beb6791d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf5ff89158f849fb87b620acde6706f1'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:49.607750 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-73193f61-1a89-4570-8788-b20beb6791d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf5ff89158f849fb87b620acde6706f1'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:49.639038 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-73193f61-1a89-4570-8788-b20beb6791d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf5ff89158f849fb87b620acde6706f1'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:49.640028 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-73193f61-1a89-4570-8788-b20beb6791d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf5ff89158f849fb87b620acde6706f1'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:49.695158 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 931/1848] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 08:48:49 2022] DELETE /identity/v3/users/bf5ff89158f849fb87b620acde6706f1 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:49.699635 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9b0d0-9ffd-4e00-b6bf-28fca2dbeecb None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:49.699928 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9b0d0-9ffd-4e00-b6bf-28fca2dbeecb None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:49.700210 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9b0d0-9ffd-4e00-b6bf-28fca2dbeecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:49.709895 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd9999-9e52-47f3-a175-d644fd4747a6 None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:49.715142 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd9999-9e52-47f3-a175-d644fd4747a6 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:49.715615 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd9999-9e52-47f3-a175-d644fd4747a6 None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:49.717901 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 932/1849] 10.222.0.42 () {54 vars in 921 bytes} [Wed Jun 22 08:48:49 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:48:49.767202 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-fbe9b0d0-9ffd-4e00-b6bf-28fca2dbeecb None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:49.768156 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80bd1d-7baf-49d6-86af-a0c4297ca97c None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:49.768546 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80bd1d-7baf-49d6-86af-a0c4297ca97c None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:49.768938 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80bd1d-7baf-49d6-86af-a0c4297ca97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:49.771721 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-fbe9b0d0-9ffd-4e00-b6bf-28fca2dbeecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:49.833614 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-fa80bd1d-7baf-49d6-86af-a0c4297ca97c None None] MFA Rules not processed for user `4f1809a35b244c1db7a185d82859369e`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:49.837193 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-fa80bd1d-7baf-49d6-86af-a0c4297ca97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:49.870176 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:49.956168 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 918/1850] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:49.982832 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe9b0d0-9ffd-4e00-b6bf-28fca2dbeecb None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:49.984567 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-fbe9b0d0-9ffd-4e00-b6bf-28fca2dbeecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:50.093769 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 933/1851] 10.222.0.42 () {58 vars in 1018 bytes} [Wed Jun 22 08:48:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 08:48:50.146633 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa80bd1d-7baf-49d6-86af-a0c4297ca97c None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:50.148785 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-fa80bd1d-7baf-49d6-86af-a0c4297ca97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:50.201736 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa80bd1d-7baf-49d6-86af-a0c4297ca97c None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:50.215107 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e6d2fe-59c3-4ac8-9e7b-3996c93058c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f1809a35b244c1db7a185d82859369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:50.216533 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe9b0d0-9ffd-4e00-b6bf-28fca2dbeecb None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:50.223611 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6d2fe-59c3-4ac8-9e7b-3996c93058c4 service nova] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:50.223823 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6d2fe-59c3-4ac8-9e7b-3996c93058c4 service nova] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:50.230202 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6d2fe-59c3-4ac8-9e7b-3996c93058c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:50.232152 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054aea3b-a2f9-4ff5-9000-323fb47e3801 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:50.232877 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054aea3b-a2f9-4ff5-9000-323fb47e3801 service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:50.233166 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054aea3b-a2f9-4ff5-9000-323fb47e3801 service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:50.234220 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054aea3b-a2f9-4ff5-9000-323fb47e3801 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:50.274907 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054aea3b-a2f9-4ff5-9000-323fb47e3801 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:50.276472 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054aea3b-a2f9-4ff5-9000-323fb47e3801 service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:50.283070 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e6d2fe-59c3-4ac8-9e7b-3996c93058c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:50.292796 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e6d2fe-59c3-4ac8-9e7b-3996c93058c4 service nova] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:50.307761 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 919/1852] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:48:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:48:50.335538 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 934/1853] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:48:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:48:50.870192 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054aea3b-a2f9-4ff5-9000-323fb47e3801 service neutron] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:50.873617 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-054aea3b-a2f9-4ff5-9000-323fb47e3801 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:50.940288 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054aea3b-a2f9-4ff5-9000-323fb47e3801 service neutron] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:50.964776 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ac0c9-8b32-4713-914f-0c43bd6618d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:50.968362 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ac0c9-8b32-4713-914f-0c43bd6618d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:50.968508 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ac0c9-8b32-4713-914f-0c43bd6618d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:50.986166 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ac0c9-8b32-4713-914f-0c43bd6618d1 admin admin] PATH_INFO: `/v3/projects/c68de9512b8349ea93559702cb355c19` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:50.993996 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5ac0c9-8b32-4713-914f-0c43bd6618d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c68de9512b8349ea93559702cb355c19)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:50.998572 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5ac0c9-8b32-4713-914f-0c43bd6618d1 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:51.005688 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:51.154669 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-fc5ac0c9-8b32-4713-914f-0c43bd6618d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c68de9512b8349ea93559702cb355c19', 'request_id': 'req-fc5ac0c9-8b32-4713-914f-0c43bd6618d1'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:51.166049 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-fc5ac0c9-8b32-4713-914f-0c43bd6618d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c68de9512b8349ea93559702cb355c19', 'request_id': 'req-fc5ac0c9-8b32-4713-914f-0c43bd6618d1'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:51.174739 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-fc5ac0c9-8b32-4713-914f-0c43bd6618d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c68de9512b8349ea93559702cb355c19', 'request_id': 'req-fc5ac0c9-8b32-4713-914f-0c43bd6618d1'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:51.216970 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-fc5ac0c9-8b32-4713-914f-0c43bd6618d1 admin admin] The token cache is being invalidate because project c68de9512b8349ea93559702cb355c19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 08:48:51.219619 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-fc5ac0c9-8b32-4713-914f-0c43bd6618d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:51.224366 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-fc5ac0c9-8b32-4713-914f-0c43bd6618d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:51.245333 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 920/1854] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 08:48:50 2022] DELETE /identity/v3/projects/c68de9512b8349ea93559702cb355c19 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:51.260064 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b68aca-bda6-4fd8-8bc5-385c80b49055 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:51.260345 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b68aca-bda6-4fd8-8bc5-385c80b49055 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:51.260633 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b68aca-bda6-4fd8-8bc5-385c80b49055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:51.319202 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-52b68aca-bda6-4fd8-8bc5-385c80b49055 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:51.324123 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-52b68aca-bda6-4fd8-8bc5-385c80b49055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:51.522818 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 935/1855] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:51.531282 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6371e4d-8716-4279-9c06-64a42837d3ec None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:51.531741 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6371e4d-8716-4279-9c06-64a42837d3ec None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:51.532420 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6371e4d-8716-4279-9c06-64a42837d3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:51.570514 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-f6371e4d-8716-4279-9c06-64a42837d3ec None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:51.573096 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-f6371e4d-8716-4279-9c06-64a42837d3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:51.592603 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 921/1856] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:51.593643 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b68aca-bda6-4fd8-8bc5-385c80b49055 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:51.607131 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b68aca-bda6-4fd8-8bc5-385c80b49055 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:51.622195 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f026832-1b8e-45bc-803f-73d8c3f3e63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:51.624208 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f026832-1b8e-45bc-803f-73d8c3f3e63d admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:51.625948 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f026832-1b8e-45bc-803f-73d8c3f3e63d admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:51.626288 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f026832-1b8e-45bc-803f-73d8c3f3e63d admin admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:51.631780 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f026832-1b8e-45bc-803f-73d8c3f3e63d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:51.632127 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f026832-1b8e-45bc-803f-73d8c3f3e63d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:51.637429 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f026832-1b8e-45bc-803f-73d8c3f3e63d admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:51.697331 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6371e4d-8716-4279-9c06-64a42837d3ec None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:51.702978 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 936/1857] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Jun 22 08:48:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:51.716161 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6371e4d-8716-4279-9c06-64a42837d3ec None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:51.722740 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794332ff-24ea-4f6e-9d4a-136b83918d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:51.723986 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794332ff-24ea-4f6e-9d4a-136b83918d58 admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:51.724280 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794332ff-24ea-4f6e-9d4a-136b83918d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:51.724563 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794332ff-24ea-4f6e-9d4a-136b83918d58 admin admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:51.725323 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794332ff-24ea-4f6e-9d4a-136b83918d58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:51.727624 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794332ff-24ea-4f6e-9d4a-136b83918d58 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:51.810151 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 922/1858] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 08:48:51 2022] POST /identity/v3/projects => generated 377 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:51.815671 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f026832-1b8e-45bc-803f-73d8c3f3e63d admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:51.851689 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f026832-1b8e-45bc-803f-73d8c3f3e63d admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:52.071356 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd2e2f0-9685-4f48-978b-97007459f7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:52.073613 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd2e2f0-9685-4f48-978b-97007459f7d2 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:52.076575 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd2e2f0-9685-4f48-978b-97007459f7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:52.077457 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd2e2f0-9685-4f48-978b-97007459f7d2 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:52.079528 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd2e2f0-9685-4f48-978b-97007459f7d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:52.084162 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd2e2f0-9685-4f48-978b-97007459f7d2 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:52.206379 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794332ff-24ea-4f6e-9d4a-136b83918d58 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:52.211081 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 937/1859] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 08:48:51 2022] POST /identity/v3/users => generated 289 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:52.236204 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794332ff-24ea-4f6e-9d4a-136b83918d58 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:52.257262 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36523d1d-205a-49af-8c33-f9df037a4d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:52.262252 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36523d1d-205a-49af-8c33-f9df037a4d7b admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:52.262894 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36523d1d-205a-49af-8c33-f9df037a4d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:52.263393 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36523d1d-205a-49af-8c33-f9df037a4d7b admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:52.265461 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36523d1d-205a-49af-8c33-f9df037a4d7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:52.271583 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36523d1d-205a-49af-8c33-f9df037a4d7b admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:52.324642 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 923/1860] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:48:52 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:48:52.327456 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd2e2f0-9685-4f48-978b-97007459f7d2 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:52.346059 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd2e2f0-9685-4f48-978b-97007459f7d2 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:52.403340 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d3e0f-cfc9-42a9-8064-a1e563adac4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:52.413790 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d3e0f-cfc9-42a9-8064-a1e563adac4c admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:52.414233 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d3e0f-cfc9-42a9-8064-a1e563adac4c admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:52.414621 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d3e0f-cfc9-42a9-8064-a1e563adac4c admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:52.419807 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3d3e0f-cfc9-42a9-8064-a1e563adac4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:52.432164 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3d3e0f-cfc9-42a9-8064-a1e563adac4c admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:52.448094 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:52.502307 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 938/1861] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:48:52 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:48:52.504961 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36523d1d-205a-49af-8c33-f9df037a4d7b admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:52.521084 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36523d1d-205a-49af-8c33-f9df037a4d7b admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:52.556334 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cabbf6-50dc-4e3c-a0c5-92c3cf4fd228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:52.558574 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cabbf6-50dc-4e3c-a0c5-92c3cf4fd228 admin admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:52.563971 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cabbf6-50dc-4e3c-a0c5-92c3cf4fd228 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:52.565334 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cabbf6-50dc-4e3c-a0c5-92c3cf4fd228 admin admin] PATH_INFO: `/v3/projects/8e5c0b0999704731a733734ed52ead02/users/9f8688dfd0a14a6d96ae1c5f2093933b/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:52.634566 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cabbf6-50dc-4e3c-a0c5-92c3cf4fd228 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e5c0b0999704731a733734ed52ead02, user_id=9f8688dfd0a14a6d96ae1c5f2093933b, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:52.648421 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cabbf6-50dc-4e3c-a0c5-92c3cf4fd228 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:52.707517 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 924/1862] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:48:52 2022] PUT /identity/v3/projects/8e5c0b0999704731a733734ed52ead02/users/9f8688dfd0a14a6d96ae1c5f2093933b/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:52.717410 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5eacb-712d-4031-9a39-a2ad0f3985db None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:52.717845 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5eacb-712d-4031-9a39-a2ad0f3985db None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:52.718624 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5eacb-712d-4031-9a39-a2ad0f3985db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:52.819646 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-f7c5eacb-712d-4031-9a39-a2ad0f3985db None None] MFA Rules not processed for user `9f8688dfd0a14a6d96ae1c5f2093933b`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:52.822420 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-f7c5eacb-712d-4031-9a39-a2ad0f3985db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:53.073146 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 939/1863] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:53.077656 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cabbf6-50dc-4e3c-a0c5-92c3cf4fd228 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:53.298502 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cabbf6-50dc-4e3c-a0c5-92c3cf4fd228 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:53.304607 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d0c0fe-6562-4e63-baec-1ceefb99c4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:53.305460 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0c0fe-6562-4e63-baec-1ceefb99c4cc admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:53.305767 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0c0fe-6562-4e63-baec-1ceefb99c4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:53.306042 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0c0fe-6562-4e63-baec-1ceefb99c4cc admin admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:53.306810 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d0c0fe-6562-4e63-baec-1ceefb99c4cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:53.312097 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d0c0fe-6562-4e63-baec-1ceefb99c4cc admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:53.366924 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 925/1864] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 08:48:53 2022] POST /identity/v3/projects => generated 377 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:53.370703 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5eacb-712d-4031-9a39-a2ad0f3985db None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:53.392882 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5eacb-712d-4031-9a39-a2ad0f3985db None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:53.480274 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd24694-b5c7-46cb-b95f-9e946e6a9d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:53.482096 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd24694-b5c7-46cb-b95f-9e946e6a9d01 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:53.485607 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd24694-b5c7-46cb-b95f-9e946e6a9d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:53.490590 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd24694-b5c7-46cb-b95f-9e946e6a9d01 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:53.491919 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd24694-b5c7-46cb-b95f-9e946e6a9d01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:53.494289 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd24694-b5c7-46cb-b95f-9e946e6a9d01 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:53.542616 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 940/1865] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 08:48:53 2022] POST /identity/v3/users => generated 295 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:53.543922 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d0c0fe-6562-4e63-baec-1ceefb99c4cc admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:53.567643 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d0c0fe-6562-4e63-baec-1ceefb99c4cc admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:53.576747 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3373b6d-be75-4be8-8639-793bd37b64d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:53.577931 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3373b6d-be75-4be8-8639-793bd37b64d1 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:53.578402 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3373b6d-be75-4be8-8639-793bd37b64d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:53.578786 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3373b6d-be75-4be8-8639-793bd37b64d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:53.579734 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3373b6d-be75-4be8-8639-793bd37b64d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:53.581826 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3373b6d-be75-4be8-8639-793bd37b64d1 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:53.611547 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd24694-b5c7-46cb-b95f-9e946e6a9d01 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:53.627536 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 926/1866] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:48:53 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:48:53.639559 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd24694-b5c7-46cb-b95f-9e946e6a9d01 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:53.646689 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e344564-bb96-45d6-a325-fb639a280534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:53.648142 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e344564-bb96-45d6-a325-fb639a280534 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:53.648753 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e344564-bb96-45d6-a325-fb639a280534 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:53.649396 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e344564-bb96-45d6-a325-fb639a280534 admin admin] PATH_INFO: `/v3/projects/c65e59beb623423b9f871f7334264f80/users/cf7c59aed22a4946a26369ee683dbd2e/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:53.676614 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e344564-bb96-45d6-a325-fb639a280534 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c65e59beb623423b9f871f7334264f80, user_id=cf7c59aed22a4946a26369ee683dbd2e, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:53.680518 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e344564-bb96-45d6-a325-fb639a280534 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:53.702124 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 941/1867] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:48:53 2022] PUT /identity/v3/projects/c65e59beb623423b9f871f7334264f80/users/cf7c59aed22a4946a26369ee683dbd2e/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:53.703896 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3373b6d-be75-4be8-8639-793bd37b64d1 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:53.713519 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:53.731104 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3373b6d-be75-4be8-8639-793bd37b64d1 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:53.888289 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d43c8f-7750-42dc-bb4b-645d803b75f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:53.889055 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d43c8f-7750-42dc-bb4b-645d803b75f7 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:53.889334 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d43c8f-7750-42dc-bb4b-645d803b75f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:53.890970 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d43c8f-7750-42dc-bb4b-645d803b75f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:53.891728 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d43c8f-7750-42dc-bb4b-645d803b75f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:53.893798 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d43c8f-7750-42dc-bb4b-645d803b75f7 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:53.953020 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 927/1868] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:48:53 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 08:48:53.961324 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e344564-bb96-45d6-a325-fb639a280534 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:53.992495 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e344564-bb96-45d6-a325-fb639a280534 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:54.004341 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e5ee3-7696-4929-85d8-8a27a2e3041d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:54.006328 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e5ee3-7696-4929-85d8-8a27a2e3041d admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:54.007052 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e5ee3-7696-4929-85d8-8a27a2e3041d admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:54.007824 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e5ee3-7696-4929-85d8-8a27a2e3041d admin admin] PATH_INFO: `/v3/projects/c65e59beb623423b9f871f7334264f80/users/cf7c59aed22a4946a26369ee683dbd2e/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:54.013200 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33e5ee3-7696-4929-85d8-8a27a2e3041d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c65e59beb623423b9f871f7334264f80, user_id=cf7c59aed22a4946a26369ee683dbd2e, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:54.021902 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33e5ee3-7696-4929-85d8-8a27a2e3041d admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:54.065463 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 942/1869] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:48:53 2022] PUT /identity/v3/projects/c65e59beb623423b9f871f7334264f80/users/cf7c59aed22a4946a26369ee683dbd2e/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 08:48:54.068037 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2912d46-3888-4256-8524-fe9f9826432f None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:54.068606 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2912d46-3888-4256-8524-fe9f9826432f None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:54.069190 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2912d46-3888-4256-8524-fe9f9826432f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:54.181852 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-b2912d46-3888-4256-8524-fe9f9826432f None None] MFA Rules not processed for user `cf7c59aed22a4946a26369ee683dbd2e`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:54.187573 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-b2912d46-3888-4256-8524-fe9f9826432f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:54.330751 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 928/1870] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:54 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:54.346584 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e5ee3-7696-4929-85d8-8a27a2e3041d admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:54.352373 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-c33e5ee3-7696-4929-85d8-8a27a2e3041d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:54.719387 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:54.739903 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e5ee3-7696-4929-85d8-8a27a2e3041d admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:54.745792 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b18b5-c408-4086-85a6-b0343456dc24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:54.746839 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b18b5-c408-4086-85a6-b0343456dc24 service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:54.747385 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b18b5-c408-4086-85a6-b0343456dc24 service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:54.747908 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b18b5-c408-4086-85a6-b0343456dc24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:54.842576 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b18b5-c408-4086-85a6-b0343456dc24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:54.845050 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b18b5-c408-4086-85a6-b0343456dc24 service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:54.859722 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 943/1871] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:48:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:48:54.995074 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2912d46-3888-4256-8524-fe9f9826432f None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:55.003339 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-b2912d46-3888-4256-8524-fe9f9826432f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:55.135051 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2912d46-3888-4256-8524-fe9f9826432f None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:55.151106 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0284e7d-1396-4fcb-b464-d21171862ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:55.153135 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0284e7d-1396-4fcb-b464-d21171862ad9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:55.153496 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0284e7d-1396-4fcb-b464-d21171862ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:55.153859 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0284e7d-1396-4fcb-b464-d21171862ad9 admin admin] PATH_INFO: `/v3/users/030e4abf98af4e47b260e0213f89596b` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:55.155811 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0284e7d-1396-4fcb-b464-d21171862ad9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=030e4abf98af4e47b260e0213f89596b)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:55.158818 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0284e7d-1396-4fcb-b464-d21171862ad9 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:55.196560 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b18b5-c408-4086-85a6-b0343456dc24 service cinder] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:55.198095 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-5f3b18b5-c408-4086-85a6-b0343456dc24 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:55.226109 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:55.230666 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b18b5-c408-4086-85a6-b0343456dc24 service cinder] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:55.246731 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b784c6-0871-4739-8fb0-5fc188c3c736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:55.247785 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b784c6-0871-4739-8fb0-5fc188c3c736 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:55.248126 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b784c6-0871-4739-8fb0-5fc188c3c736 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:55.248409 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b784c6-0871-4739-8fb0-5fc188c3c736 admin admin] PATH_INFO: `/v3/users/39ef7b6b22c649858e3516977f2176b9` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:55.253022 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b784c6-0871-4739-8fb0-5fc188c3c736 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39ef7b6b22c649858e3516977f2176b9)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:55.255704 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b784c6-0871-4739-8fb0-5fc188c3c736 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:55.314696 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-b0284e7d-1396-4fcb-b464-d21171862ad9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '030e4abf98af4e47b260e0213f89596b'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:55.358367 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-b0284e7d-1396-4fcb-b464-d21171862ad9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '030e4abf98af4e47b260e0213f89596b'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:55.362545 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-b0284e7d-1396-4fcb-b464-d21171862ad9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '030e4abf98af4e47b260e0213f89596b'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:55.387147 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c6b784c6-0871-4739-8fb0-5fc188c3c736 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39ef7b6b22c649858e3516977f2176b9'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:55.394034 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-b0284e7d-1396-4fcb-b464-d21171862ad9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '030e4abf98af4e47b260e0213f89596b'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:55.397060 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-b0284e7d-1396-4fcb-b464-d21171862ad9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '030e4abf98af4e47b260e0213f89596b'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:55.406507 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c6b784c6-0871-4739-8fb0-5fc188c3c736 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39ef7b6b22c649858e3516977f2176b9'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:55.411813 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c6b784c6-0871-4739-8fb0-5fc188c3c736 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39ef7b6b22c649858e3516977f2176b9'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:55.433084 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c6b784c6-0871-4739-8fb0-5fc188c3c736 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39ef7b6b22c649858e3516977f2176b9'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:55.434830 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c6b784c6-0871-4739-8fb0-5fc188c3c736 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39ef7b6b22c649858e3516977f2176b9'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:55.452159 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 929/1872] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 08:48:54 2022] DELETE /identity/v3/users/030e4abf98af4e47b260e0213f89596b => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:55.455766 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbfe22c-562f-4696-8ae0-8401f67ff75d None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:55.456258 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbfe22c-562f-4696-8ae0-8401f67ff75d None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:55.467895 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbfe22c-562f-4696-8ae0-8401f67ff75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:55.500852 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 944/1873] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 08:48:55 2022] DELETE /identity/v3/users/39ef7b6b22c649858e3516977f2176b9 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 08:48:55.503610 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d426ca-6e02-47f8-afc7-fecfbbb93860 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:55.503610 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d426ca-6e02-47f8-afc7-fecfbbb93860 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:55.503865 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d426ca-6e02-47f8-afc7-fecfbbb93860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:55.542132 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-dfbfe22c-562f-4696-8ae0-8401f67ff75d None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:55.542132 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-dfbfe22c-562f-4696-8ae0-8401f67ff75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:55.546752 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-16d426ca-6e02-47f8-afc7-fecfbbb93860 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:55.548433 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-16d426ca-6e02-47f8-afc7-fecfbbb93860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:55.697130 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 930/1874] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:55.709052 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbfe22c-562f-4696-8ae0-8401f67ff75d None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:55.710627 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-dfbfe22c-562f-4696-8ae0-8401f67ff75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:55.737032 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 945/1875] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:55.737032 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d426ca-6e02-47f8-afc7-fecfbbb93860 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:55.757190 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-16d426ca-6e02-47f8-afc7-fecfbbb93860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:55.777781 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d426ca-6e02-47f8-afc7-fecfbbb93860 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:55.789918 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2730b0a9-e63a-4c70-b08f-6954e8b8bca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:55.791137 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730b0a9-e63a-4c70-b08f-6954e8b8bca2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:55.791705 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730b0a9-e63a-4c70-b08f-6954e8b8bca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:55.792004 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730b0a9-e63a-4c70-b08f-6954e8b8bca2 admin admin] PATH_INFO: `/v3/users/c670cfdf87284e0ba701e8d4fafc2e17` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:55.794775 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2730b0a9-e63a-4c70-b08f-6954e8b8bca2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c670cfdf87284e0ba701e8d4fafc2e17)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:55.797828 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2730b0a9-e63a-4c70-b08f-6954e8b8bca2 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:55.801597 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:55.805501 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbfe22c-562f-4696-8ae0-8401f67ff75d None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:55.812963 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45ff517-11c7-4436-a2c3-8b9737f4ae57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:55.813678 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ff517-11c7-4436-a2c3-8b9737f4ae57 service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:55.813984 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ff517-11c7-4436-a2c3-8b9737f4ae57 service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:55.814295 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ff517-11c7-4436-a2c3-8b9737f4ae57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:55.828617 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45ff517-11c7-4436-a2c3-8b9737f4ae57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:55.832255 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45ff517-11c7-4436-a2c3-8b9737f4ae57 service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:55.845872 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 931/1876] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:48:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 08:48:55.846971 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45ff517-11c7-4436-a2c3-8b9737f4ae57 service neutron] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:55.871410 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45ff517-11c7-4436-a2c3-8b9737f4ae57 service neutron] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:55.878159 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-2730b0a9-e63a-4c70-b08f-6954e8b8bca2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c670cfdf87284e0ba701e8d4fafc2e17'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:55.879410 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef5500b-15e9-47d7-b409-d990770b2fe7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:55.880438 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5500b-15e9-47d7-b409-d990770b2fe7 service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:55.881208 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5500b-15e9-47d7-b409-d990770b2fe7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:55.881661 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5500b-15e9-47d7-b409-d990770b2fe7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:55.886625 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-2730b0a9-e63a-4c70-b08f-6954e8b8bca2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c670cfdf87284e0ba701e8d4fafc2e17'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:55.887335 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-2730b0a9-e63a-4c70-b08f-6954e8b8bca2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c670cfdf87284e0ba701e8d4fafc2e17'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:55.895294 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef5500b-15e9-47d7-b409-d990770b2fe7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:55.896978 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef5500b-15e9-47d7-b409-d990770b2fe7 service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:55.899134 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-2730b0a9-e63a-4c70-b08f-6954e8b8bca2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c670cfdf87284e0ba701e8d4fafc2e17'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:55.900478 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-2730b0a9-e63a-4c70-b08f-6954e8b8bca2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c670cfdf87284e0ba701e8d4fafc2e17'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:55.908140 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 932/1877] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:48:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:48:55.908992 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef5500b-15e9-47d7-b409-d990770b2fe7 service neutron] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:55.910759 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-3ef5500b-15e9-47d7-b409-d990770b2fe7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:55.930025 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef5500b-15e9-47d7-b409-d990770b2fe7 service neutron] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:55.936328 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b560d-9a7f-4e75-bfd1-d7115aa69392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:55.937383 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b560d-9a7f-4e75-bfd1-d7115aa69392 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:55.937815 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b560d-9a7f-4e75-bfd1-d7115aa69392 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:55.938126 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b560d-9a7f-4e75-bfd1-d7115aa69392 admin admin] PATH_INFO: `/v3/users/c574b3e92dd941e9b524821bf2611a5a` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:55.939389 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6b560d-9a7f-4e75-bfd1-d7115aa69392 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c574b3e92dd941e9b524821bf2611a5a)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:55.940871 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 946/1878] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 08:48:55 2022] DELETE /identity/v3/users/c670cfdf87284e0ba701e8d4fafc2e17 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:55.942429 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6b560d-9a7f-4e75-bfd1-d7115aa69392 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:55.946995 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222ce1c-a0dc-42ab-8c9a-a88a52e2a032 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:55.948042 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222ce1c-a0dc-42ab-8c9a-a88a52e2a032 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:55.949181 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222ce1c-a0dc-42ab-8c9a-a88a52e2a032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:55.979345 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-f222ce1c-a0dc-42ab-8c9a-a88a52e2a032 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:55.980163 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:55.980976 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-f222ce1c-a0dc-42ab-8c9a-a88a52e2a032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:56.002548 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-1e6b560d-9a7f-4e75-bfd1-d7115aa69392 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c574b3e92dd941e9b524821bf2611a5a'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:56.013856 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-1e6b560d-9a7f-4e75-bfd1-d7115aa69392 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c574b3e92dd941e9b524821bf2611a5a'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:56.014998 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-1e6b560d-9a7f-4e75-bfd1-d7115aa69392 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c574b3e92dd941e9b524821bf2611a5a'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:56.025374 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-1e6b560d-9a7f-4e75-bfd1-d7115aa69392 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c574b3e92dd941e9b524821bf2611a5a'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:56.026215 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-1e6b560d-9a7f-4e75-bfd1-d7115aa69392 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c574b3e92dd941e9b524821bf2611a5a'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:56.056041 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 933/1879] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 08:48:55 2022] DELETE /identity/v3/users/c574b3e92dd941e9b524821bf2611a5a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:56.060417 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84d853-f083-4aed-9774-bdaea661c0d7 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:56.060956 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84d853-f083-4aed-9774-bdaea661c0d7 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:56.061384 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84d853-f083-4aed-9774-bdaea661c0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:56.074792 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 947/1880] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:56.085444 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222ce1c-a0dc-42ab-8c9a-a88a52e2a032 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:56.087367 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-f222ce1c-a0dc-42ab-8c9a-a88a52e2a032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:56.089938 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-6b84d853-f083-4aed-9774-bdaea661c0d7 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:56.091549 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-6b84d853-f083-4aed-9774-bdaea661c0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:56.183528 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 934/1881] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 08:48:56.193100 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b84d853-f083-4aed-9774-bdaea661c0d7 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:56.194804 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-6b84d853-f083-4aed-9774-bdaea661c0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:56.205996 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222ce1c-a0dc-42ab-8c9a-a88a52e2a032 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:56.268017 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:56.281442 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b84d853-f083-4aed-9774-bdaea661c0d7 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:56.286772 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1628f003-8b94-49d9-9148-c1aa3cc8c015 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:56.287456 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1628f003-8b94-49d9-9148-c1aa3cc8c015 service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:56.287740 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1628f003-8b94-49d9-9148-c1aa3cc8c015 service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:56.288015 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1628f003-8b94-49d9-9148-c1aa3cc8c015 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:56.301693 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1628f003-8b94-49d9-9148-c1aa3cc8c015 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:56.303528 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1628f003-8b94-49d9-9148-c1aa3cc8c015 service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:56.314496 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258b826-80aa-4cd5-9d30-08a3dcc26c19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:56.318651 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 935/1882] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:48:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 08:48:56.319306 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258b826-80aa-4cd5-9d30-08a3dcc26c19 service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:56.319665 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258b826-80aa-4cd5-9d30-08a3dcc26c19 service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:56.320000 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258b826-80aa-4cd5-9d30-08a3dcc26c19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:56.337892 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d258b826-80aa-4cd5-9d30-08a3dcc26c19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:56.340142 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d258b826-80aa-4cd5-9d30-08a3dcc26c19 service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:56.358619 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 948/1883] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:48:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 08:48:56.421668 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1628f003-8b94-49d9-9148-c1aa3cc8c015 service neutron] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:56.423378 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-1628f003-8b94-49d9-9148-c1aa3cc8c015 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:56.451582 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1628f003-8b94-49d9-9148-c1aa3cc8c015 service neutron] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:56.456770 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258b826-80aa-4cd5-9d30-08a3dcc26c19 service neutron] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:56.459308 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-d258b826-80aa-4cd5-9d30-08a3dcc26c19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:56.467114 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9178ad45-1734-487d-a477-df1757ff80e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:56.468121 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9178ad45-1734-487d-a477-df1757ff80e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:56.468419 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9178ad45-1734-487d-a477-df1757ff80e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:56.468699 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9178ad45-1734-487d-a477-df1757ff80e3 admin admin] PATH_INFO: `/v3/projects/498c6993aaa84655a68b6e5724b596c1` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:56.470883 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9178ad45-1734-487d-a477-df1757ff80e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=498c6993aaa84655a68b6e5724b596c1)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:56.474671 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9178ad45-1734-487d-a477-df1757ff80e3 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:56.490065 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258b826-80aa-4cd5-9d30-08a3dcc26c19 service neutron] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:56.501819 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ab461-2dfc-4651-8891-28a28776be90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:56.502738 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ab461-2dfc-4651-8891-28a28776be90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:56.503024 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ab461-2dfc-4651-8891-28a28776be90 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:56.503304 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ab461-2dfc-4651-8891-28a28776be90 admin admin] PATH_INFO: `/v3/projects/f89baef685b641b683fb2c1cfe8799c5` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:56.508143 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6ab461-2dfc-4651-8891-28a28776be90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f89baef685b641b683fb2c1cfe8799c5)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:56.518003 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6ab461-2dfc-4651-8891-28a28776be90 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:56.628318 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:56.644817 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-9178ad45-1734-487d-a477-df1757ff80e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '498c6993aaa84655a68b6e5724b596c1', 'request_id': 'req-9178ad45-1734-487d-a477-df1757ff80e3'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:56.681945 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-9178ad45-1734-487d-a477-df1757ff80e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '498c6993aaa84655a68b6e5724b596c1', 'request_id': 'req-9178ad45-1734-487d-a477-df1757ff80e3'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:56.719191 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-9178ad45-1734-487d-a477-df1757ff80e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '498c6993aaa84655a68b6e5724b596c1', 'request_id': 'req-9178ad45-1734-487d-a477-df1757ff80e3'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:56.740627 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-bd6ab461-2dfc-4651-8891-28a28776be90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f89baef685b641b683fb2c1cfe8799c5', 'request_id': 'req-bd6ab461-2dfc-4651-8891-28a28776be90'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:56.748263 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-9178ad45-1734-487d-a477-df1757ff80e3 admin admin] The token cache is being invalidate because project 498c6993aaa84655a68b6e5724b596c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 08:48:56.748844 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-9178ad45-1734-487d-a477-df1757ff80e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:56.749951 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-9178ad45-1734-487d-a477-df1757ff80e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:56.759580 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 936/1884] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 08:48:56 2022] DELETE /identity/v3/projects/498c6993aaa84655a68b6e5724b596c1 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:56.760616 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-bd6ab461-2dfc-4651-8891-28a28776be90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f89baef685b641b683fb2c1cfe8799c5', 'request_id': 'req-bd6ab461-2dfc-4651-8891-28a28776be90'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:56.761339 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9178ad45-1734-487d-a477-df1757ff80e3 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:56.763819 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-9178ad45-1734-487d-a477-df1757ff80e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:56.791316 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-bd6ab461-2dfc-4651-8891-28a28776be90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f89baef685b641b683fb2c1cfe8799c5', 'request_id': 'req-bd6ab461-2dfc-4651-8891-28a28776be90'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:56.828502 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-bd6ab461-2dfc-4651-8891-28a28776be90 admin admin] The token cache is being invalidate because project f89baef685b641b683fb2c1cfe8799c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 08:48:56.828801 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-bd6ab461-2dfc-4651-8891-28a28776be90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:56.831511 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-bd6ab461-2dfc-4651-8891-28a28776be90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:56.842029 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 949/1885] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 08:48:56 2022] DELETE /identity/v3/projects/f89baef685b641b683fb2c1cfe8799c5 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:56.852325 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ab461-2dfc-4651-8891-28a28776be90 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:56.856921 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-bd6ab461-2dfc-4651-8891-28a28776be90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:56.894029 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9178ad45-1734-487d-a477-df1757ff80e3 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:56.998437 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d63ff-1982-4c74-b031-b6a11f7efe22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:56.999427 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d63ff-1982-4c74-b031-b6a11f7efe22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:56.999782 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d63ff-1982-4c74-b031-b6a11f7efe22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:57.000245 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d63ff-1982-4c74-b031-b6a11f7efe22 admin admin] PATH_INFO: `/v3/users/adcfda220c2a4dfd9849f84baf2409e0` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:57.012955 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3d63ff-1982-4c74-b031-b6a11f7efe22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=adcfda220c2a4dfd9849f84baf2409e0)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:57.015083 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3d63ff-1982-4c74-b031-b6a11f7efe22 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:57.034401 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ab461-2dfc-4651-8891-28a28776be90 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:57.046365 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a42865-fde9-4a53-81c0-2f21ec825911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:57.048096 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a42865-fde9-4a53-81c0-2f21ec825911 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:57.049036 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a42865-fde9-4a53-81c0-2f21ec825911 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:57.049911 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a42865-fde9-4a53-81c0-2f21ec825911 admin admin] PATH_INFO: `/v3/users/6c2d062b90a84513a8c6d3eb1e9f12a7` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:57.052526 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a42865-fde9-4a53-81c0-2f21ec825911 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c2d062b90a84513a8c6d3eb1e9f12a7)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:57.055184 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a42865-fde9-4a53-81c0-2f21ec825911 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:57.102689 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-0e3d63ff-1982-4c74-b031-b6a11f7efe22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adcfda220c2a4dfd9849f84baf2409e0'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:57.113322 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-0e3d63ff-1982-4c74-b031-b6a11f7efe22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adcfda220c2a4dfd9849f84baf2409e0'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:57.114291 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-0e3d63ff-1982-4c74-b031-b6a11f7efe22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adcfda220c2a4dfd9849f84baf2409e0'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:57.118875 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-b4a42865-fde9-4a53-81c0-2f21ec825911 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c2d062b90a84513a8c6d3eb1e9f12a7'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:57.125845 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-0e3d63ff-1982-4c74-b031-b6a11f7efe22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adcfda220c2a4dfd9849f84baf2409e0'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:57.126814 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-0e3d63ff-1982-4c74-b031-b6a11f7efe22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adcfda220c2a4dfd9849f84baf2409e0'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:57.129260 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-b4a42865-fde9-4a53-81c0-2f21ec825911 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c2d062b90a84513a8c6d3eb1e9f12a7'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:57.130272 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-b4a42865-fde9-4a53-81c0-2f21ec825911 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c2d062b90a84513a8c6d3eb1e9f12a7'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:57.142124 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-b4a42865-fde9-4a53-81c0-2f21ec825911 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c2d062b90a84513a8c6d3eb1e9f12a7'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:57.143094 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-b4a42865-fde9-4a53-81c0-2f21ec825911 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c2d062b90a84513a8c6d3eb1e9f12a7'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:57.148008 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:57.148817 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:57.162176 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 937/1886] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 08:48:56 2022] DELETE /identity/v3/users/adcfda220c2a4dfd9849f84baf2409e0 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:57.176396 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 950/1887] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 08:48:56 2022] DELETE /identity/v3/users/6c2d062b90a84513a8c6d3eb1e9f12a7 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:57.526368 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d63ff-1982-4c74-b031-b6a11f7efe22 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:57.528040 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-0e3d63ff-1982-4c74-b031-b6a11f7efe22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:57.619510 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d63ff-1982-4c74-b031-b6a11f7efe22 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:57.709559 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94baf91a-51b0-4783-b9b4-bad8dedae09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:57.710538 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94baf91a-51b0-4783-b9b4-bad8dedae09a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:57.710819 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94baf91a-51b0-4783-b9b4-bad8dedae09a admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:57.711101 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94baf91a-51b0-4783-b9b4-bad8dedae09a admin admin] PATH_INFO: `/v3/projects/63966d32fce34983ac2fa378e2f09f7f` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:57.714527 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94baf91a-51b0-4783-b9b4-bad8dedae09a admin admin] RBAC: Authorizing `identity:delete_project(project_id=63966d32fce34983ac2fa378e2f09f7f)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:57.716475 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94baf91a-51b0-4783-b9b4-bad8dedae09a admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:57.774172 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-94baf91a-51b0-4783-b9b4-bad8dedae09a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63966d32fce34983ac2fa378e2f09f7f', 'request_id': 'req-94baf91a-51b0-4783-b9b4-bad8dedae09a'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:57.780592 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-94baf91a-51b0-4783-b9b4-bad8dedae09a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63966d32fce34983ac2fa378e2f09f7f', 'request_id': 'req-94baf91a-51b0-4783-b9b4-bad8dedae09a'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:57.787131 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a42865-fde9-4a53-81c0-2f21ec825911 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:57.789260 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-b4a42865-fde9-4a53-81c0-2f21ec825911 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:57.790551 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-94baf91a-51b0-4783-b9b4-bad8dedae09a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63966d32fce34983ac2fa378e2f09f7f', 'request_id': 'req-94baf91a-51b0-4783-b9b4-bad8dedae09a'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:57.807217 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a42865-fde9-4a53-81c0-2f21ec825911 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:57.808160 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-94baf91a-51b0-4783-b9b4-bad8dedae09a admin admin] The token cache is being invalidate because project 63966d32fce34983ac2fa378e2f09f7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 08:48:57.808642 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-94baf91a-51b0-4783-b9b4-bad8dedae09a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:57.810358 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-94baf91a-51b0-4783-b9b4-bad8dedae09a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:57.813109 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 938/1888] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 08:48:57 2022] DELETE /identity/v3/projects/63966d32fce34983ac2fa378e2f09f7f => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:57.817548 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94baf91a-51b0-4783-b9b4-bad8dedae09a admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:57.822747 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-94baf91a-51b0-4783-b9b4-bad8dedae09a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:57.889924 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:57.915034 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc93f7b-261a-451f-a1b6-7c9d70d179f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:57.916088 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc93f7b-261a-451f-a1b6-7c9d70d179f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:57.916513 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc93f7b-261a-451f-a1b6-7c9d70d179f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:57.916790 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc93f7b-261a-451f-a1b6-7c9d70d179f9 admin admin] PATH_INFO: `/v3/projects/b47a7735531849e38c2b6b2daa203c87` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:57.919866 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc93f7b-261a-451f-a1b6-7c9d70d179f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b47a7735531849e38c2b6b2daa203c87)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:57.923928 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc93f7b-261a-451f-a1b6-7c9d70d179f9 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:57.979794 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94baf91a-51b0-4783-b9b4-bad8dedae09a admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:57.986388 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c708d752-ace2-494e-9b03-66c942e8f479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:57.987495 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c708d752-ace2-494e-9b03-66c942e8f479 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:57.988328 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c708d752-ace2-494e-9b03-66c942e8f479 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:57.988616 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c708d752-ace2-494e-9b03-66c942e8f479 admin admin] PATH_INFO: `/v3/users/6cc2b6cb18644a439bf17775105eeae2` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:57.990713 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c708d752-ace2-494e-9b03-66c942e8f479 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cc2b6cb18644a439bf17775105eeae2)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:57.992844 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c708d752-ace2-494e-9b03-66c942e8f479 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:58.035768 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-ffc93f7b-261a-451f-a1b6-7c9d70d179f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b47a7735531849e38c2b6b2daa203c87', 'request_id': 'req-ffc93f7b-261a-451f-a1b6-7c9d70d179f9'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:58.059577 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-ffc93f7b-261a-451f-a1b6-7c9d70d179f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b47a7735531849e38c2b6b2daa203c87', 'request_id': 'req-ffc93f7b-261a-451f-a1b6-7c9d70d179f9'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:58.084015 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-ffc93f7b-261a-451f-a1b6-7c9d70d179f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b47a7735531849e38c2b6b2daa203c87', 'request_id': 'req-ffc93f7b-261a-451f-a1b6-7c9d70d179f9'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:58.105669 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-c708d752-ace2-494e-9b03-66c942e8f479 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cc2b6cb18644a439bf17775105eeae2'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:58.111258 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-ffc93f7b-261a-451f-a1b6-7c9d70d179f9 admin admin] The token cache is being invalidate because project b47a7735531849e38c2b6b2daa203c87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 08:48:58.111258 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-ffc93f7b-261a-451f-a1b6-7c9d70d179f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:58.111258 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-ffc93f7b-261a-451f-a1b6-7c9d70d179f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:58.117792 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 951/1889] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 08:48:57 2022] DELETE /identity/v3/projects/b47a7735531849e38c2b6b2daa203c87 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:58.118883 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc93f7b-261a-451f-a1b6-7c9d70d179f9 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:58.120731 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-ffc93f7b-261a-451f-a1b6-7c9d70d179f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:58.124993 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-c708d752-ace2-494e-9b03-66c942e8f479 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cc2b6cb18644a439bf17775105eeae2'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:58.127909 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-c708d752-ace2-494e-9b03-66c942e8f479 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cc2b6cb18644a439bf17775105eeae2'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:58.168888 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-c708d752-ace2-494e-9b03-66c942e8f479 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cc2b6cb18644a439bf17775105eeae2'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:58.171906 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-c708d752-ace2-494e-9b03-66c942e8f479 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cc2b6cb18644a439bf17775105eeae2'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:58.217589 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 939/1890] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 08:48:57 2022] DELETE /identity/v3/users/6cc2b6cb18644a439bf17775105eeae2 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 08:48:58.218632 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c708d752-ace2-494e-9b03-66c942e8f479 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:58.220323 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-c708d752-ace2-494e-9b03-66c942e8f479 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:58.234452 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc93f7b-261a-451f-a1b6-7c9d70d179f9 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:58.266746 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:58.318799 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c708d752-ace2-494e-9b03-66c942e8f479 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:58.326793 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a498eaaa-8b3e-4576-8a69-d91b0be9492b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:58.329335 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a498eaaa-8b3e-4576-8a69-d91b0be9492b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:58.330026 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a498eaaa-8b3e-4576-8a69-d91b0be9492b admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:58.330466 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a498eaaa-8b3e-4576-8a69-d91b0be9492b admin admin] PATH_INFO: `/v3/users/4f630870f8e7403abda9851224ba15ec` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:58.333252 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a498eaaa-8b3e-4576-8a69-d91b0be9492b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f630870f8e7403abda9851224ba15ec)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:58.336668 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a498eaaa-8b3e-4576-8a69-d91b0be9492b admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:58.367904 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540f2af8-185f-4a3f-bf74-d2f24f783ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:58.368928 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f2af8-185f-4a3f-bf74-d2f24f783ed8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:58.369128 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f2af8-185f-4a3f-bf74-d2f24f783ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:58.369412 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f2af8-185f-4a3f-bf74-d2f24f783ed8 admin admin] PATH_INFO: `/v3/projects/dfd1367e7ece429ca347681ba4721926` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:58.370724 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540f2af8-185f-4a3f-bf74-d2f24f783ed8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfd1367e7ece429ca347681ba4721926)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:58.372803 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540f2af8-185f-4a3f-bf74-d2f24f783ed8 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:58.446406 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-a498eaaa-8b3e-4576-8a69-d91b0be9492b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f630870f8e7403abda9851224ba15ec'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:58.459905 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-a498eaaa-8b3e-4576-8a69-d91b0be9492b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f630870f8e7403abda9851224ba15ec'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:58.460833 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-a498eaaa-8b3e-4576-8a69-d91b0be9492b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f630870f8e7403abda9851224ba15ec'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:58.465117 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:58.478775 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-a498eaaa-8b3e-4576-8a69-d91b0be9492b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f630870f8e7403abda9851224ba15ec'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:58.480148 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-a498eaaa-8b3e-4576-8a69-d91b0be9492b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f630870f8e7403abda9851224ba15ec'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:58.518660 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 940/1891] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 08:48:58 2022] DELETE /identity/v3/users/4f630870f8e7403abda9851224ba15ec => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:58.522925 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-540f2af8-185f-4a3f-bf74-d2f24f783ed8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfd1367e7ece429ca347681ba4721926', 'request_id': 'req-540f2af8-185f-4a3f-bf74-d2f24f783ed8'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:58.523554 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a498eaaa-8b3e-4576-8a69-d91b0be9492b admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:58.525308 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-a498eaaa-8b3e-4576-8a69-d91b0be9492b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:58.539050 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-540f2af8-185f-4a3f-bf74-d2f24f783ed8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfd1367e7ece429ca347681ba4721926', 'request_id': 'req-540f2af8-185f-4a3f-bf74-d2f24f783ed8'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:58.561451 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-540f2af8-185f-4a3f-bf74-d2f24f783ed8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfd1367e7ece429ca347681ba4721926', 'request_id': 'req-540f2af8-185f-4a3f-bf74-d2f24f783ed8'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:58.600193 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-540f2af8-185f-4a3f-bf74-d2f24f783ed8 admin admin] The token cache is being invalidate because project dfd1367e7ece429ca347681ba4721926 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 08:48:58.600671 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-540f2af8-185f-4a3f-bf74-d2f24f783ed8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:58.602724 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-540f2af8-185f-4a3f-bf74-d2f24f783ed8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:58.609245 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 952/1892] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 08:48:58 2022] DELETE /identity/v3/projects/dfd1367e7ece429ca347681ba4721926 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:58.614472 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540f2af8-185f-4a3f-bf74-d2f24f783ed8 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:58.617305 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-540f2af8-185f-4a3f-bf74-d2f24f783ed8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:58.638972 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a498eaaa-8b3e-4576-8a69-d91b0be9492b admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:58.668394 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0cec28-d528-484b-9c1c-ca16d75f6308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:58.669516 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0cec28-d528-484b-9c1c-ca16d75f6308 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:58.669810 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0cec28-d528-484b-9c1c-ca16d75f6308 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:58.670122 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0cec28-d528-484b-9c1c-ca16d75f6308 admin admin] PATH_INFO: `/v3/projects/16febdf691ff41e0b31bd4a272cbe2c2` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:58.671409 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0cec28-d528-484b-9c1c-ca16d75f6308 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16febdf691ff41e0b31bd4a272cbe2c2)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:58.673343 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0cec28-d528-484b-9c1c-ca16d75f6308 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:58.713744 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540f2af8-185f-4a3f-bf74-d2f24f783ed8 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:58.719727 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100c5e1e-8411-4a9a-8aeb-6e2a50bfcc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:58.720632 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c5e1e-8411-4a9a-8aeb-6e2a50bfcc9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:58.720914 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c5e1e-8411-4a9a-8aeb-6e2a50bfcc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:58.721330 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c5e1e-8411-4a9a-8aeb-6e2a50bfcc9e admin admin] PATH_INFO: `/v3/users/265096dcd09b462db0c0cb861c0cbf71` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:58.723648 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100c5e1e-8411-4a9a-8aeb-6e2a50bfcc9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=265096dcd09b462db0c0cb861c0cbf71)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:58.725929 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100c5e1e-8411-4a9a-8aeb-6e2a50bfcc9e admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:58.768775 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-2f0cec28-d528-484b-9c1c-ca16d75f6308 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16febdf691ff41e0b31bd4a272cbe2c2', 'request_id': 'req-2f0cec28-d528-484b-9c1c-ca16d75f6308'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:58.778659 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-2f0cec28-d528-484b-9c1c-ca16d75f6308 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16febdf691ff41e0b31bd4a272cbe2c2', 'request_id': 'req-2f0cec28-d528-484b-9c1c-ca16d75f6308'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:58.787728 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-2f0cec28-d528-484b-9c1c-ca16d75f6308 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16febdf691ff41e0b31bd4a272cbe2c2', 'request_id': 'req-2f0cec28-d528-484b-9c1c-ca16d75f6308'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:58.797722 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-100c5e1e-8411-4a9a-8aeb-6e2a50bfcc9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '265096dcd09b462db0c0cb861c0cbf71'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:58.803517 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:58.805794 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-2f0cec28-d528-484b-9c1c-ca16d75f6308 admin admin] The token cache is being invalidate because project 16febdf691ff41e0b31bd4a272cbe2c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 08:48:58.806306 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-2f0cec28-d528-484b-9c1c-ca16d75f6308 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:58.807977 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-2f0cec28-d528-484b-9c1c-ca16d75f6308 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:58.813950 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 941/1893] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 08:48:58 2022] DELETE /identity/v3/projects/16febdf691ff41e0b31bd4a272cbe2c2 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:58.813950 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0cec28-d528-484b-9c1c-ca16d75f6308 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:58.813950 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-2f0cec28-d528-484b-9c1c-ca16d75f6308 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:58.815581 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-100c5e1e-8411-4a9a-8aeb-6e2a50bfcc9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '265096dcd09b462db0c0cb861c0cbf71'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:58.816663 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-100c5e1e-8411-4a9a-8aeb-6e2a50bfcc9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '265096dcd09b462db0c0cb861c0cbf71'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:58.827220 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-100c5e1e-8411-4a9a-8aeb-6e2a50bfcc9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '265096dcd09b462db0c0cb861c0cbf71'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:58.828534 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-100c5e1e-8411-4a9a-8aeb-6e2a50bfcc9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '265096dcd09b462db0c0cb861c0cbf71'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:58.872314 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 953/1894] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 08:48:58 2022] DELETE /identity/v3/users/265096dcd09b462db0c0cb861c0cbf71 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:58.872314 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662326c0-91cf-4e3b-bfa9-191e13ee18f0 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:58.872583 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662326c0-91cf-4e3b-bfa9-191e13ee18f0 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:58.872753 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662326c0-91cf-4e3b-bfa9-191e13ee18f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:58.918778 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0cec28-d528-484b-9c1c-ca16d75f6308 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:58.930786 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:58.933510 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-662326c0-91cf-4e3b-bfa9-191e13ee18f0 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:58.934858 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-662326c0-91cf-4e3b-bfa9-191e13ee18f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:59.031194 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efabe952-ecd1-499d-b66d-342efecdced3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:59.033294 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efabe952-ecd1-499d-b66d-342efecdced3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:59.034007 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efabe952-ecd1-499d-b66d-342efecdced3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:59.035221 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efabe952-ecd1-499d-b66d-342efecdced3 admin admin] PATH_INFO: `/v3/projects/b7dc843cf0e64504b96b01cb3e043f44` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:59.038042 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efabe952-ecd1-499d-b66d-342efecdced3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7dc843cf0e64504b96b01cb3e043f44)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:59.040865 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efabe952-ecd1-499d-b66d-342efecdced3 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:59.090044 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 954/1895] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:59.091507 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662326c0-91cf-4e3b-bfa9-191e13ee18f0 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:59.092891 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-662326c0-91cf-4e3b-bfa9-191e13ee18f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:59.105569 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662326c0-91cf-4e3b-bfa9-191e13ee18f0 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:59.111824 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff991bc-794d-4c60-aab9-8b272892cbb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:59.113719 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff991bc-794d-4c60-aab9-8b272892cbb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:59.113719 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff991bc-794d-4c60-aab9-8b272892cbb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:59.113719 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff991bc-794d-4c60-aab9-8b272892cbb0 admin admin] PATH_INFO: `/v3/projects/e4d08d5af5ed46f38e319867713edfbc` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:59.116290 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff991bc-794d-4c60-aab9-8b272892cbb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4d08d5af5ed46f38e319867713edfbc)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:59.118756 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff991bc-794d-4c60-aab9-8b272892cbb0 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:59.134601 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-efabe952-ecd1-499d-b66d-342efecdced3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7dc843cf0e64504b96b01cb3e043f44', 'request_id': 'req-efabe952-ecd1-499d-b66d-342efecdced3'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:59.142235 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-efabe952-ecd1-499d-b66d-342efecdced3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7dc843cf0e64504b96b01cb3e043f44', 'request_id': 'req-efabe952-ecd1-499d-b66d-342efecdced3'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:59.150006 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-efabe952-ecd1-499d-b66d-342efecdced3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7dc843cf0e64504b96b01cb3e043f44', 'request_id': 'req-efabe952-ecd1-499d-b66d-342efecdced3'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:59.164136 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-efabe952-ecd1-499d-b66d-342efecdced3 admin admin] The token cache is being invalidate because project b7dc843cf0e64504b96b01cb3e043f44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 08:48:59.164427 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-efabe952-ecd1-499d-b66d-342efecdced3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:59.165530 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-efabe952-ecd1-499d-b66d-342efecdced3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:59.167760 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 942/1896] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 08:48:58 2022] DELETE /identity/v3/projects/b7dc843cf0e64504b96b01cb3e043f44 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:59.172180 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b2972-d54e-4e18-aa7c-972d29c8d261 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:59.172493 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b2972-d54e-4e18-aa7c-972d29c8d261 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:59.172853 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b2972-d54e-4e18-aa7c-972d29c8d261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:59.194643 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-e30b2972-d54e-4e18-aa7c-972d29c8d261 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:59.195877 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-e30b2972-d54e-4e18-aa7c-972d29c8d261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:59.200748 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-aff991bc-794d-4c60-aab9-8b272892cbb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4d08d5af5ed46f38e319867713edfbc', 'request_id': 'req-aff991bc-794d-4c60-aab9-8b272892cbb0'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:59.209766 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-aff991bc-794d-4c60-aab9-8b272892cbb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4d08d5af5ed46f38e319867713edfbc', 'request_id': 'req-aff991bc-794d-4c60-aab9-8b272892cbb0'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:59.220199 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-aff991bc-794d-4c60-aab9-8b272892cbb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4d08d5af5ed46f38e319867713edfbc', 'request_id': 'req-aff991bc-794d-4c60-aab9-8b272892cbb0'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:59.240125 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-aff991bc-794d-4c60-aab9-8b272892cbb0 admin admin] The token cache is being invalidate because project e4d08d5af5ed46f38e319867713edfbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 08:48:59.240456 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-aff991bc-794d-4c60-aab9-8b272892cbb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:59.241460 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-aff991bc-794d-4c60-aab9-8b272892cbb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:59.247818 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 955/1897] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 08:48:59 2022] DELETE /identity/v3/projects/e4d08d5af5ed46f38e319867713edfbc => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:59.247818 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca9e4e-667f-41ac-8904-6ab1365cc987 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:59.247818 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca9e4e-667f-41ac-8904-6ab1365cc987 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:59.247818 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca9e4e-667f-41ac-8904-6ab1365cc987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:59.283359 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-37ca9e4e-667f-41ac-8904-6ab1365cc987 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:59.284718 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-37ca9e4e-667f-41ac-8904-6ab1365cc987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:59.322133 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 943/1898] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:59.322688 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b7c0d-c7dd-4850-8ce0-4c6f1d272afd None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:59.322938 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b7c0d-c7dd-4850-8ce0-4c6f1d272afd None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:59.323877 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b7c0d-c7dd-4850-8ce0-4c6f1d272afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:59.338503 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:59.348521 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-cf3b7c0d-c7dd-4850-8ce0-4c6f1d272afd None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:59.350136 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-cf3b7c0d-c7dd-4850-8ce0-4c6f1d272afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:59.355838 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 956/1899] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:59.359250 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 944/1900] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:59.360076 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b7c0d-c7dd-4850-8ce0-4c6f1d272afd None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:59.363406 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca9e4e-667f-41ac-8904-6ab1365cc987 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:59.364774 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-37ca9e4e-667f-41ac-8904-6ab1365cc987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:59.370494 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b7c0d-c7dd-4850-8ce0-4c6f1d272afd None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:59.375175 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69935a23-e872-428b-9019-404ce319544b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:59.375842 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69935a23-e872-428b-9019-404ce319544b admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:59.376126 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69935a23-e872-428b-9019-404ce319544b admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:59.376403 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69935a23-e872-428b-9019-404ce319544b admin admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:59.377136 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69935a23-e872-428b-9019-404ce319544b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:59.377262 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca9e4e-667f-41ac-8904-6ab1365cc987 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:59.377442 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69935a23-e872-428b-9019-404ce319544b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:59.379773 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69935a23-e872-428b-9019-404ce319544b admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:59.382942 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519c328-54c1-47a1-a4f4-994186c679f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:59.383810 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519c328-54c1-47a1-a4f4-994186c679f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:59.384094 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519c328-54c1-47a1-a4f4-994186c679f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:59.384371 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519c328-54c1-47a1-a4f4-994186c679f2 admin admin] PATH_INFO: `/v3/projects/91df6e603dac44e9bc8e85cbd136f4cf` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:59.385592 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b519c328-54c1-47a1-a4f4-994186c679f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91df6e603dac44e9bc8e85cbd136f4cf)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:59.388004 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b519c328-54c1-47a1-a4f4-994186c679f2 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:59.397326 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 945/1901] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Jun 22 08:48:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:59.397326 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666afbf-6216-4f96-a5b4-916d2e3c841c None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:59.397326 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666afbf-6216-4f96-a5b4-916d2e3c841c None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:59.397326 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666afbf-6216-4f96-a5b4-916d2e3c841c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:59.414441 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-d666afbf-6216-4f96-a5b4-916d2e3c841c None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:59.415642 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-d666afbf-6216-4f96-a5b4-916d2e3c841c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:59.426280 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 946/1902] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:59.427550 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f38126-e06d-470d-bc47-c50f9d364899 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:59.427835 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f38126-e06d-470d-bc47-c50f9d364899 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:59.428110 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f38126-e06d-470d-bc47-c50f9d364899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:59.444643 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-b519c328-54c1-47a1-a4f4-994186c679f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91df6e603dac44e9bc8e85cbd136f4cf', 'request_id': 'req-b519c328-54c1-47a1-a4f4-994186c679f2'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:59.447178 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-20f38126-e06d-470d-bc47-c50f9d364899 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:59.448399 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-20f38126-e06d-470d-bc47-c50f9d364899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:59.450888 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-b519c328-54c1-47a1-a4f4-994186c679f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91df6e603dac44e9bc8e85cbd136f4cf', 'request_id': 'req-b519c328-54c1-47a1-a4f4-994186c679f2'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:59.457479 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-b519c328-54c1-47a1-a4f4-994186c679f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91df6e603dac44e9bc8e85cbd136f4cf', 'request_id': 'req-b519c328-54c1-47a1-a4f4-994186c679f2'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:59.458640 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:59.470596 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-b519c328-54c1-47a1-a4f4-994186c679f2 admin admin] The token cache is being invalidate because project 91df6e603dac44e9bc8e85cbd136f4cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 08:48:59.471103 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-b519c328-54c1-47a1-a4f4-994186c679f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:59.471847 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-b519c328-54c1-47a1-a4f4-994186c679f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:48:59.473774 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 957/1903] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 08:48:59 2022] DELETE /identity/v3/projects/91df6e603dac44e9bc8e85cbd136f4cf => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:59.474537 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519c328-54c1-47a1-a4f4-994186c679f2 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:59.475838 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-b519c328-54c1-47a1-a4f4-994186c679f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:59.511931 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 947/1904] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:59.512690 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f38126-e06d-470d-bc47-c50f9d364899 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:59.516122 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-20f38126-e06d-470d-bc47-c50f9d364899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:59.527702 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f38126-e06d-470d-bc47-c50f9d364899 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:59.532511 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e373a1c9-79ce-4d7f-9251-f45d0a926e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:59.533364 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373a1c9-79ce-4d7f-9251-f45d0a926e4d admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:59.533791 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373a1c9-79ce-4d7f-9251-f45d0a926e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:59.534098 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373a1c9-79ce-4d7f-9251-f45d0a926e4d admin admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:59.534837 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e373a1c9-79ce-4d7f-9251-f45d0a926e4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:59.535144 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e373a1c9-79ce-4d7f-9251-f45d0a926e4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:59.536732 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e373a1c9-79ce-4d7f-9251-f45d0a926e4d admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:59.548437 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 948/1905] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Jun 22 08:48:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:59.549245 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519c328-54c1-47a1-a4f4-994186c679f2 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:59.549690 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea8045-5ac5-46e0-affb-a2c69c810eca None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:59.549982 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea8045-5ac5-46e0-affb-a2c69c810eca None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:59.550801 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea8045-5ac5-46e0-affb-a2c69c810eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:59.554806 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384846f-845b-4efa-afb1-f886859044fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:59.555470 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384846f-845b-4efa-afb1-f886859044fb admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:59.555750 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384846f-845b-4efa-afb1-f886859044fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:59.556022 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384846f-845b-4efa-afb1-f886859044fb admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:59.556717 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0384846f-845b-4efa-afb1-f886859044fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:59.558655 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0384846f-845b-4efa-afb1-f886859044fb admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:59.570782 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-43ea8045-5ac5-46e0-affb-a2c69c810eca None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:59.571995 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-43ea8045-5ac5-46e0-affb-a2c69c810eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:59.580567 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 949/1906] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:59.582000 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea8045-5ac5-46e0-affb-a2c69c810eca None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:59.591711 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea8045-5ac5-46e0-affb-a2c69c810eca None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:59.597538 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 958/1907] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 08:48:59 2022] POST /identity/v3/projects => generated 399 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:59.597538 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384846f-845b-4efa-afb1-f886859044fb admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:59.597759 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217cf15a-fe82-4092-93ea-5c00db066c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:59.597905 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217cf15a-fe82-4092-93ea-5c00db066c5c admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:59.598355 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217cf15a-fe82-4092-93ea-5c00db066c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:59.598749 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217cf15a-fe82-4092-93ea-5c00db066c5c admin admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:59.599764 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217cf15a-fe82-4092-93ea-5c00db066c5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:59.600072 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217cf15a-fe82-4092-93ea-5c00db066c5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:59.601686 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217cf15a-fe82-4092-93ea-5c00db066c5c admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:59.613985 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 950/1908] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Jun 22 08:48:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:59.615291 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e28b3-8484-4313-b896-23bb4c75ac08 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:59.615580 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e28b3-8484-4313-b896-23bb4c75ac08 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:59.615854 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e28b3-8484-4313-b896-23bb4c75ac08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:59.633666 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-a51e28b3-8484-4313-b896-23bb4c75ac08 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:59.634935 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-a51e28b3-8484-4313-b896-23bb4c75ac08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:59.662354 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384846f-845b-4efa-afb1-f886859044fb admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:59.667504 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ddf10a-2e29-4c44-a88c-c7c6316922ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:59.668177 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ddf10a-2e29-4c44-a88c-c7c6316922ab admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:59.668465 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ddf10a-2e29-4c44-a88c-c7c6316922ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:59.668748 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ddf10a-2e29-4c44-a88c-c7c6316922ab admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:59.670257 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ddf10a-2e29-4c44-a88c-c7c6316922ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:59.671628 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ddf10a-2e29-4c44-a88c-c7c6316922ab admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:59.676902 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:59.711163 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 959/1909] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 08:48:59 2022] POST /identity/v3/projects => generated 365 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:59.712308 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ddf10a-2e29-4c44-a88c-c7c6316922ab admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:59.749525 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 951/1910] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:48:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:48:59.750401 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e28b3-8484-4313-b896-23bb4c75ac08 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:59.767043 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e28b3-8484-4313-b896-23bb4c75ac08 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:59.813197 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ddf10a-2e29-4c44-a88c-c7c6316922ab admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:59.826876 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a413f-d922-470b-a026-8d1b86f1c636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:59.829829 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a413f-d922-470b-a026-8d1b86f1c636 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:59.830190 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a413f-d922-470b-a026-8d1b86f1c636 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:59.831260 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a413f-d922-470b-a026-8d1b86f1c636 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:59.832854 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051a413f-d922-470b-a026-8d1b86f1c636 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:59.835834 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051a413f-d922-470b-a026-8d1b86f1c636 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:59.878781 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1317421d-ba21-4880-a023-ea7107b1c341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:59.879774 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317421d-ba21-4880-a023-ea7107b1c341 admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:59.880832 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317421d-ba21-4880-a023-ea7107b1c341 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:59.881731 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317421d-ba21-4880-a023-ea7107b1c341 admin admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:59.888312 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 960/1911] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 08:48:59 2022] POST /identity/v3/users => generated 300 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:59.888312 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a413f-d922-470b-a026-8d1b86f1c636 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:59.889030 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1317421d-ba21-4880-a023-ea7107b1c341 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:59.893069 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1317421d-ba21-4880-a023-ea7107b1c341 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:59.901968 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a413f-d922-470b-a026-8d1b86f1c636 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:59.908372 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e348a19-69e3-4a4a-9c00-8709acbbfa2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:59.909146 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e348a19-69e3-4a4a-9c00-8709acbbfa2d admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:59.910691 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e348a19-69e3-4a4a-9c00-8709acbbfa2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:59.910838 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e348a19-69e3-4a4a-9c00-8709acbbfa2d admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:59.911940 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e348a19-69e3-4a4a-9c00-8709acbbfa2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:59.915296 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e348a19-69e3-4a4a-9c00-8709acbbfa2d admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:59.943536 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 952/1912] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 08:48:59 2022] POST /identity/v3/projects => generated 387 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:59.944665 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1317421d-ba21-4880-a023-ea7107b1c341 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:59.954759 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 961/1913] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 08:48:59 2022] POST /identity/v3/users => generated 283 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:59.956076 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e348a19-69e3-4a4a-9c00-8709acbbfa2d admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:59.965007 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:59.969210 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e348a19-69e3-4a4a-9c00-8709acbbfa2d admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:00.059752 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a19d5be-ee65-4a15-b79f-2f666f29189a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:00.060722 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a19d5be-ee65-4a15-b79f-2f666f29189a admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:00.061118 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a19d5be-ee65-4a15-b79f-2f666f29189a admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:00.061504 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a19d5be-ee65-4a15-b79f-2f666f29189a admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:00.062863 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a19d5be-ee65-4a15-b79f-2f666f29189a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:00.064824 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a19d5be-ee65-4a15-b79f-2f666f29189a admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:00.084895 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 962/1914] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:48:59 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:49:00.086142 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a19d5be-ee65-4a15-b79f-2f666f29189a admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:00.104001 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1317421d-ba21-4880-a023-ea7107b1c341 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:00.104583 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a19d5be-ee65-4a15-b79f-2f666f29189a admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:00.110783 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a31f49-6daf-4337-8ec0-4a64705f1fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:00.110943 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc7263-cd52-422b-acf0-c4338713c130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:00.111551 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc7263-cd52-422b-acf0-c4338713c130 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:00.111844 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc7263-cd52-422b-acf0-c4338713c130 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:00.112118 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc7263-cd52-422b-acf0-c4338713c130 admin admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:00.112227 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a31f49-6daf-4337-8ec0-4a64705f1fa8 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:00.112615 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a31f49-6daf-4337-8ec0-4a64705f1fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:00.112958 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dc7263-cd52-422b-acf0-c4338713c130 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:00.113098 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a31f49-6daf-4337-8ec0-4a64705f1fa8 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:00.113269 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dc7263-cd52-422b-acf0-c4338713c130 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:00.114028 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a31f49-6daf-4337-8ec0-4a64705f1fa8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:00.116244 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a31f49-6daf-4337-8ec0-4a64705f1fa8 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:00.116678 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dc7263-cd52-422b-acf0-c4338713c130 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:00.133271 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 953/1915] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Jun 22 08:48:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:00.134261 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc7263-cd52-422b-acf0-c4338713c130 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:00.150502 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc7263-cd52-422b-acf0-c4338713c130 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:00.155814 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89475d-12fd-4af6-8d45-bcab68ba131a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:00.156753 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 963/1916] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 08:49:00 2022] POST /identity/v3/users => generated 294 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:49:00.157639 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a31f49-6daf-4337-8ec0-4a64705f1fa8 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:00.160189 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89475d-12fd-4af6-8d45-bcab68ba131a admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:00.160629 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89475d-12fd-4af6-8d45-bcab68ba131a admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:00.160928 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89475d-12fd-4af6-8d45-bcab68ba131a admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:00.161152 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-26a31f49-6daf-4337-8ec0-4a64705f1fa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:00.161929 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b89475d-12fd-4af6-8d45-bcab68ba131a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:00.164050 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b89475d-12fd-4af6-8d45-bcab68ba131a admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:00.180652 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 954/1917] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:49:00 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:49:00.182434 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89475d-12fd-4af6-8d45-bcab68ba131a admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:00.195716 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89475d-12fd-4af6-8d45-bcab68ba131a admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:00.200544 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a5386-c586-4373-850a-7dbd7df6d5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:00.201224 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a5386-c586-4373-850a-7dbd7df6d5a4 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:00.201514 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a5386-c586-4373-850a-7dbd7df6d5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:00.201796 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a5386-c586-4373-850a-7dbd7df6d5a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:00.203270 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a5386-c586-4373-850a-7dbd7df6d5a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:00.205090 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a5386-c586-4373-850a-7dbd7df6d5a4 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:00.218189 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 955/1918] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:49:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:49:00.218951 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a5386-c586-4373-850a-7dbd7df6d5a4 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:00.228915 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:00.231925 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a5386-c586-4373-850a-7dbd7df6d5a4 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:00.238050 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a7905-4daf-4cbd-877a-611eef45fe44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:00.238746 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a7905-4daf-4cbd-877a-611eef45fe44 admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:00.239013 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a7905-4daf-4cbd-877a-611eef45fe44 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:00.239294 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a7905-4daf-4cbd-877a-611eef45fe44 admin admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:00.240051 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03a7905-4daf-4cbd-877a-611eef45fe44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:00.242246 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03a7905-4daf-4cbd-877a-611eef45fe44 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:00.249001 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a31f49-6daf-4337-8ec0-4a64705f1fa8 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:00.253587 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ed18c3-166d-40fd-84a7-dae745b6796e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:00.254678 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed18c3-166d-40fd-84a7-dae745b6796e service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:00.255255 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed18c3-166d-40fd-84a7-dae745b6796e service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:00.255759 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed18c3-166d-40fd-84a7-dae745b6796e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:00.258782 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-97ed18c3-166d-40fd-84a7-dae745b6796e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:00.287134 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 956/1919] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 08:49:00 2022] POST /identity/v3/projects => generated 375 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:49:00.287982 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a7905-4daf-4cbd-877a-611eef45fe44 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:00.375509 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ed18c3-166d-40fd-84a7-dae745b6796e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:00.377192 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ed18c3-166d-40fd-84a7-dae745b6796e service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:00.384336 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a7905-4daf-4cbd-877a-611eef45fe44 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:00.393248 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb5da14-8d61-461e-9b1e-888c25d39ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:00.394820 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 964/1920] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:49:00 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:49:00.394959 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb5da14-8d61-461e-9b1e-888c25d39ff2 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:00.395418 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ed18c3-166d-40fd-84a7-dae745b6796e service cinder] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:00.409966 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ed18c3-166d-40fd-84a7-dae745b6796e service cinder] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:00.412871 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb5da14-8d61-461e-9b1e-888c25d39ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:00.413105 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb5da14-8d61-461e-9b1e-888c25d39ff2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:00.416526 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb5da14-8d61-461e-9b1e-888c25d39ff2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:00.417073 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a43344b-c2e3-4e8f-8ed4-4ea45c84c3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:00.418003 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43344b-c2e3-4e8f-8ed4-4ea45c84c3c6 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:00.418548 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43344b-c2e3-4e8f-8ed4-4ea45c84c3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:00.419037 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43344b-c2e3-4e8f-8ed4-4ea45c84c3c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:00.419996 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a43344b-c2e3-4e8f-8ed4-4ea45c84c3c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:00.423000 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb5da14-8d61-461e-9b1e-888c25d39ff2 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:00.423971 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a43344b-c2e3-4e8f-8ed4-4ea45c84c3c6 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:00.439191 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 965/1921] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:49:00 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:49:00.440416 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a43344b-c2e3-4e8f-8ed4-4ea45c84c3c6 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:00.459194 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 957/1922] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:49:00 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:49:00.460441 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb5da14-8d61-461e-9b1e-888c25d39ff2 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:00.472535 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a43344b-c2e3-4e8f-8ed4-4ea45c84c3c6 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:00.479736 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb5da14-8d61-461e-9b1e-888c25d39ff2 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:00.484160 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14cf201-7579-4ca4-a689-bf5c7a888323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:00.485137 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14cf201-7579-4ca4-a689-bf5c7a888323 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:00.485423 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14cf201-7579-4ca4-a689-bf5c7a888323 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:00.485798 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14cf201-7579-4ca4-a689-bf5c7a888323 admin admin] PATH_INFO: `/v3/projects/eaaf41dc28784c53b9101ab1a5f47bd6/users/4761507897fb4d95a47426c5fd41672c/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:00.488027 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c8da8b-a50b-4424-8a18-9ffe806a53d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:00.489109 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8da8b-a50b-4424-8a18-9ffe806a53d5 admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:00.489556 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8da8b-a50b-4424-8a18-9ffe806a53d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:00.490771 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8da8b-a50b-4424-8a18-9ffe806a53d5 admin admin] PATH_INFO: `/v3/users` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:00.491188 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c8da8b-a50b-4424-8a18-9ffe806a53d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:00.495105 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c8da8b-a50b-4424-8a18-9ffe806a53d5 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:00.528516 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 958/1923] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 08:49:00 2022] POST /identity/v3/users => generated 288 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:49:00.528516 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c8da8b-a50b-4424-8a18-9ffe806a53d5 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:00.548298 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14cf201-7579-4ca4-a689-bf5c7a888323 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaaf41dc28784c53b9101ab1a5f47bd6, user_id=4761507897fb4d95a47426c5fd41672c, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:00.551075 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14cf201-7579-4ca4-a689-bf5c7a888323 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:00.554014 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c8da8b-a50b-4424-8a18-9ffe806a53d5 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:00.581014 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f9c542-e0e0-4bb9-904a-73d25f6145f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:00.582698 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f9c542-e0e0-4bb9-904a-73d25f6145f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:00.583183 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f9c542-e0e0-4bb9-904a-73d25f6145f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:00.583756 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f9c542-e0e0-4bb9-904a-73d25f6145f9 admin admin] PATH_INFO: `/v3/projects/e2999f7575e04059b4ae46cfc9f778b8/users/26c13fc5da7544f0b160749c2fb38576/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:00.588549 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 966/1924] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:49:00 2022] PUT /identity/v3/projects/eaaf41dc28784c53b9101ab1a5f47bd6/users/4761507897fb4d95a47426c5fd41672c/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:00.589761 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14cf201-7579-4ca4-a689-bf5c7a888323 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:00.617309 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f9c542-e0e0-4bb9-904a-73d25f6145f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2999f7575e04059b4ae46cfc9f778b8, user_id=26c13fc5da7544f0b160749c2fb38576, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:00.623001 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f9c542-e0e0-4bb9-904a-73d25f6145f9 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:00.659337 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 959/1925] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:49:00 2022] PUT /identity/v3/projects/e2999f7575e04059b4ae46cfc9f778b8/users/26c13fc5da7544f0b160749c2fb38576/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:00.662097 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f9c542-e0e0-4bb9-904a-73d25f6145f9 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:00.705804 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:00.767876 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14cf201-7579-4ca4-a689-bf5c7a888323 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:00.804651 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f9c542-e0e0-4bb9-904a-73d25f6145f9 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:00.816808 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aa19f2-ca26-4b18-8f81-2f79bf164010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:00.817719 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa19f2-ca26-4b18-8f81-2f79bf164010 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:00.818633 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa19f2-ca26-4b18-8f81-2f79bf164010 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:00.819083 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa19f2-ca26-4b18-8f81-2f79bf164010 admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:00.820036 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aa19f2-ca26-4b18-8f81-2f79bf164010 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:00.823071 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aa19f2-ca26-4b18-8f81-2f79bf164010 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:00.839091 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 960/1926] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:49:00 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:49:00.840684 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a491b1a-f34f-4c1a-a14e-c6f46cd9ea1b None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:00.841140 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a491b1a-f34f-4c1a-a14e-c6f46cd9ea1b None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:00.841572 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a491b1a-f34f-4c1a-a14e-c6f46cd9ea1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:00.861531 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb12588f-4f2d-476b-9fe3-a37f6b8d3ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:00.862259 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12588f-4f2d-476b-9fe3-a37f6b8d3ba7 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:00.862582 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12588f-4f2d-476b-9fe3-a37f6b8d3ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:00.863409 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12588f-4f2d-476b-9fe3-a37f6b8d3ba7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:00.864973 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb12588f-4f2d-476b-9fe3-a37f6b8d3ba7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:00.867522 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb12588f-4f2d-476b-9fe3-a37f6b8d3ba7 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:00.869129 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:00.887856 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 967/1927] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:49:00 2022] GET /identity/v3/roles => generated 1420 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:49:00.889676 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb0e10-dd53-471e-9d9e-18de28951c8d None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:00.889971 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb0e10-dd53-471e-9d9e-18de28951c8d None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:00.890304 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb0e10-dd53-471e-9d9e-18de28951c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:00.907708 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-3a491b1a-f34f-4c1a-a14e-c6f46cd9ea1b None None] MFA Rules not processed for user `4761507897fb4d95a47426c5fd41672c`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:00.909065 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-3a491b1a-f34f-4c1a-a14e-c6f46cd9ea1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:00.936035 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-95bb0e10-dd53-471e-9d9e-18de28951c8d None None] MFA Rules not processed for user `26c13fc5da7544f0b160749c2fb38576`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:00.936035 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-95bb0e10-dd53-471e-9d9e-18de28951c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:01.040145 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 961/1928] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:00 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:01.044933 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a491b1a-f34f-4c1a-a14e-c6f46cd9ea1b None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:01.061621 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a491b1a-f34f-4c1a-a14e-c6f46cd9ea1b None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:01.068367 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbcb5af-1168-4d4f-9509-f33468b974bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:01.069282 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbcb5af-1168-4d4f-9509-f33468b974bd admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:01.070209 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbcb5af-1168-4d4f-9509-f33468b974bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:01.070662 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbcb5af-1168-4d4f-9509-f33468b974bd admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:01.071762 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbcb5af-1168-4d4f-9509-f33468b974bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:01.074176 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbcb5af-1168-4d4f-9509-f33468b974bd admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:01.084336 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 968/1929] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:00 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:01.086328 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bb0e10-dd53-471e-9d9e-18de28951c8d None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:01.090478 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 962/1930] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:49:01.091554 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbcb5af-1168-4d4f-9509-f33468b974bd admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:01.104020 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bb0e10-dd53-471e-9d9e-18de28951c8d None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:01.107336 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbcb5af-1168-4d4f-9509-f33468b974bd admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:01.112190 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa1d018-1b71-47b5-8b03-40d15c229453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:01.114404 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1d018-1b71-47b5-8b03-40d15c229453 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:01.115058 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1d018-1b71-47b5-8b03-40d15c229453 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:01.115418 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e2d8e-6b74-4097-8623-92f890792dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:01.115810 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1d018-1b71-47b5-8b03-40d15c229453 admin admin] PATH_INFO: `/v3/projects/14bf34abe12949a1bc336a326e15f788/users/18baac3403f24f879cb6d9cd4d0cbad7/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:01.116544 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e2d8e-6b74-4097-8623-92f890792dd4 admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:01.116937 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e2d8e-6b74-4097-8623-92f890792dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:01.117391 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e2d8e-6b74-4097-8623-92f890792dd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:01.118544 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103e2d8e-6b74-4097-8623-92f890792dd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:01.120981 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103e2d8e-6b74-4097-8623-92f890792dd4 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:01.141473 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa1d018-1b71-47b5-8b03-40d15c229453 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14bf34abe12949a1bc336a326e15f788, user_id=18baac3403f24f879cb6d9cd4d0cbad7, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:01.158197 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa1d018-1b71-47b5-8b03-40d15c229453 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:01.164987 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 963/1931] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 08:49:01 2022] POST /identity/v3/projects => generated 399 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:49:01.166155 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e2d8e-6b74-4097-8623-92f890792dd4 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:01.180805 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 969/1932] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:49:01 2022] PUT /identity/v3/projects/14bf34abe12949a1bc336a326e15f788/users/18baac3403f24f879cb6d9cd4d0cbad7/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:01.184452 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa1d018-1b71-47b5-8b03-40d15c229453 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:01.275359 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e2d8e-6b74-4097-8623-92f890792dd4 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:01.286474 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:01.297817 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa1d018-1b71-47b5-8b03-40d15c229453 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:01.318464 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ed3bf0-8ff9-42c0-a47d-f40e7aede4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:01.319829 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed3bf0-8ff9-42c0-a47d-f40e7aede4e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:01.320813 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed3bf0-8ff9-42c0-a47d-f40e7aede4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:01.321291 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed3bf0-8ff9-42c0-a47d-f40e7aede4e0 admin admin] PATH_INFO: `/v3/projects/ba5945c9ae9343ad8d17d5af71c23239/users/7efbfe8a2a074bd9b7011c9be11ee302/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:01.342852 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ed3bf0-8ff9-42c0-a47d-f40e7aede4e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba5945c9ae9343ad8d17d5af71c23239, user_id=7efbfe8a2a074bd9b7011c9be11ee302, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:01.346114 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ed3bf0-8ff9-42c0-a47d-f40e7aede4e0 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:01.352440 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e962a5d-f628-4d5c-8d49-3d5868e5330a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:01.353766 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e962a5d-f628-4d5c-8d49-3d5868e5330a admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:01.354064 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e962a5d-f628-4d5c-8d49-3d5868e5330a admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:01.354455 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e962a5d-f628-4d5c-8d49-3d5868e5330a admin admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:01.355361 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e962a5d-f628-4d5c-8d49-3d5868e5330a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:01.358196 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e962a5d-f628-4d5c-8d49-3d5868e5330a admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:01.370413 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 970/1933] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:49:01 2022] PUT /identity/v3/projects/ba5945c9ae9343ad8d17d5af71c23239/users/7efbfe8a2a074bd9b7011c9be11ee302/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:01.371578 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ed3bf0-8ff9-42c0-a47d-f40e7aede4e0 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:01.418391 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 964/1934] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 08:49:01 2022] POST /identity/v3/projects => generated 361 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:49:01.418391 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b760359-e10e-4969-a70e-6fe650f3d268 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:01.418391 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b760359-e10e-4969-a70e-6fe650f3d268 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:01.418391 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b760359-e10e-4969-a70e-6fe650f3d268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:01.449779 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:01.454403 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-5b760359-e10e-4969-a70e-6fe650f3d268 None None] MFA Rules not processed for user `18baac3403f24f879cb6d9cd4d0cbad7`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:01.456366 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-5b760359-e10e-4969-a70e-6fe650f3d268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:01.477180 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ed3bf0-8ff9-42c0-a47d-f40e7aede4e0 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:01.553489 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd70a4-110d-456e-9556-8f34a24a24cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:01.555842 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 965/1935] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:01.557447 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9164ae8-2314-4788-9096-755aaec85a84 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:01.557755 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9164ae8-2314-4788-9096-755aaec85a84 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:01.558036 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9164ae8-2314-4788-9096-755aaec85a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:01.562323 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd70a4-110d-456e-9556-8f34a24a24cd admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:01.562910 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd70a4-110d-456e-9556-8f34a24a24cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:01.563775 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd70a4-110d-456e-9556-8f34a24a24cd admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:01.565550 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bd70a4-110d-456e-9556-8f34a24a24cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:01.569215 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bd70a4-110d-456e-9556-8f34a24a24cd admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:01.598344 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-d9164ae8-2314-4788-9096-755aaec85a84 None None] MFA Rules not processed for user `7efbfe8a2a074bd9b7011c9be11ee302`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:01.598973 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 971/1936] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 08:49:01 2022] POST /identity/v3/users => generated 306 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:49:01.599905 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-d9164ae8-2314-4788-9096-755aaec85a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:01.600270 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd70a4-110d-456e-9556-8f34a24a24cd admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:01.611275 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd70a4-110d-456e-9556-8f34a24a24cd admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:01.616841 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652baea-8636-416b-a11b-f29606c61580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:01.617551 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652baea-8636-416b-a11b-f29606c61580 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:01.617831 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652baea-8636-416b-a11b-f29606c61580 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:01.618133 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652baea-8636-416b-a11b-f29606c61580 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:01.618855 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5652baea-8636-416b-a11b-f29606c61580 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:01.621244 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5652baea-8636-416b-a11b-f29606c61580 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:01.650797 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 972/1937] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 08:49:01 2022] POST /identity/v3/users => generated 287 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:49:01.650797 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652baea-8636-416b-a11b-f29606c61580 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:01.663132 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652baea-8636-416b-a11b-f29606c61580 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:01.668736 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b81690-0220-4d2f-90bb-3c717c6b9582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:01.669561 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b81690-0220-4d2f-90bb-3c717c6b9582 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:01.669923 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b81690-0220-4d2f-90bb-3c717c6b9582 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:01.670295 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b81690-0220-4d2f-90bb-3c717c6b9582 admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:01.671434 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b81690-0220-4d2f-90bb-3c717c6b9582 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:01.673511 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b81690-0220-4d2f-90bb-3c717c6b9582 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:01.682053 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 966/1938] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:01.686238 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9164ae8-2314-4788-9096-755aaec85a84 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:01.696734 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9164ae8-2314-4788-9096-755aaec85a84 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:01.701227 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a46ac01-b57f-4b62-a51d-45ae772783b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:01.701365 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 973/1939] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 08:49:01 2022] POST /identity/v3/projects => generated 387 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:49:01.701889 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46ac01-b57f-4b62-a51d-45ae772783b9 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:01.702215 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46ac01-b57f-4b62-a51d-45ae772783b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:01.702505 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46ac01-b57f-4b62-a51d-45ae772783b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:01.703222 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a46ac01-b57f-4b62-a51d-45ae772783b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:01.705079 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a46ac01-b57f-4b62-a51d-45ae772783b9 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:01.705190 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b81690-0220-4d2f-90bb-3c717c6b9582 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:01.716780 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 967/1940] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:49:01.717607 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a46ac01-b57f-4b62-a51d-45ae772783b9 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:01.731505 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a46ac01-b57f-4b62-a51d-45ae772783b9 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:01.735772 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:01.777169 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b81690-0220-4d2f-90bb-3c717c6b9582 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:01.782945 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c071bb76-a3c3-4b92-bad8-8841f2a860f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:01.783622 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c071bb76-a3c3-4b92-bad8-8841f2a860f6 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:01.783909 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c071bb76-a3c3-4b92-bad8-8841f2a860f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:01.784184 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c071bb76-a3c3-4b92-bad8-8841f2a860f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:01.785484 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c071bb76-a3c3-4b92-bad8-8841f2a860f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:01.787149 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c071bb76-a3c3-4b92-bad8-8841f2a860f6 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:01.797605 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 974/1941] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:49:01.798452 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c071bb76-a3c3-4b92-bad8-8841f2a860f6 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:01.803676 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f45cd-e554-4a71-b2b8-0791eb17d75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:01.804088 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f45cd-e554-4a71-b2b8-0791eb17d75a admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:01.804376 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f45cd-e554-4a71-b2b8-0791eb17d75a admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:01.804654 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f45cd-e554-4a71-b2b8-0791eb17d75a admin admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:01.805801 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4f45cd-e554-4a71-b2b8-0791eb17d75a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:01.807621 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4f45cd-e554-4a71-b2b8-0791eb17d75a admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:01.808950 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c071bb76-a3c3-4b92-bad8-8841f2a860f6 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:01.818293 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2076b38c-92fd-45b3-b5cd-0cbfccc02a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:01.819034 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076b38c-92fd-45b3-b5cd-0cbfccc02a18 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:01.819377 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076b38c-92fd-45b3-b5cd-0cbfccc02a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:01.819601 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076b38c-92fd-45b3-b5cd-0cbfccc02a18 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:01.820323 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2076b38c-92fd-45b3-b5cd-0cbfccc02a18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:01.822288 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2076b38c-92fd-45b3-b5cd-0cbfccc02a18 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:01.839591 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 968/1942] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 08:49:01 2022] POST /identity/v3/projects => generated 373 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:49:01.840748 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f45cd-e554-4a71-b2b8-0791eb17d75a admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:01.850239 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 975/1943] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 08:49:01 2022] POST /identity/v3/users => generated 300 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:49:01.851519 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2076b38c-92fd-45b3-b5cd-0cbfccc02a18 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:01.865495 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2076b38c-92fd-45b3-b5cd-0cbfccc02a18 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:01.886327 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:01.915263 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f45cd-e554-4a71-b2b8-0791eb17d75a admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:01.920473 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffddb6ed-5417-48f6-b87c-5f7ac1cadf22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:01.921445 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffddb6ed-5417-48f6-b87c-5f7ac1cadf22 admin admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:01.921727 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffddb6ed-5417-48f6-b87c-5f7ac1cadf22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:01.922039 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffddb6ed-5417-48f6-b87c-5f7ac1cadf22 admin admin] PATH_INFO: `/v3/projects/c47f47bde951418f9622593a89b35b32/users/fe7f415438a54d83914e3e644ad20673/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:01.928715 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9073a6cc-a647-4336-8658-4cf5a6e82390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:01.929617 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073a6cc-a647-4336-8658-4cf5a6e82390 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:01.929907 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073a6cc-a647-4336-8658-4cf5a6e82390 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:01.930223 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073a6cc-a647-4336-8658-4cf5a6e82390 admin admin] PATH_INFO: `/v3/projects/26fc1c04000b4e7b9f98dfb066997cf2/users/90b7abecdde94c31bbd42e28d5ce1806/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:01.938543 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffddb6ed-5417-48f6-b87c-5f7ac1cadf22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c47f47bde951418f9622593a89b35b32, user_id=fe7f415438a54d83914e3e644ad20673, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:01.941831 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffddb6ed-5417-48f6-b87c-5f7ac1cadf22 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:01.947452 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9073a6cc-a647-4336-8658-4cf5a6e82390 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26fc1c04000b4e7b9f98dfb066997cf2, user_id=90b7abecdde94c31bbd42e28d5ce1806, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:01.950541 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9073a6cc-a647-4336-8658-4cf5a6e82390 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:01.957138 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 969/1944] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:49:01 2022] PUT /identity/v3/projects/c47f47bde951418f9622593a89b35b32/users/fe7f415438a54d83914e3e644ad20673/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:01.958421 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffddb6ed-5417-48f6-b87c-5f7ac1cadf22 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:01.966783 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 976/1945] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:49:01 2022] PUT /identity/v3/projects/26fc1c04000b4e7b9f98dfb066997cf2/users/90b7abecdde94c31bbd42e28d5ce1806/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:01.967757 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9073a6cc-a647-4336-8658-4cf5a6e82390 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:02.033955 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9073a6cc-a647-4336-8658-4cf5a6e82390 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:02.034156 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffddb6ed-5417-48f6-b87c-5f7ac1cadf22 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:02.038929 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e213ac87-cae0-4c74-955c-de7858810f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:02.039621 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213ac87-cae0-4c74-955c-de7858810f6e admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:02.039790 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc04ec-86b9-42c4-92fd-7cb017c49bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:02.039966 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213ac87-cae0-4c74-955c-de7858810f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:02.040246 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213ac87-cae0-4c74-955c-de7858810f6e admin admin] PATH_INFO: `/v3/users` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:02.040397 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc04ec-86b9-42c4-92fd-7cb017c49bee admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:02.040916 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc04ec-86b9-42c4-92fd-7cb017c49bee admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:02.040916 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc04ec-86b9-42c4-92fd-7cb017c49bee admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:02.041218 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e213ac87-cae0-4c74-955c-de7858810f6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:02.041746 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dc04ec-86b9-42c4-92fd-7cb017c49bee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:02.043191 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e213ac87-cae0-4c74-955c-de7858810f6e admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:02.043525 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dc04ec-86b9-42c4-92fd-7cb017c49bee admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:02.054786 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 977/1946] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:49:02.055681 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc04ec-86b9-42c4-92fd-7cb017c49bee admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:02.068759 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 970/1947] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 08:49:01 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:49:02.068942 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc04ec-86b9-42c4-92fd-7cb017c49bee admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:02.069042 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e213ac87-cae0-4c74-955c-de7858810f6e admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:02.073572 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b5c81f-8d38-468a-abf8-e309e03d9e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:02.074354 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5c81f-8d38-468a-abf8-e309e03d9e34 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:02.074595 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5c81f-8d38-468a-abf8-e309e03d9e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:02.074874 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5c81f-8d38-468a-abf8-e309e03d9e34 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:02.075788 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:02.075916 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b5c81f-8d38-468a-abf8-e309e03d9e34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:02.077273 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b5c81f-8d38-468a-abf8-e309e03d9e34 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:02.079972 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e213ac87-cae0-4c74-955c-de7858810f6e admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:02.087126 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cceb25f-fe6e-484f-8ad8-01a743395d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:02.087797 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cceb25f-fe6e-484f-8ad8-01a743395d76 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:02.088080 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cceb25f-fe6e-484f-8ad8-01a743395d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:02.088359 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cceb25f-fe6e-484f-8ad8-01a743395d76 admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:02.091587 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 978/1948] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:49:02.091728 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cceb25f-fe6e-484f-8ad8-01a743395d76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:02.091822 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b5c81f-8d38-468a-abf8-e309e03d9e34 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:02.091924 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cceb25f-fe6e-484f-8ad8-01a743395d76 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:02.099443 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b5c81f-8d38-468a-abf8-e309e03d9e34 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:02.101826 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 971/1949] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:49:02.102547 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cceb25f-fe6e-484f-8ad8-01a743395d76 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:02.107302 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0586cab7-577a-4556-92d3-2c7690956c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:02.108197 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586cab7-577a-4556-92d3-2c7690956c10 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:02.108481 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586cab7-577a-4556-92d3-2c7690956c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:02.108755 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586cab7-577a-4556-92d3-2c7690956c10 admin admin] PATH_INFO: `/v3/projects/cb76e959a0e14441a5d76668dacb1e4e/users/b23c4f9243cd49ea99c31d7db13e7525/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:02.112930 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cceb25f-fe6e-484f-8ad8-01a743395d76 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:02.117695 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6d6051-ab13-400b-b53b-0bd13a3551f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:02.118393 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d6051-ab13-400b-b53b-0bd13a3551f8 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:02.118850 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d6051-ab13-400b-b53b-0bd13a3551f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:02.119135 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d6051-ab13-400b-b53b-0bd13a3551f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:02.119866 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6d6051-ab13-400b-b53b-0bd13a3551f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:02.121481 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6d6051-ab13-400b-b53b-0bd13a3551f8 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:02.124144 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0586cab7-577a-4556-92d3-2c7690956c10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb76e959a0e14441a5d76668dacb1e4e, user_id=b23c4f9243cd49ea99c31d7db13e7525, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:02.126852 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0586cab7-577a-4556-92d3-2c7690956c10 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:02.133045 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 972/1950] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:49:02.134160 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6d6051-ab13-400b-b53b-0bd13a3551f8 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:02.142401 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 979/1951] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:49:02 2022] PUT /identity/v3/projects/cb76e959a0e14441a5d76668dacb1e4e/users/b23c4f9243cd49ea99c31d7db13e7525/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:02.143201 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0586cab7-577a-4556-92d3-2c7690956c10 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:02.148686 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6d6051-ab13-400b-b53b-0bd13a3551f8 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:02.215095 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0586cab7-577a-4556-92d3-2c7690956c10 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:02.219016 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeec2ae-a14b-48d8-8b25-2958164cde30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:02.219854 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c382df9-69bf-4e2d-b75d-d7d93f9a5945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:02.219983 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeec2ae-a14b-48d8-8b25-2958164cde30 admin admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:02.220199 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeec2ae-a14b-48d8-8b25-2958164cde30 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:02.220455 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeec2ae-a14b-48d8-8b25-2958164cde30 admin admin] PATH_INFO: `/v3/projects/c47f47bde951418f9622593a89b35b32/users/fe7f415438a54d83914e3e644ad20673/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:02.220732 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c382df9-69bf-4e2d-b75d-d7d93f9a5945 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:02.221015 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c382df9-69bf-4e2d-b75d-d7d93f9a5945 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:02.221289 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c382df9-69bf-4e2d-b75d-d7d93f9a5945 admin admin] PATH_INFO: `/v3/projects/26fc1c04000b4e7b9f98dfb066997cf2/users/90b7abecdde94c31bbd42e28d5ce1806/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:02.222612 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeec2ae-a14b-48d8-8b25-2958164cde30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c47f47bde951418f9622593a89b35b32, user_id=fe7f415438a54d83914e3e644ad20673, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:02.223334 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c382df9-69bf-4e2d-b75d-d7d93f9a5945 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26fc1c04000b4e7b9f98dfb066997cf2, user_id=90b7abecdde94c31bbd42e28d5ce1806, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:02.225181 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeec2ae-a14b-48d8-8b25-2958164cde30 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:02.225980 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c382df9-69bf-4e2d-b75d-d7d93f9a5945 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:02.231771 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:02.236284 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 973/1952] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:49:02 2022] PUT /identity/v3/projects/c47f47bde951418f9622593a89b35b32/users/fe7f415438a54d83914e3e644ad20673/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:02.237289 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeec2ae-a14b-48d8-8b25-2958164cde30 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:02.247903 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 980/1953] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:49:02 2022] PUT /identity/v3/projects/26fc1c04000b4e7b9f98dfb066997cf2/users/90b7abecdde94c31bbd42e28d5ce1806/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:02.247903 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c382df9-69bf-4e2d-b75d-d7d93f9a5945 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:02.314858 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c382df9-69bf-4e2d-b75d-d7d93f9a5945 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:02.318866 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeec2ae-a14b-48d8-8b25-2958164cde30 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:02.320491 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e80809-cb8d-432c-a8fa-a5ce573ef3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:02.321109 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e80809-cb8d-432c-a8fa-a5ce573ef3d1 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:02.321395 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e80809-cb8d-432c-a8fa-a5ce573ef3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:02.321672 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e80809-cb8d-432c-a8fa-a5ce573ef3d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:02.322452 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e80809-cb8d-432c-a8fa-a5ce573ef3d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:02.323865 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c7af3-6314-4b5a-abe0-0288e25ad3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:02.324208 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e80809-cb8d-432c-a8fa-a5ce573ef3d1 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:02.324990 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c7af3-6314-4b5a-abe0-0288e25ad3cf admin admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:02.325271 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c7af3-6314-4b5a-abe0-0288e25ad3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:02.325557 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c7af3-6314-4b5a-abe0-0288e25ad3cf admin admin] PATH_INFO: `/v3/projects/09ba306e5f754e42b2b7f83d2b23057f/users/b5e7bb7800004e8eb43d141fce7e0ef8/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:02.335150 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 981/1954] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:49:02.339766 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19490f70-b60b-40d7-8d98-80395472ab4d None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:02.340055 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19490f70-b60b-40d7-8d98-80395472ab4d None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:02.340331 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19490f70-b60b-40d7-8d98-80395472ab4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:02.341860 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c7af3-6314-4b5a-abe0-0288e25ad3cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=09ba306e5f754e42b2b7f83d2b23057f, user_id=b5e7bb7800004e8eb43d141fce7e0ef8, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:02.344565 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c7af3-6314-4b5a-abe0-0288e25ad3cf admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:02.360650 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 974/1955] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:49:02 2022] PUT /identity/v3/projects/09ba306e5f754e42b2b7f83d2b23057f/users/b5e7bb7800004e8eb43d141fce7e0ef8/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:02.362311 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0db2c1-d657-4320-b0a0-2a7d45f13a31 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:02.363380 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0db2c1-d657-4320-b0a0-2a7d45f13a31 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:02.363842 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0db2c1-d657-4320-b0a0-2a7d45f13a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:02.372542 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-19490f70-b60b-40d7-8d98-80395472ab4d None None] MFA Rules not processed for user `fe7f415438a54d83914e3e644ad20673`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:02.373785 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-19490f70-b60b-40d7-8d98-80395472ab4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:02.392271 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-2c0db2c1-d657-4320-b0a0-2a7d45f13a31 None None] MFA Rules not processed for user `90b7abecdde94c31bbd42e28d5ce1806`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:02.393499 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-2c0db2c1-d657-4320-b0a0-2a7d45f13a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:02.453227 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:02.469625 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 982/1956] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:02 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:02.471935 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19490f70-b60b-40d7-8d98-80395472ab4d None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:02.485152 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 975/1957] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:02 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:02.486670 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0db2c1-d657-4320-b0a0-2a7d45f13a31 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:02.546619 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19490f70-b60b-40d7-8d98-80395472ab4d None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:02.552601 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3237db-4761-41d4-975c-ce5b815eb9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:02.553515 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3237db-4761-41d4-975c-ce5b815eb9c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:02.553801 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3237db-4761-41d4-975c-ce5b815eb9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:02.554096 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3237db-4761-41d4-975c-ce5b815eb9c9 admin admin] PATH_INFO: `/v3/projects/cb76e959a0e14441a5d76668dacb1e4e/users/b23c4f9243cd49ea99c31d7db13e7525/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:02.556362 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3237db-4761-41d4-975c-ce5b815eb9c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb76e959a0e14441a5d76668dacb1e4e, user_id=b23c4f9243cd49ea99c31d7db13e7525, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:02.559275 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3237db-4761-41d4-975c-ce5b815eb9c9 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:02.563122 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0db2c1-d657-4320-b0a0-2a7d45f13a31 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:02.568794 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685bfa4e-b527-4be4-90c4-66ee99914bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:02.569484 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685bfa4e-b527-4be4-90c4-66ee99914bed admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:02.569771 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685bfa4e-b527-4be4-90c4-66ee99914bed admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:02.570049 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685bfa4e-b527-4be4-90c4-66ee99914bed admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:02.570874 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685bfa4e-b527-4be4-90c4-66ee99914bed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:02.572439 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685bfa4e-b527-4be4-90c4-66ee99914bed admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:02.581794 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 983/1958] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:49:02 2022] PUT /identity/v3/projects/cb76e959a0e14441a5d76668dacb1e4e/users/b23c4f9243cd49ea99c31d7db13e7525/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:02.581794 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3237db-4761-41d4-975c-ce5b815eb9c9 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:02.581794 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-fd3237db-4761-41d4-975c-ce5b815eb9c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:02.586261 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 976/1959] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:49:02.587499 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685bfa4e-b527-4be4-90c4-66ee99914bed admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:02.599989 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:02.656372 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3237db-4761-41d4-975c-ce5b815eb9c9 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:02.661019 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db51a2-aa8f-4a92-a51c-46190aa7ada4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:02.661699 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db51a2-aa8f-4a92-a51c-46190aa7ada4 service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:02.662099 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db51a2-aa8f-4a92-a51c-46190aa7ada4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:02.662400 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db51a2-aa8f-4a92-a51c-46190aa7ada4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:02.677954 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685bfa4e-b527-4be4-90c4-66ee99914bed admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:02.682228 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51715e9e-9848-4cd1-bfe5-afbaca84f695 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:02.682904 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51715e9e-9848-4cd1-bfe5-afbaca84f695 service cinder] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:02.683186 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51715e9e-9848-4cd1-bfe5-afbaca84f695 service cinder] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:02.683460 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51715e9e-9848-4cd1-bfe5-afbaca84f695 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:02.746487 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3db51a2-aa8f-4a92-a51c-46190aa7ada4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:02.748996 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3db51a2-aa8f-4a92-a51c-46190aa7ada4 service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:02.752610 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51715e9e-9848-4cd1-bfe5-afbaca84f695 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:02.754117 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51715e9e-9848-4cd1-bfe5-afbaca84f695 service cinder] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:02.765515 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 977/1960] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:49:02 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:49:02.766532 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 984/1961] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:49:02 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:49:02.767386 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2e4f9-2b68-4420-9f42-e77ca90e98b9 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:02.767839 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2e4f9-2b68-4420-9f42-e77ca90e98b9 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:02.767979 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db51a2-aa8f-4a92-a51c-46190aa7ada4 service cinder] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:02.768252 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2e4f9-2b68-4420-9f42-e77ca90e98b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:02.801950 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-f2a2e4f9-2b68-4420-9f42-e77ca90e98b9 None None] MFA Rules not processed for user `b23c4f9243cd49ea99c31d7db13e7525`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:02.804092 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-f2a2e4f9-2b68-4420-9f42-e77ca90e98b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:02.825474 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:02.840558 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db51a2-aa8f-4a92-a51c-46190aa7ada4 service cinder] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:02.846566 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909838fa-886b-41b4-adf8-0793c3e77f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:02.848027 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909838fa-886b-41b4-adf8-0793c3e77f2f admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:02.848457 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909838fa-886b-41b4-adf8-0793c3e77f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:02.848735 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909838fa-886b-41b4-adf8-0793c3e77f2f admin admin] PATH_INFO: `/v3/projects/09ba306e5f754e42b2b7f83d2b23057f/users/b5e7bb7800004e8eb43d141fce7e0ef8/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:02.851992 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909838fa-886b-41b4-adf8-0793c3e77f2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=09ba306e5f754e42b2b7f83d2b23057f, user_id=b5e7bb7800004e8eb43d141fce7e0ef8, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:02.855454 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909838fa-886b-41b4-adf8-0793c3e77f2f admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:02.870358 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 985/1962] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:49:02 2022] PUT /identity/v3/projects/09ba306e5f754e42b2b7f83d2b23057f/users/b5e7bb7800004e8eb43d141fce7e0ef8/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:02.878192 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48563574-fef0-4f73-96d6-fe9dbdcc843c None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:02.878560 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48563574-fef0-4f73-96d6-fe9dbdcc843c None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:02.879017 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48563574-fef0-4f73-96d6-fe9dbdcc843c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:02.911844 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 978/1963] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:02 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:02.913323 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2e4f9-2b68-4420-9f42-e77ca90e98b9 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:02.920273 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-48563574-fef0-4f73-96d6-fe9dbdcc843c None None] MFA Rules not processed for user `b5e7bb7800004e8eb43d141fce7e0ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:02.921584 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-48563574-fef0-4f73-96d6-fe9dbdcc843c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:02.929443 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2e4f9-2b68-4420-9f42-e77ca90e98b9 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:02.982526 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:02.990680 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b146fd0-0253-4157-a306-f7b100ac1a26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:02.991338 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b146fd0-0253-4157-a306-f7b100ac1a26 service cinder] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:02.991626 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b146fd0-0253-4157-a306-f7b100ac1a26 service cinder] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:02.992042 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b146fd0-0253-4157-a306-f7b100ac1a26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:03.018282 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 986/1964] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:02 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:03.020403 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48563574-fef0-4f73-96d6-fe9dbdcc843c None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:03.036182 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48563574-fef0-4f73-96d6-fe9dbdcc843c None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:03.041533 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7067180b-653c-4978-9482-92f00d1e19d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:03.042265 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067180b-653c-4978-9482-92f00d1e19d3 service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:03.042626 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067180b-653c-4978-9482-92f00d1e19d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:03.042926 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067180b-653c-4978-9482-92f00d1e19d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:03.081227 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b146fd0-0253-4157-a306-f7b100ac1a26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:03.083848 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b146fd0-0253-4157-a306-f7b100ac1a26 service cinder] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:03.093531 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 979/1965] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:49:02 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:49:03.133619 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7067180b-653c-4978-9482-92f00d1e19d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:03.135176 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7067180b-653c-4978-9482-92f00d1e19d3 service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:03.146701 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 987/1966] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:49:03 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:49:03.202903 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b146fd0-0253-4157-a306-f7b100ac1a26 service cinder] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:03.212368 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b146fd0-0253-4157-a306-f7b100ac1a26 service cinder] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:03.216557 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b770e6dd-b12f-452a-8305-f393950405b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:03.217310 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770e6dd-b12f-452a-8305-f393950405b3 service cinder] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:03.217684 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770e6dd-b12f-452a-8305-f393950405b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:03.218030 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770e6dd-b12f-452a-8305-f393950405b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:03.285621 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b770e6dd-b12f-452a-8305-f393950405b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:03.287104 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b770e6dd-b12f-452a-8305-f393950405b3 service cinder] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:03.297430 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 980/1967] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:49:03 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:49:03.434942 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7067180b-653c-4978-9482-92f00d1e19d3 service cinder] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:03.526357 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7067180b-653c-4978-9482-92f00d1e19d3 service cinder] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:03.532175 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d111fa-0114-427f-a027-059824063dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:03.533264 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d111fa-0114-427f-a027-059824063dda admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:03.533592 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d111fa-0114-427f-a027-059824063dda admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:03.533922 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d111fa-0114-427f-a027-059824063dda admin admin] PATH_INFO: `/v3/users/18baac3403f24f879cb6d9cd4d0cbad7` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:03.535398 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d111fa-0114-427f-a027-059824063dda admin admin] RBAC: Authorizing `identity:delete_user(user_id=18baac3403f24f879cb6d9cd4d0cbad7)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:03.537390 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d111fa-0114-427f-a027-059824063dda admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:03.602484 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c5d111fa-0114-427f-a027-059824063dda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18baac3403f24f879cb6d9cd4d0cbad7'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:03.621880 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c5d111fa-0114-427f-a027-059824063dda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18baac3403f24f879cb6d9cd4d0cbad7'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:03.622680 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c5d111fa-0114-427f-a027-059824063dda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18baac3403f24f879cb6d9cd4d0cbad7'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:03.640691 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c5d111fa-0114-427f-a027-059824063dda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18baac3403f24f879cb6d9cd4d0cbad7'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:03.641451 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c5d111fa-0114-427f-a027-059824063dda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18baac3403f24f879cb6d9cd4d0cbad7'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:03.665360 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 988/1968] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 08:49:03 2022] DELETE /identity/v3/users/18baac3403f24f879cb6d9cd4d0cbad7 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:03.665533 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:03.670001 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d29b98-bf37-42ce-ab26-ca0822afa23d None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:03.670445 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d29b98-bf37-42ce-ab26-ca0822afa23d None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:03.670966 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d29b98-bf37-42ce-ab26-ca0822afa23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:03.704475 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-a1d29b98-bf37-42ce-ab26-ca0822afa23d None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:03.707194 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-a1d29b98-bf37-42ce-ab26-ca0822afa23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:03.712804 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:03.843958 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 981/1969] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:03.856791 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d111fa-0114-427f-a027-059824063dda admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:03.858375 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-c5d111fa-0114-427f-a027-059824063dda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:03.934125 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d111fa-0114-427f-a027-059824063dda admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:03.937978 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e249068-d1dd-4272-ac0e-281c5cfe4cdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:03.938826 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e249068-d1dd-4272-ac0e-281c5cfe4cdb service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:03.939117 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e249068-d1dd-4272-ac0e-281c5cfe4cdb service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:03.939455 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e249068-d1dd-4272-ac0e-281c5cfe4cdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:03.957672 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e249068-d1dd-4272-ac0e-281c5cfe4cdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:03.959315 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e249068-d1dd-4272-ac0e-281c5cfe4cdb service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:03.973206 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 989/1970] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:49:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:49:03.974326 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d29b98-bf37-42ce-ab26-ca0822afa23d None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:03.975805 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-a1d29b98-bf37-42ce-ab26-ca0822afa23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:03.988699 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d29b98-bf37-42ce-ab26-ca0822afa23d None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:03.993753 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd76a3b-415a-4973-9586-63126a361d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:03.994865 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd76a3b-415a-4973-9586-63126a361d3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:03.995285 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd76a3b-415a-4973-9586-63126a361d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:03.995647 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd76a3b-415a-4973-9586-63126a361d3b admin admin] PATH_INFO: `/v3/users/26c13fc5da7544f0b160749c2fb38576` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:03.997080 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd76a3b-415a-4973-9586-63126a361d3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=26c13fc5da7544f0b160749c2fb38576)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:03.999196 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd76a3b-415a-4973-9586-63126a361d3b admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:04.065328 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-8dd76a3b-415a-4973-9586-63126a361d3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26c13fc5da7544f0b160749c2fb38576'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:04.073371 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-8dd76a3b-415a-4973-9586-63126a361d3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26c13fc5da7544f0b160749c2fb38576'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:04.074152 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-8dd76a3b-415a-4973-9586-63126a361d3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26c13fc5da7544f0b160749c2fb38576'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:04.082773 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-8dd76a3b-415a-4973-9586-63126a361d3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26c13fc5da7544f0b160749c2fb38576'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:04.083479 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-8dd76a3b-415a-4973-9586-63126a361d3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26c13fc5da7544f0b160749c2fb38576'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:04.113151 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 982/1971] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 08:49:03 2022] DELETE /identity/v3/users/26c13fc5da7544f0b160749c2fb38576 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:04.118383 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c710bc34-3535-4f5d-9ef2-39a5207556fa None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:04.118857 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c710bc34-3535-4f5d-9ef2-39a5207556fa None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:04.119256 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c710bc34-3535-4f5d-9ef2-39a5207556fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:04.164815 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-c710bc34-3535-4f5d-9ef2-39a5207556fa None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:04.167130 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-c710bc34-3535-4f5d-9ef2-39a5207556fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:04.270847 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 990/1972] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 08:49:04.286760 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd76a3b-415a-4973-9586-63126a361d3b admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:04.288324 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-8dd76a3b-415a-4973-9586-63126a361d3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:04.332615 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c710bc34-3535-4f5d-9ef2-39a5207556fa None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:04.334169 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-c710bc34-3535-4f5d-9ef2-39a5207556fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:04.350353 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c710bc34-3535-4f5d-9ef2-39a5207556fa None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:04.355919 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd76a3b-415a-4973-9586-63126a361d3b admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:04.356077 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f76000-5de5-4e9c-8b3a-72b10a2010f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:04.356985 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f76000-5de5-4e9c-8b3a-72b10a2010f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:04.357266 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f76000-5de5-4e9c-8b3a-72b10a2010f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:04.357541 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f76000-5de5-4e9c-8b3a-72b10a2010f6 admin admin] PATH_INFO: `/v3/projects/14bf34abe12949a1bc336a326e15f788` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:04.359069 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f76000-5de5-4e9c-8b3a-72b10a2010f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14bf34abe12949a1bc336a326e15f788)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:04.360474 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917ea78-d009-406c-8eb5-1f9bb1e4dc09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:04.361504 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917ea78-d009-406c-8eb5-1f9bb1e4dc09 service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:04.361594 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f76000-5de5-4e9c-8b3a-72b10a2010f6 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:04.361896 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917ea78-d009-406c-8eb5-1f9bb1e4dc09 service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:04.362409 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917ea78-d009-406c-8eb5-1f9bb1e4dc09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:04.373558 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2917ea78-d009-406c-8eb5-1f9bb1e4dc09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:04.375216 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2917ea78-d009-406c-8eb5-1f9bb1e4dc09 service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:04.387832 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 983/1973] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:49:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:49:04.430164 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-f3f76000-5de5-4e9c-8b3a-72b10a2010f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14bf34abe12949a1bc336a326e15f788', 'request_id': 'req-f3f76000-5de5-4e9c-8b3a-72b10a2010f6'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:04.437371 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-f3f76000-5de5-4e9c-8b3a-72b10a2010f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14bf34abe12949a1bc336a326e15f788', 'request_id': 'req-f3f76000-5de5-4e9c-8b3a-72b10a2010f6'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:04.445176 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-f3f76000-5de5-4e9c-8b3a-72b10a2010f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14bf34abe12949a1bc336a326e15f788', 'request_id': 'req-f3f76000-5de5-4e9c-8b3a-72b10a2010f6'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:04.461260 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-f3f76000-5de5-4e9c-8b3a-72b10a2010f6 admin admin] The token cache is being invalidate because project 14bf34abe12949a1bc336a326e15f788 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 08:49:04.461643 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-f3f76000-5de5-4e9c-8b3a-72b10a2010f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:04.462346 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-f3f76000-5de5-4e9c-8b3a-72b10a2010f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:04.463935 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 991/1974] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 08:49:04 2022] DELETE /identity/v3/projects/14bf34abe12949a1bc336a326e15f788 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 08:49:04.468721 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917ea78-d009-406c-8eb5-1f9bb1e4dc09 service neutron] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:04.480206 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917ea78-d009-406c-8eb5-1f9bb1e4dc09 service neutron] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:04.502551 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:04.550480 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae8b826-b843-401a-a0f9-cdd70eb4e890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:04.551422 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae8b826-b843-401a-a0f9-cdd70eb4e890 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:04.551710 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae8b826-b843-401a-a0f9-cdd70eb4e890 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:04.551988 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae8b826-b843-401a-a0f9-cdd70eb4e890 admin admin] PATH_INFO: `/v3/users/b23c4f9243cd49ea99c31d7db13e7525` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:04.553289 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae8b826-b843-401a-a0f9-cdd70eb4e890 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b23c4f9243cd49ea99c31d7db13e7525)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:04.555557 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae8b826-b843-401a-a0f9-cdd70eb4e890 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:04.609049 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-5ae8b826-b843-401a-a0f9-cdd70eb4e890 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b23c4f9243cd49ea99c31d7db13e7525'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:04.617149 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-5ae8b826-b843-401a-a0f9-cdd70eb4e890 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b23c4f9243cd49ea99c31d7db13e7525'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:04.618338 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-5ae8b826-b843-401a-a0f9-cdd70eb4e890 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b23c4f9243cd49ea99c31d7db13e7525'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:04.632847 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-5ae8b826-b843-401a-a0f9-cdd70eb4e890 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b23c4f9243cd49ea99c31d7db13e7525'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:04.636076 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-5ae8b826-b843-401a-a0f9-cdd70eb4e890 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b23c4f9243cd49ea99c31d7db13e7525'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:04.689460 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 984/1975] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 08:49:04 2022] DELETE /identity/v3/users/b23c4f9243cd49ea99c31d7db13e7525 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:04.704473 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f76000-5de5-4e9c-8b3a-72b10a2010f6 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:04.706117 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-f3f76000-5de5-4e9c-8b3a-72b10a2010f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:04.727079 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f76000-5de5-4e9c-8b3a-72b10a2010f6 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:04.770583 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:04.872655 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f2d29-01c4-44d1-b91d-e3a666663964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:04.873545 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f2d29-01c4-44d1-b91d-e3a666663964 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:04.873824 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f2d29-01c4-44d1-b91d-e3a666663964 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:04.874116 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f2d29-01c4-44d1-b91d-e3a666663964 admin admin] PATH_INFO: `/v3/projects/e2999f7575e04059b4ae46cfc9f778b8` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:04.876362 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782f2d29-01c4-44d1-b91d-e3a666663964 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2999f7575e04059b4ae46cfc9f778b8)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:04.883289 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782f2d29-01c4-44d1-b91d-e3a666663964 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:05.071492 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-782f2d29-01c4-44d1-b91d-e3a666663964 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2999f7575e04059b4ae46cfc9f778b8', 'request_id': 'req-782f2d29-01c4-44d1-b91d-e3a666663964'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:05.080891 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-782f2d29-01c4-44d1-b91d-e3a666663964 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2999f7575e04059b4ae46cfc9f778b8', 'request_id': 'req-782f2d29-01c4-44d1-b91d-e3a666663964'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:05.099697 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-782f2d29-01c4-44d1-b91d-e3a666663964 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2999f7575e04059b4ae46cfc9f778b8', 'request_id': 'req-782f2d29-01c4-44d1-b91d-e3a666663964'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:05.127829 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-782f2d29-01c4-44d1-b91d-e3a666663964 admin admin] The token cache is being invalidate because project e2999f7575e04059b4ae46cfc9f778b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 08:49:05.128726 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-782f2d29-01c4-44d1-b91d-e3a666663964 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:05.130228 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-782f2d29-01c4-44d1-b91d-e3a666663964 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:05.137079 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 992/1976] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 08:49:04 2022] DELETE /identity/v3/projects/e2999f7575e04059b4ae46cfc9f778b8 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:05.137709 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae8b826-b843-401a-a0f9-cdd70eb4e890 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:05.139346 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-5ae8b826-b843-401a-a0f9-cdd70eb4e890 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:05.163900 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae8b826-b843-401a-a0f9-cdd70eb4e890 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:05.286963 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504afdf5-d8f4-4365-8818-043f5ae25d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:05.287879 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504afdf5-d8f4-4365-8818-043f5ae25d4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:05.288210 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504afdf5-d8f4-4365-8818-043f5ae25d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:05.289099 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504afdf5-d8f4-4365-8818-043f5ae25d4f admin admin] PATH_INFO: `/v3/users/90b7abecdde94c31bbd42e28d5ce1806` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:05.289757 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504afdf5-d8f4-4365-8818-043f5ae25d4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=90b7abecdde94c31bbd42e28d5ce1806)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:05.292229 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504afdf5-d8f4-4365-8818-043f5ae25d4f admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:05.380622 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:05.382648 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-504afdf5-d8f4-4365-8818-043f5ae25d4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90b7abecdde94c31bbd42e28d5ce1806'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:05.403845 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-504afdf5-d8f4-4365-8818-043f5ae25d4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90b7abecdde94c31bbd42e28d5ce1806'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:05.404832 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-504afdf5-d8f4-4365-8818-043f5ae25d4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90b7abecdde94c31bbd42e28d5ce1806'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:05.417218 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-504afdf5-d8f4-4365-8818-043f5ae25d4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90b7abecdde94c31bbd42e28d5ce1806'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:05.418283 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-504afdf5-d8f4-4365-8818-043f5ae25d4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90b7abecdde94c31bbd42e28d5ce1806'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:05.449605 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 985/1977] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 08:49:05 2022] DELETE /identity/v3/users/90b7abecdde94c31bbd42e28d5ce1806 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 08:49:05.782633 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f2d29-01c4-44d1-b91d-e3a666663964 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:05.785303 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-782f2d29-01c4-44d1-b91d-e3a666663964 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:05.805046 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f2d29-01c4-44d1-b91d-e3a666663964 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:05.957639 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e50e7de-be3a-4d67-9608-8a94450e6b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:05.959815 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50e7de-be3a-4d67-9608-8a94450e6b38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:05.962323 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50e7de-be3a-4d67-9608-8a94450e6b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:05.962798 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50e7de-be3a-4d67-9608-8a94450e6b38 admin admin] PATH_INFO: `/v3/projects/cb76e959a0e14441a5d76668dacb1e4e` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:05.965492 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e50e7de-be3a-4d67-9608-8a94450e6b38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb76e959a0e14441a5d76668dacb1e4e)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:05.970034 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e50e7de-be3a-4d67-9608-8a94450e6b38 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:06.015884 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504afdf5-d8f4-4365-8818-043f5ae25d4f admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:06.018449 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-504afdf5-d8f4-4365-8818-043f5ae25d4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:06.042016 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504afdf5-d8f4-4365-8818-043f5ae25d4f admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:06.052156 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34c2b1-c673-4696-a3cf-378ec88c488d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:06.054683 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34c2b1-c673-4696-a3cf-378ec88c488d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:06.055368 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34c2b1-c673-4696-a3cf-378ec88c488d admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:06.056086 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34c2b1-c673-4696-a3cf-378ec88c488d admin admin] PATH_INFO: `/v3/projects/26fc1c04000b4e7b9f98dfb066997cf2` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:06.059491 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf34c2b1-c673-4696-a3cf-378ec88c488d admin admin] RBAC: Authorizing `identity:delete_project(project_id=26fc1c04000b4e7b9f98dfb066997cf2)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:06.064657 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf34c2b1-c673-4696-a3cf-378ec88c488d admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:06.117679 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-4e50e7de-be3a-4d67-9608-8a94450e6b38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb76e959a0e14441a5d76668dacb1e4e', 'request_id': 'req-4e50e7de-be3a-4d67-9608-8a94450e6b38'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:06.144274 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:06.155539 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-4e50e7de-be3a-4d67-9608-8a94450e6b38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb76e959a0e14441a5d76668dacb1e4e', 'request_id': 'req-4e50e7de-be3a-4d67-9608-8a94450e6b38'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:06.206779 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-cf34c2b1-c673-4696-a3cf-378ec88c488d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26fc1c04000b4e7b9f98dfb066997cf2', 'request_id': 'req-cf34c2b1-c673-4696-a3cf-378ec88c488d'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:06.211554 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-4e50e7de-be3a-4d67-9608-8a94450e6b38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb76e959a0e14441a5d76668dacb1e4e', 'request_id': 'req-4e50e7de-be3a-4d67-9608-8a94450e6b38'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:06.232951 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-cf34c2b1-c673-4696-a3cf-378ec88c488d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26fc1c04000b4e7b9f98dfb066997cf2', 'request_id': 'req-cf34c2b1-c673-4696-a3cf-378ec88c488d'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:06.245306 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-4e50e7de-be3a-4d67-9608-8a94450e6b38 admin admin] The token cache is being invalidate because project cb76e959a0e14441a5d76668dacb1e4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 08:49:06.257784 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-4e50e7de-be3a-4d67-9608-8a94450e6b38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:06.258897 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-cf34c2b1-c673-4696-a3cf-378ec88c488d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26fc1c04000b4e7b9f98dfb066997cf2', 'request_id': 'req-cf34c2b1-c673-4696-a3cf-378ec88c488d'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:06.264110 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-4e50e7de-be3a-4d67-9608-8a94450e6b38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:06.284011 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 993/1978] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 08:49:05 2022] DELETE /identity/v3/projects/cb76e959a0e14441a5d76668dacb1e4e => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:06.286544 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7193a77-a5f1-4fa6-a07e-de3fd44c2c5c None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:06.287098 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7193a77-a5f1-4fa6-a07e-de3fd44c2c5c None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:06.287769 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7193a77-a5f1-4fa6-a07e-de3fd44c2c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:06.307779 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-cf34c2b1-c673-4696-a3cf-378ec88c488d admin admin] The token cache is being invalidate because project 26fc1c04000b4e7b9f98dfb066997cf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 08:49:06.308429 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-cf34c2b1-c673-4696-a3cf-378ec88c488d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:06.310598 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-cf34c2b1-c673-4696-a3cf-378ec88c488d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:06.319894 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 986/1979] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 08:49:06 2022] DELETE /identity/v3/projects/26fc1c04000b4e7b9f98dfb066997cf2 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 08:49:06.327489 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-d7193a77-a5f1-4fa6-a07e-de3fd44c2c5c None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:06.329414 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-d7193a77-a5f1-4fa6-a07e-de3fd44c2c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:06.329903 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299bd98c-733c-477e-bd0b-298d24e577b8 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:06.332945 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299bd98c-733c-477e-bd0b-298d24e577b8 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:06.333557 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299bd98c-733c-477e-bd0b-298d24e577b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:06.384338 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-299bd98c-733c-477e-bd0b-298d24e577b8 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:06.387243 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-299bd98c-733c-477e-bd0b-298d24e577b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:06.556983 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 994/1980] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:06.558008 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7193a77-a5f1-4fa6-a07e-de3fd44c2c5c None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:06.562116 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-d7193a77-a5f1-4fa6-a07e-de3fd44c2c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:06.598947 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7193a77-a5f1-4fa6-a07e-de3fd44c2c5c None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:06.613658 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15a7f97-2732-4658-be03-c9acdfd87cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:06.614583 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a7f97-2732-4658-be03-c9acdfd87cf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:06.614866 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a7f97-2732-4658-be03-c9acdfd87cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:06.615210 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a7f97-2732-4658-be03-c9acdfd87cf4 admin admin] PATH_INFO: `/v3/users/7efbfe8a2a074bd9b7011c9be11ee302` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:06.618300 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15a7f97-2732-4658-be03-c9acdfd87cf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7efbfe8a2a074bd9b7011c9be11ee302)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:06.620736 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15a7f97-2732-4658-be03-c9acdfd87cf4 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:06.680376 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 987/1981] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:06.683589 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b5d94-fc63-49ea-919f-c7d3fab3c7eb None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:06.684286 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b5d94-fc63-49ea-919f-c7d3fab3c7eb None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:06.685797 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b5d94-fc63-49ea-919f-c7d3fab3c7eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:06.744390 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-656b5d94-fc63-49ea-919f-c7d3fab3c7eb None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:06.744982 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-a15a7f97-2732-4658-be03-c9acdfd87cf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7efbfe8a2a074bd9b7011c9be11ee302'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:06.747009 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-656b5d94-fc63-49ea-919f-c7d3fab3c7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:06.758889 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-a15a7f97-2732-4658-be03-c9acdfd87cf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7efbfe8a2a074bd9b7011c9be11ee302'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:06.760233 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-a15a7f97-2732-4658-be03-c9acdfd87cf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7efbfe8a2a074bd9b7011c9be11ee302'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:06.778611 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-a15a7f97-2732-4658-be03-c9acdfd87cf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7efbfe8a2a074bd9b7011c9be11ee302'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:06.780493 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-a15a7f97-2732-4658-be03-c9acdfd87cf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7efbfe8a2a074bd9b7011c9be11ee302'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:06.795603 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 988/1982] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:06.797867 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369b4f2-a64a-40d3-b2aa-48d059f6e415 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:06.798395 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369b4f2-a64a-40d3-b2aa-48d059f6e415 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:06.798866 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369b4f2-a64a-40d3-b2aa-48d059f6e415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:06.835641 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 995/1983] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 08:49:06 2022] DELETE /identity/v3/users/7efbfe8a2a074bd9b7011c9be11ee302 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:06.836795 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15a7f97-2732-4658-be03-c9acdfd87cf4 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:06.839182 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-3369b4f2-a64a-40d3-b2aa-48d059f6e415 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:06.841749 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-3369b4f2-a64a-40d3-b2aa-48d059f6e415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:06.959123 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:06.974028 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:06.982251 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15a7f97-2732-4658-be03-c9acdfd87cf4 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:07.000680 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3d1f80-8e4b-42c1-8635-593b4d84910e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:07.001233 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d1f80-8e4b-42c1-8635-593b4d84910e admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:07.002111 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d1f80-8e4b-42c1-8635-593b4d84910e admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:07.006878 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d1f80-8e4b-42c1-8635-593b4d84910e admin admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:07.008434 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3d1f80-8e4b-42c1-8635-593b4d84910e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:07.011104 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3d1f80-8e4b-42c1-8635-593b4d84910e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:07.032583 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3d1f80-8e4b-42c1-8635-593b4d84910e admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:07.076232 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 989/1984] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:07.079986 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a20653-a588-4b07-bc39-b26d09a96f7c None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:07.080456 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a20653-a588-4b07-bc39-b26d09a96f7c None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:07.082796 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a20653-a588-4b07-bc39-b26d09a96f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:07.084771 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 996/1985] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Jun 22 08:49:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:07.088760 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3d1f80-8e4b-42c1-8635-593b4d84910e admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:07.135106 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-c4a20653-a588-4b07-bc39-b26d09a96f7c None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:07.137664 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-c4a20653-a588-4b07-bc39-b26d09a96f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:07.140199 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3d1f80-8e4b-42c1-8635-593b4d84910e admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:07.156000 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 990/1986] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:07.156671 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a20653-a588-4b07-bc39-b26d09a96f7c None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:07.167528 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0793236-5636-4cee-beb6-a47147d56b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:07.172442 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0793236-5636-4cee-beb6-a47147d56b8e admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:07.172442 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0793236-5636-4cee-beb6-a47147d56b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:07.172442 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0793236-5636-4cee-beb6-a47147d56b8e admin admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:07.180590 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0793236-5636-4cee-beb6-a47147d56b8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:07.180590 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0793236-5636-4cee-beb6-a47147d56b8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:07.184326 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0793236-5636-4cee-beb6-a47147d56b8e admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:07.194733 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a20653-a588-4b07-bc39-b26d09a96f7c None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:07.215001 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a16caa-651b-4ca3-8c0b-cf456482aae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:07.215710 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a16caa-651b-4ca3-8c0b-cf456482aae7 admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:07.215943 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a16caa-651b-4ca3-8c0b-cf456482aae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:07.216342 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a16caa-651b-4ca3-8c0b-cf456482aae7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:07.217170 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a16caa-651b-4ca3-8c0b-cf456482aae7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:07.219132 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a16caa-651b-4ca3-8c0b-cf456482aae7 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:07.235603 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 997/1987] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Jun 22 08:49:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:07.235603 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0793236-5636-4cee-beb6-a47147d56b8e admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:07.238086 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-f0793236-5636-4cee-beb6-a47147d56b8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:07.284014 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 991/1988] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 08:49:07 2022] POST /identity/v3/projects => generated 387 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:49:07.285080 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a16caa-651b-4ca3-8c0b-cf456482aae7 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:07.321310 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0793236-5636-4cee-beb6-a47147d56b8e admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:07.386381 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a16caa-651b-4ca3-8c0b-cf456482aae7 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:07.391919 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf3795-f02d-4871-98ca-562565e558c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:07.393158 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf3795-f02d-4871-98ca-562565e558c2 admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:07.393291 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf3795-f02d-4871-98ca-562565e558c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:07.394352 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf3795-f02d-4871-98ca-562565e558c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:07.394831 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bf3795-f02d-4871-98ca-562565e558c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:07.397064 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bf3795-f02d-4871-98ca-562565e558c2 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:07.415653 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26f9215-cdbf-4f10-827b-6ee74eaff83e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:07.416819 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f9215-cdbf-4f10-827b-6ee74eaff83e service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:07.417314 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f9215-cdbf-4f10-827b-6ee74eaff83e service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:07.418976 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f9215-cdbf-4f10-827b-6ee74eaff83e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:07.433724 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26f9215-cdbf-4f10-827b-6ee74eaff83e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:07.435493 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26f9215-cdbf-4f10-827b-6ee74eaff83e service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:07.456702 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 998/1989] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:49:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:49:07.458675 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26f9215-cdbf-4f10-827b-6ee74eaff83e service neutron] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:07.459271 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 992/1990] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 08:49:07 2022] POST /identity/v3/projects => generated 363 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:49:07.463372 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf3795-f02d-4871-98ca-562565e558c2 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:07.473582 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26f9215-cdbf-4f10-827b-6ee74eaff83e service neutron] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:07.577598 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b3303-1ee0-4dca-ada5-03ad099d5125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:07.578315 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b3303-1ee0-4dca-ada5-03ad099d5125 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:07.578604 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b3303-1ee0-4dca-ada5-03ad099d5125 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:07.579513 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b3303-1ee0-4dca-ada5-03ad099d5125 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:07.580112 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782b3303-1ee0-4dca-ada5-03ad099d5125 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:07.581102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf3795-f02d-4871-98ca-562565e558c2 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:07.584129 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782b3303-1ee0-4dca-ada5-03ad099d5125 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:07.596441 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ccc21c-8b4b-44dc-a653-cf29e3b77d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:07.597640 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ccc21c-8b4b-44dc-a653-cf29e3b77d47 admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:07.597640 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ccc21c-8b4b-44dc-a653-cf29e3b77d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:07.597889 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ccc21c-8b4b-44dc-a653-cf29e3b77d47 admin admin] PATH_INFO: `/v3/users` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:07.598507 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ccc21c-8b4b-44dc-a653-cf29e3b77d47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:07.600466 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ccc21c-8b4b-44dc-a653-cf29e3b77d47 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:07.627249 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 999/1991] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 08:49:07 2022] POST /identity/v3/users => generated 294 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:49:07.629845 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b3303-1ee0-4dca-ada5-03ad099d5125 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:07.645295 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b3303-1ee0-4dca-ada5-03ad099d5125 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:07.649951 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 993/1992] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 08:49:07 2022] POST /identity/v3/users => generated 282 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 08:49:07.650920 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ccc21c-8b4b-44dc-a653-cf29e3b77d47 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:07.653138 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cdecea-14dc-498a-9b51-35b792eab82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:07.654130 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cdecea-14dc-498a-9b51-35b792eab82a admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:07.654635 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cdecea-14dc-498a-9b51-35b792eab82a admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:07.655154 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cdecea-14dc-498a-9b51-35b792eab82a admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:07.656257 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cdecea-14dc-498a-9b51-35b792eab82a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:07.658940 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cdecea-14dc-498a-9b51-35b792eab82a admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:07.679127 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ccc21c-8b4b-44dc-a653-cf29e3b77d47 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:07.684335 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f89110-dac4-469f-8496-03d00a0604cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:07.685025 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f89110-dac4-469f-8496-03d00a0604cf admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:07.685309 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f89110-dac4-469f-8496-03d00a0604cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:07.685586 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f89110-dac4-469f-8496-03d00a0604cf admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:07.686367 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f89110-dac4-469f-8496-03d00a0604cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:07.687978 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f89110-dac4-469f-8496-03d00a0604cf admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:07.703118 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1000/1993] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:49:07 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:49:07.705035 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cdecea-14dc-498a-9b51-35b792eab82a admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:07.710434 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 994/1994] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:49:07 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:49:07.714699 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f89110-dac4-469f-8496-03d00a0604cf admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:07.734464 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f89110-dac4-469f-8496-03d00a0604cf admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:07.744329 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cdecea-14dc-498a-9b51-35b792eab82a admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:07.750052 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a343e377-c4cf-41d3-b94d-e20cb7359702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:07.750765 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a343e377-c4cf-41d3-b94d-e20cb7359702 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:07.751052 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a343e377-c4cf-41d3-b94d-e20cb7359702 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:07.751336 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a343e377-c4cf-41d3-b94d-e20cb7359702 admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:07.752076 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a343e377-c4cf-41d3-b94d-e20cb7359702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:07.754317 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a343e377-c4cf-41d3-b94d-e20cb7359702 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:07.754683 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af334336-45cd-4c24-b5c1-e8891fbf598b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:07.755702 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af334336-45cd-4c24-b5c1-e8891fbf598b admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:07.756624 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af334336-45cd-4c24-b5c1-e8891fbf598b admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:07.757123 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af334336-45cd-4c24-b5c1-e8891fbf598b admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:07.758264 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af334336-45cd-4c24-b5c1-e8891fbf598b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:07.761145 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af334336-45cd-4c24-b5c1-e8891fbf598b admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:07.773472 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 995/1995] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:49:07 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:49:07.779682 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a343e377-c4cf-41d3-b94d-e20cb7359702 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:07.780032 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1001/1996] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:49:07 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:49:07.781113 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af334336-45cd-4c24-b5c1-e8891fbf598b admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:07.787079 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:07.792109 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:07.793804 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af334336-45cd-4c24-b5c1-e8891fbf598b admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:07.800304 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a343e377-c4cf-41d3-b94d-e20cb7359702 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:07.807932 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1346ddd-41dc-4194-bfd4-561ba6b20977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:07.810488 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1346ddd-41dc-4194-bfd4-561ba6b20977 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:07.810788 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1346ddd-41dc-4194-bfd4-561ba6b20977 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:07.811076 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1346ddd-41dc-4194-bfd4-561ba6b20977 admin admin] PATH_INFO: `/v3/projects/3ef3bc2a56584745ab4cc785c251d6e4/users/bb87d3616cb144fea9eced0c2fd8006e/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:07.813642 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e68baa-5bce-4c55-a18b-ca992c4e5bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:07.815119 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e68baa-5bce-4c55-a18b-ca992c4e5bc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:07.815473 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e68baa-5bce-4c55-a18b-ca992c4e5bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:07.816268 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e68baa-5bce-4c55-a18b-ca992c4e5bc6 admin admin] PATH_INFO: `/v3/projects/8bedf9566d714747b50b9e97e9b30053/users/47997c35c3ca4dde90c75e7d2136af50/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:07.835485 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1346ddd-41dc-4194-bfd4-561ba6b20977 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ef3bc2a56584745ab4cc785c251d6e4, user_id=bb87d3616cb144fea9eced0c2fd8006e, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:07.838347 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1346ddd-41dc-4194-bfd4-561ba6b20977 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:07.847389 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e68baa-5bce-4c55-a18b-ca992c4e5bc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bedf9566d714747b50b9e97e9b30053, user_id=47997c35c3ca4dde90c75e7d2136af50, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:07.850102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e68baa-5bce-4c55-a18b-ca992c4e5bc6 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:07.859431 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1002/1997] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:49:07 2022] PUT /identity/v3/projects/3ef3bc2a56584745ab4cc785c251d6e4/users/bb87d3616cb144fea9eced0c2fd8006e/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:07.866948 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 996/1998] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:49:07 2022] PUT /identity/v3/projects/8bedf9566d714747b50b9e97e9b30053/users/47997c35c3ca4dde90c75e7d2136af50/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:07.871329 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af04e0-1758-479a-9699-ad3c58a62750 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:07.871631 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af04e0-1758-479a-9699-ad3c58a62750 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:07.871938 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af04e0-1758-479a-9699-ad3c58a62750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:07.880506 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b28ea-a9e4-4b20-a31f-4940cbb93850 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:07.880794 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b28ea-a9e4-4b20-a31f-4940cbb93850 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:07.881075 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b28ea-a9e4-4b20-a31f-4940cbb93850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:07.913349 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-50af04e0-1758-479a-9699-ad3c58a62750 None None] MFA Rules not processed for user `bb87d3616cb144fea9eced0c2fd8006e`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:07.914801 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-a26b28ea-a9e4-4b20-a31f-4940cbb93850 None None] MFA Rules not processed for user `47997c35c3ca4dde90c75e7d2136af50`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:07.914969 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-50af04e0-1758-479a-9699-ad3c58a62750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:07.915984 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-a26b28ea-a9e4-4b20-a31f-4940cbb93850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:08.008891 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 997/1999] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:07 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:08.009819 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b28ea-a9e4-4b20-a31f-4940cbb93850 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:08.013595 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-a26b28ea-a9e4-4b20-a31f-4940cbb93850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:08.038780 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1003/2000] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:08.039598 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50af04e0-1758-479a-9699-ad3c58a62750 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:08.089876 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b28ea-a9e4-4b20-a31f-4940cbb93850 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:08.095580 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0383cbce-0263-4f44-837c-6777cd73762b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:08.096565 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383cbce-0263-4f44-837c-6777cd73762b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:08.097394 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383cbce-0263-4f44-837c-6777cd73762b admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:08.097675 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383cbce-0263-4f44-837c-6777cd73762b admin admin] PATH_INFO: `/v3/projects/ba5945c9ae9343ad8d17d5af71c23239` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:08.098915 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0383cbce-0263-4f44-837c-6777cd73762b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba5945c9ae9343ad8d17d5af71c23239)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:08.100915 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0383cbce-0263-4f44-837c-6777cd73762b admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:08.114487 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50af04e0-1758-479a-9699-ad3c58a62750 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:08.119289 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82643b08-d109-4971-85ea-4b02aa723d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:08.119952 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82643b08-d109-4971-85ea-4b02aa723d78 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:08.120239 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82643b08-d109-4971-85ea-4b02aa723d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:08.120518 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82643b08-d109-4971-85ea-4b02aa723d78 admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:08.121221 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82643b08-d109-4971-85ea-4b02aa723d78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:08.123174 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82643b08-d109-4971-85ea-4b02aa723d78 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:08.154618 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-0383cbce-0263-4f44-837c-6777cd73762b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba5945c9ae9343ad8d17d5af71c23239', 'request_id': 'req-0383cbce-0263-4f44-837c-6777cd73762b'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:08.158110 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1004/2001] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 08:49:08 2022] POST /identity/v3/projects => generated 365 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:49:08.159086 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82643b08-d109-4971-85ea-4b02aa723d78 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:08.171616 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-0383cbce-0263-4f44-837c-6777cd73762b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba5945c9ae9343ad8d17d5af71c23239', 'request_id': 'req-0383cbce-0263-4f44-837c-6777cd73762b'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:08.179191 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-0383cbce-0263-4f44-837c-6777cd73762b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba5945c9ae9343ad8d17d5af71c23239', 'request_id': 'req-0383cbce-0263-4f44-837c-6777cd73762b'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:08.190344 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:08.196564 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-0383cbce-0263-4f44-837c-6777cd73762b admin admin] The token cache is being invalidate because project ba5945c9ae9343ad8d17d5af71c23239 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 08:49:08.196897 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-0383cbce-0263-4f44-837c-6777cd73762b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:08.198151 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-0383cbce-0263-4f44-837c-6777cd73762b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:08.205860 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 998/2002] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 08:49:08 2022] DELETE /identity/v3/projects/ba5945c9ae9343ad8d17d5af71c23239 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:08.207668 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0383cbce-0263-4f44-837c-6777cd73762b admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:08.209193 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-0383cbce-0263-4f44-837c-6777cd73762b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:08.233887 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:08.267997 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82643b08-d109-4971-85ea-4b02aa723d78 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:08.273787 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813ff76d-cc9c-47e7-ae7b-f19d88ae33db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:08.274645 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ff76d-cc9c-47e7-ae7b-f19d88ae33db admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:08.276018 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ff76d-cc9c-47e7-ae7b-f19d88ae33db admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:08.276319 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ff76d-cc9c-47e7-ae7b-f19d88ae33db admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:08.277154 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813ff76d-cc9c-47e7-ae7b-f19d88ae33db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:08.279118 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813ff76d-cc9c-47e7-ae7b-f19d88ae33db admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:08.301051 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0383cbce-0263-4f44-837c-6777cd73762b admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:08.306135 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ec180-d6ef-4342-b880-a5cc8182e626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:08.306952 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ec180-d6ef-4342-b880-a5cc8182e626 admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:08.307312 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ec180-d6ef-4342-b880-a5cc8182e626 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:08.307657 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ec180-d6ef-4342-b880-a5cc8182e626 admin admin] PATH_INFO: `/v3/users` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:08.308425 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ec180-d6ef-4342-b880-a5cc8182e626 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:08.310353 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1005/2003] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 08:49:08 2022] POST /identity/v3/projects => generated 387 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:49:08.310481 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ec180-d6ef-4342-b880-a5cc8182e626 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:08.311474 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813ff76d-cc9c-47e7-ae7b-f19d88ae33db admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:08.315166 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-813ff76d-cc9c-47e7-ae7b-f19d88ae33db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:08.332479 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 999/2004] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 08:49:08 2022] POST /identity/v3/users => generated 289 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:49:08.333319 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ec180-d6ef-4342-b880-a5cc8182e626 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:08.335256 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-b44ec180-d6ef-4342-b880-a5cc8182e626 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:08.347941 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ec180-d6ef-4342-b880-a5cc8182e626 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:08.393245 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813ff76d-cc9c-47e7-ae7b-f19d88ae33db admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:08.399338 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9d2c10-7c45-43c4-8892-359311d2c091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:08.400998 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d2c10-7c45-43c4-8892-359311d2c091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:08.401287 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d2c10-7c45-43c4-8892-359311d2c091 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:08.401564 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d2c10-7c45-43c4-8892-359311d2c091 admin admin] PATH_INFO: `/v3/users/b5e7bb7800004e8eb43d141fce7e0ef8` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:08.402837 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9d2c10-7c45-43c4-8892-359311d2c091 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5e7bb7800004e8eb43d141fce7e0ef8)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:08.404763 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9d2c10-7c45-43c4-8892-359311d2c091 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:08.426105 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c93a38e-e637-4650-bc87-5aa8abc2e6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:08.427278 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93a38e-e637-4650-bc87-5aa8abc2e6a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:08.427416 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93a38e-e637-4650-bc87-5aa8abc2e6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:08.427722 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93a38e-e637-4650-bc87-5aa8abc2e6a7 admin admin] PATH_INFO: `/v3/users/4761507897fb4d95a47426c5fd41672c` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:08.429095 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c93a38e-e637-4650-bc87-5aa8abc2e6a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4761507897fb4d95a47426c5fd41672c)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:08.431203 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c93a38e-e637-4650-bc87-5aa8abc2e6a7 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:08.481067 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-5f9d2c10-7c45-43c4-8892-359311d2c091 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5e7bb7800004e8eb43d141fce7e0ef8'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:08.488933 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-5f9d2c10-7c45-43c4-8892-359311d2c091 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5e7bb7800004e8eb43d141fce7e0ef8'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:08.489972 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-5f9d2c10-7c45-43c4-8892-359311d2c091 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5e7bb7800004e8eb43d141fce7e0ef8'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:08.499541 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-9c93a38e-e637-4650-bc87-5aa8abc2e6a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4761507897fb4d95a47426c5fd41672c'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:08.499946 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-5f9d2c10-7c45-43c4-8892-359311d2c091 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5e7bb7800004e8eb43d141fce7e0ef8'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:08.500776 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-5f9d2c10-7c45-43c4-8892-359311d2c091 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5e7bb7800004e8eb43d141fce7e0ef8'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:08.508622 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-9c93a38e-e637-4650-bc87-5aa8abc2e6a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4761507897fb4d95a47426c5fd41672c'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:08.509638 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-9c93a38e-e637-4650-bc87-5aa8abc2e6a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4761507897fb4d95a47426c5fd41672c'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:08.520320 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-9c93a38e-e637-4650-bc87-5aa8abc2e6a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4761507897fb4d95a47426c5fd41672c'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:08.521091 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-9c93a38e-e637-4650-bc87-5aa8abc2e6a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4761507897fb4d95a47426c5fd41672c'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:08.523936 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1006/2005] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 08:49:08 2022] DELETE /identity/v3/users/b5e7bb7800004e8eb43d141fce7e0ef8 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:08.524806 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9d2c10-7c45-43c4-8892-359311d2c091 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:08.526353 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-5f9d2c10-7c45-43c4-8892-359311d2c091 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:08.558641 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1000/2006] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 08:49:08 2022] DELETE /identity/v3/users/4761507897fb4d95a47426c5fd41672c => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:08.558641 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c93a38e-e637-4650-bc87-5aa8abc2e6a7 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:08.559448 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-9c93a38e-e637-4650-bc87-5aa8abc2e6a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:08.572653 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:08.605049 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:08.611156 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9d2c10-7c45-43c4-8892-359311d2c091 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:08.644492 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c93a38e-e637-4650-bc87-5aa8abc2e6a7 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:08.649970 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2fd7aa-f61b-4d54-a540-308f1a79c071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:08.650738 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2fd7aa-f61b-4d54-a540-308f1a79c071 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:08.651029 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2fd7aa-f61b-4d54-a540-308f1a79c071 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:08.651424 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2fd7aa-f61b-4d54-a540-308f1a79c071 admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:08.652169 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2fd7aa-f61b-4d54-a540-308f1a79c071 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:08.653780 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2fd7aa-f61b-4d54-a540-308f1a79c071 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:08.667061 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1001/2007] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:49:08 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:49:08.668949 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22261817-b72c-406c-a50b-978062ba6777 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:08.669145 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22261817-b72c-406c-a50b-978062ba6777 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:08.669431 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22261817-b72c-406c-a50b-978062ba6777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:08.696996 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-22261817-b72c-406c-a50b-978062ba6777 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:08.698158 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbaebc5-1f6e-44bf-85d9-8f13a0736af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:08.698816 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-22261817-b72c-406c-a50b-978062ba6777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:08.699001 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbaebc5-1f6e-44bf-85d9-8f13a0736af1 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:08.699142 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbaebc5-1f6e-44bf-85d9-8f13a0736af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:08.699440 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbaebc5-1f6e-44bf-85d9-8f13a0736af1 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:08.700080 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbaebc5-1f6e-44bf-85d9-8f13a0736af1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:08.702964 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbaebc5-1f6e-44bf-85d9-8f13a0736af1 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:08.709652 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1002/2008] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:08.710641 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22261817-b72c-406c-a50b-978062ba6777 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:08.721501 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22261817-b72c-406c-a50b-978062ba6777 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:08.730572 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52993d1-a176-4b97-abcd-e64fb0eb963a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:08.732108 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52993d1-a176-4b97-abcd-e64fb0eb963a admin admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:08.732495 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52993d1-a176-4b97-abcd-e64fb0eb963a admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:08.733210 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52993d1-a176-4b97-abcd-e64fb0eb963a admin admin] PATH_INFO: `/v3/projects/ec5b3d120bbc4526acc137eb38a944e1/users/2db435c58fd3458685f8aff0eb567374/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:08.739297 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1007/2009] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 08:49:08 2022] POST /identity/v3/users => generated 300 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:49:08.739297 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbaebc5-1f6e-44bf-85d9-8f13a0736af1 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:08.739297 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-edbaebc5-1f6e-44bf-85d9-8f13a0736af1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:08.758322 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52993d1-a176-4b97-abcd-e64fb0eb963a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec5b3d120bbc4526acc137eb38a944e1, user_id=2db435c58fd3458685f8aff0eb567374, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:08.761570 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52993d1-a176-4b97-abcd-e64fb0eb963a admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:08.785821 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1003/2010] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:49:08 2022] PUT /identity/v3/projects/ec5b3d120bbc4526acc137eb38a944e1/users/2db435c58fd3458685f8aff0eb567374/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:08.785821 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52993d1-a176-4b97-abcd-e64fb0eb963a admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:08.792469 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-b52993d1-a176-4b97-abcd-e64fb0eb963a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:08.803209 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbaebc5-1f6e-44bf-85d9-8f13a0736af1 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:08.867078 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b847d710-a4a8-4c1b-8957-3dacc21a98ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:08.867741 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847d710-a4a8-4c1b-8957-3dacc21a98ef service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:08.868022 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847d710-a4a8-4c1b-8957-3dacc21a98ef service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:08.868462 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847d710-a4a8-4c1b-8957-3dacc21a98ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:08.897124 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52993d1-a176-4b97-abcd-e64fb0eb963a admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:08.901837 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484ffc48-6bb0-4197-a0db-d51e6ed9777d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:08.902547 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ffc48-6bb0-4197-a0db-d51e6ed9777d admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:08.902837 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ffc48-6bb0-4197-a0db-d51e6ed9777d admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:08.903115 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ffc48-6bb0-4197-a0db-d51e6ed9777d admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:08.903848 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484ffc48-6bb0-4197-a0db-d51e6ed9777d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:08.905451 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484ffc48-6bb0-4197-a0db-d51e6ed9777d admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:08.916036 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1004/2011] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:49:08 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:49:08.916993 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484ffc48-6bb0-4197-a0db-d51e6ed9777d admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:08.927536 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484ffc48-6bb0-4197-a0db-d51e6ed9777d admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:08.932303 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a2cdd8-dc91-4d8b-9f74-0a160991c1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:08.932947 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2cdd8-dc91-4d8b-9f74-0a160991c1f1 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:08.933230 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2cdd8-dc91-4d8b-9f74-0a160991c1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:08.933509 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2cdd8-dc91-4d8b-9f74-0a160991c1f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:08.934258 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a2cdd8-dc91-4d8b-9f74-0a160991c1f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:08.934742 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b847d710-a4a8-4c1b-8957-3dacc21a98ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:08.935841 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a2cdd8-dc91-4d8b-9f74-0a160991c1f1 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:08.936180 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b847d710-a4a8-4c1b-8957-3dacc21a98ef service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:08.942115 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:08.947522 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1008/2012] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:49:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:49:08.947970 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1005/2013] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:49:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:49:08.948757 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a2cdd8-dc91-4d8b-9f74-0a160991c1f1 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:08.952096 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b847d710-a4a8-4c1b-8957-3dacc21a98ef service neutron] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:08.953497 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-b847d710-a4a8-4c1b-8957-3dacc21a98ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:08.960462 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a2cdd8-dc91-4d8b-9f74-0a160991c1f1 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:08.965498 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111573cf-b5fa-4abc-afc0-96561b0034db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:08.966475 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111573cf-b5fa-4abc-afc0-96561b0034db admin admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:08.966716 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b847d710-a4a8-4c1b-8957-3dacc21a98ef service neutron] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:08.966844 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111573cf-b5fa-4abc-afc0-96561b0034db admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:08.967156 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111573cf-b5fa-4abc-afc0-96561b0034db admin admin] PATH_INFO: `/v3/projects/72d72d9cbe934fe9b8ff224dbe273bbc/users/061721393b3b44cf9baa80b017db798d/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:08.972485 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de6aff-b4cc-4a3d-b075-3e7168553d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:08.973354 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de6aff-b4cc-4a3d-b075-3e7168553d49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:08.973638 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de6aff-b4cc-4a3d-b075-3e7168553d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:08.973915 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de6aff-b4cc-4a3d-b075-3e7168553d49 admin admin] PATH_INFO: `/v3/projects/09ba306e5f754e42b2b7f83d2b23057f` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:08.975449 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6de6aff-b4cc-4a3d-b075-3e7168553d49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09ba306e5f754e42b2b7f83d2b23057f)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:08.977353 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6de6aff-b4cc-4a3d-b075-3e7168553d49 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:08.985622 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111573cf-b5fa-4abc-afc0-96561b0034db admin admin] RBAC: Authorizing `identity:create_grant(project_id=72d72d9cbe934fe9b8ff224dbe273bbc, user_id=061721393b3b44cf9baa80b017db798d, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:08.990174 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111573cf-b5fa-4abc-afc0-96561b0034db admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:09.007771 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1006/2014] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:49:08 2022] PUT /identity/v3/projects/72d72d9cbe934fe9b8ff224dbe273bbc/users/061721393b3b44cf9baa80b017db798d/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:09.011518 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111573cf-b5fa-4abc-afc0-96561b0034db admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:09.035518 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-e6de6aff-b4cc-4a3d-b075-3e7168553d49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09ba306e5f754e42b2b7f83d2b23057f', 'request_id': 'req-e6de6aff-b4cc-4a3d-b075-3e7168553d49'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:09.050318 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-e6de6aff-b4cc-4a3d-b075-3e7168553d49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09ba306e5f754e42b2b7f83d2b23057f', 'request_id': 'req-e6de6aff-b4cc-4a3d-b075-3e7168553d49'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:09.057621 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-e6de6aff-b4cc-4a3d-b075-3e7168553d49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09ba306e5f754e42b2b7f83d2b23057f', 'request_id': 'req-e6de6aff-b4cc-4a3d-b075-3e7168553d49'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:09.072202 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:09.074305 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-e6de6aff-b4cc-4a3d-b075-3e7168553d49 admin admin] The token cache is being invalidate because project 09ba306e5f754e42b2b7f83d2b23057f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 08:49:09.074603 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-e6de6aff-b4cc-4a3d-b075-3e7168553d49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:09.075995 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-e6de6aff-b4cc-4a3d-b075-3e7168553d49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:09.077640 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1009/2015] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 08:49:08 2022] DELETE /identity/v3/projects/09ba306e5f754e42b2b7f83d2b23057f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:09.078399 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de6aff-b4cc-4a3d-b075-3e7168553d49 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:09.081580 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-e6de6aff-b4cc-4a3d-b075-3e7168553d49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:09.110925 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111573cf-b5fa-4abc-afc0-96561b0034db admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:09.183092 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de6aff-b4cc-4a3d-b075-3e7168553d49 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:09.189249 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad062a-c386-41ad-b076-c08d78a0fb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:09.189941 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad062a-c386-41ad-b076-c08d78a0fb50 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:09.190273 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad062a-c386-41ad-b076-c08d78a0fb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:09.191254 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad062a-c386-41ad-b076-c08d78a0fb50 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:09.192162 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ad062a-c386-41ad-b076-c08d78a0fb50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:09.193786 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ad062a-c386-41ad-b076-c08d78a0fb50 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:09.196554 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff1a4e-4121-46ed-b193-befa68981034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:09.198402 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff1a4e-4121-46ed-b193-befa68981034 admin admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:09.198908 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff1a4e-4121-46ed-b193-befa68981034 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:09.199387 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff1a4e-4121-46ed-b193-befa68981034 admin admin] PATH_INFO: `/v3/projects/ec5b3d120bbc4526acc137eb38a944e1/users/2db435c58fd3458685f8aff0eb567374/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:09.201797 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ff1a4e-4121-46ed-b193-befa68981034 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec5b3d120bbc4526acc137eb38a944e1, user_id=2db435c58fd3458685f8aff0eb567374, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:09.206779 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ff1a4e-4121-46ed-b193-befa68981034 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:09.213341 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1010/2016] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:49:09 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:49:09.213341 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844aafc-191f-499e-97a7-2489cd8be96a None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:09.213573 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844aafc-191f-499e-97a7-2489cd8be96a None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:09.213794 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844aafc-191f-499e-97a7-2489cd8be96a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:09.224781 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1007/2017] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:49:09 2022] PUT /identity/v3/projects/ec5b3d120bbc4526acc137eb38a944e1/users/2db435c58fd3458685f8aff0eb567374/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:09.225945 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff1a4e-4121-46ed-b193-befa68981034 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:09.239380 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-1844aafc-191f-499e-97a7-2489cd8be96a None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:09.241103 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-1844aafc-191f-499e-97a7-2489cd8be96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:09.306209 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff1a4e-4121-46ed-b193-befa68981034 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:09.310981 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642979ea-c369-46f5-836b-1930eab7e035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:09.311874 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642979ea-c369-46f5-836b-1930eab7e035 admin admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:09.312319 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642979ea-c369-46f5-836b-1930eab7e035 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:09.312453 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642979ea-c369-46f5-836b-1930eab7e035 admin admin] PATH_INFO: `/v3/projects/72d72d9cbe934fe9b8ff224dbe273bbc/users/061721393b3b44cf9baa80b017db798d/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:09.314645 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642979ea-c369-46f5-836b-1930eab7e035 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72d72d9cbe934fe9b8ff224dbe273bbc, user_id=061721393b3b44cf9baa80b017db798d, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:09.317848 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642979ea-c369-46f5-836b-1930eab7e035 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:09.322869 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1011/2018] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:09.324295 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382a2c3-8783-44e6-b112-19fcc2fbb7f2 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:09.324571 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382a2c3-8783-44e6-b112-19fcc2fbb7f2 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:09.324903 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382a2c3-8783-44e6-b112-19fcc2fbb7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:09.337607 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1008/2019] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:49:09 2022] PUT /identity/v3/projects/72d72d9cbe934fe9b8ff224dbe273bbc/users/061721393b3b44cf9baa80b017db798d/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:09.338468 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642979ea-c369-46f5-836b-1930eab7e035 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:09.340111 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-642979ea-c369-46f5-836b-1930eab7e035 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:09.358946 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-6382a2c3-8783-44e6-b112-19fcc2fbb7f2 None None] MFA Rules not processed for user `2db435c58fd3458685f8aff0eb567374`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:09.360205 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-6382a2c3-8783-44e6-b112-19fcc2fbb7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:09.369368 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:09.421261 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642979ea-c369-46f5-836b-1930eab7e035 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:09.427703 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94298ee-c4ee-46c0-9593-cbf3207902a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:09.428564 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94298ee-c4ee-46c0-9593-cbf3207902a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:09.428844 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94298ee-c4ee-46c0-9593-cbf3207902a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:09.429126 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94298ee-c4ee-46c0-9593-cbf3207902a4 admin admin] PATH_INFO: `/v3/projects/eaaf41dc28784c53b9101ab1a5f47bd6` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:09.430339 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94298ee-c4ee-46c0-9593-cbf3207902a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eaaf41dc28784c53b9101ab1a5f47bd6)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:09.432252 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94298ee-c4ee-46c0-9593-cbf3207902a4 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:09.445573 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:09.453730 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1012/2020] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:09 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:09.455080 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80754422-9ab7-48de-8581-f718d8b9e62c None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:09.455374 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80754422-9ab7-48de-8581-f718d8b9e62c None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:09.455652 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80754422-9ab7-48de-8581-f718d8b9e62c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:09.489146 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-80754422-9ab7-48de-8581-f718d8b9e62c None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:09.490511 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-80754422-9ab7-48de-8581-f718d8b9e62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:09.502122 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-d94298ee-c4ee-46c0-9593-cbf3207902a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eaaf41dc28784c53b9101ab1a5f47bd6', 'request_id': 'req-d94298ee-c4ee-46c0-9593-cbf3207902a4'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:09.508824 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-d94298ee-c4ee-46c0-9593-cbf3207902a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eaaf41dc28784c53b9101ab1a5f47bd6', 'request_id': 'req-d94298ee-c4ee-46c0-9593-cbf3207902a4'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:09.517825 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-d94298ee-c4ee-46c0-9593-cbf3207902a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eaaf41dc28784c53b9101ab1a5f47bd6', 'request_id': 'req-d94298ee-c4ee-46c0-9593-cbf3207902a4'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:09.535353 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-d94298ee-c4ee-46c0-9593-cbf3207902a4 admin admin] The token cache is being invalidate because project eaaf41dc28784c53b9101ab1a5f47bd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 08:49:09.535661 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-d94298ee-c4ee-46c0-9593-cbf3207902a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:09.536316 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-d94298ee-c4ee-46c0-9593-cbf3207902a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:09.538386 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1009/2021] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 08:49:09 2022] DELETE /identity/v3/projects/eaaf41dc28784c53b9101ab1a5f47bd6 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:09.540451 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f1d31-24f0-466e-9ec1-f895b9a395a4 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:09.540749 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f1d31-24f0-466e-9ec1-f895b9a395a4 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:09.541032 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f1d31-24f0-466e-9ec1-f895b9a395a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:09.566465 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1013/2022] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:09.567122 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80754422-9ab7-48de-8581-f718d8b9e62c None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:09.569498 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-80754422-9ab7-48de-8581-f718d8b9e62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:09.576578 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-4b1f1d31-24f0-466e-9ec1-f895b9a395a4 None None] MFA Rules not processed for user `061721393b3b44cf9baa80b017db798d`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:09.577673 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-4b1f1d31-24f0-466e-9ec1-f895b9a395a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:09.635969 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80754422-9ab7-48de-8581-f718d8b9e62c None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:09.640599 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62888854-d5c2-4bb3-a066-a69d35ba4a67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:09.641258 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62888854-d5c2-4bb3-a066-a69d35ba4a67 service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:09.641533 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62888854-d5c2-4bb3-a066-a69d35ba4a67 service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:09.641815 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62888854-d5c2-4bb3-a066-a69d35ba4a67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:09.643695 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-62888854-d5c2-4bb3-a066-a69d35ba4a67 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:09.655491 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1010/2023] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:09 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:09.656584 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1f1d31-24f0-466e-9ec1-f895b9a395a4 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:09.658361 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-4b1f1d31-24f0-466e-9ec1-f895b9a395a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:09.672961 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1f1d31-24f0-466e-9ec1-f895b9a395a4 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:09.680085 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b64d533-ab15-45ba-aa20-6b76c15f59e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:09.680976 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64d533-ab15-45ba-aa20-6b76c15f59e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:09.681265 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64d533-ab15-45ba-aa20-6b76c15f59e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:09.681545 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64d533-ab15-45ba-aa20-6b76c15f59e9 admin admin] PATH_INFO: `/v3/users/fe7f415438a54d83914e3e644ad20673` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:09.682798 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b64d533-ab15-45ba-aa20-6b76c15f59e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe7f415438a54d83914e3e644ad20673)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:09.684731 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b64d533-ab15-45ba-aa20-6b76c15f59e9 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:09.716952 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:09.721041 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62888854-d5c2-4bb3-a066-a69d35ba4a67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:09.722940 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62888854-d5c2-4bb3-a066-a69d35ba4a67 service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:09.735421 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1014/2024] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:49:09 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:49:09.736251 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62888854-d5c2-4bb3-a066-a69d35ba4a67 service cinder] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:09.747294 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62888854-d5c2-4bb3-a066-a69d35ba4a67 service cinder] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:09.750384 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-5b64d533-ab15-45ba-aa20-6b76c15f59e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe7f415438a54d83914e3e644ad20673'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:09.752348 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a9566e-097b-4830-b625-c2daec3dde6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:09.753686 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a9566e-097b-4830-b625-c2daec3dde6c admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:09.753990 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a9566e-097b-4830-b625-c2daec3dde6c admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:09.754315 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a9566e-097b-4830-b625-c2daec3dde6c admin admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:09.755056 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a9566e-097b-4830-b625-c2daec3dde6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:09.755396 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a9566e-097b-4830-b625-c2daec3dde6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:09.756987 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a9566e-097b-4830-b625-c2daec3dde6c admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:09.761285 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-5b64d533-ab15-45ba-aa20-6b76c15f59e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe7f415438a54d83914e3e644ad20673'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:09.761998 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-5b64d533-ab15-45ba-aa20-6b76c15f59e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe7f415438a54d83914e3e644ad20673'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:09.770861 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-5b64d533-ab15-45ba-aa20-6b76c15f59e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe7f415438a54d83914e3e644ad20673'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:09.771715 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-5b64d533-ab15-45ba-aa20-6b76c15f59e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe7f415438a54d83914e3e644ad20673'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:09.774842 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1015/2025] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Jun 22 08:49:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:09.775783 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a9566e-097b-4830-b625-c2daec3dde6c admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:09.777975 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-99a9566e-097b-4830-b625-c2daec3dde6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:09.790195 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a9566e-097b-4830-b625-c2daec3dde6c admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:09.792192 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:09.794163 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871c69d-e35e-4946-acb9-d7d06f2e2cc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:09.794768 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871c69d-e35e-4946-acb9-d7d06f2e2cc2 service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:09.795091 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871c69d-e35e-4946-acb9-d7d06f2e2cc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:09.795482 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871c69d-e35e-4946-acb9-d7d06f2e2cc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:09.797304 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-1871c69d-e35e-4946-acb9-d7d06f2e2cc2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:09.800256 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1011/2026] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 08:49:09 2022] DELETE /identity/v3/users/fe7f415438a54d83914e3e644ad20673 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:09.801426 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b64d533-ab15-45ba-aa20-6b76c15f59e9 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:09.803173 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-5b64d533-ab15-45ba-aa20-6b76c15f59e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:09.819472 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1871c69d-e35e-4946-acb9-d7d06f2e2cc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:09.820913 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1871c69d-e35e-4946-acb9-d7d06f2e2cc2 service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:09.833226 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1016/2027] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:49:09 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:49:09.834225 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871c69d-e35e-4946-acb9-d7d06f2e2cc2 service cinder] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:09.835772 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-1871c69d-e35e-4946-acb9-d7d06f2e2cc2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:09.854571 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871c69d-e35e-4946-acb9-d7d06f2e2cc2 service cinder] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:09.900465 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b64d533-ab15-45ba-aa20-6b76c15f59e9 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:09.907500 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea718d0d-bed2-473a-865e-09da5f97569d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:09.908181 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea718d0d-bed2-473a-865e-09da5f97569d admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:09.908466 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea718d0d-bed2-473a-865e-09da5f97569d admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:09.908746 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea718d0d-bed2-473a-865e-09da5f97569d admin admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:09.909495 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea718d0d-bed2-473a-865e-09da5f97569d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:09.911590 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea718d0d-bed2-473a-865e-09da5f97569d admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:09.931329 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e01fec-2dbc-4b87-b93d-a50887bbff73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:09.931976 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e01fec-2dbc-4b87-b93d-a50887bbff73 service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:09.932320 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e01fec-2dbc-4b87-b93d-a50887bbff73 service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:09.932587 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e01fec-2dbc-4b87-b93d-a50887bbff73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:09.935077 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-23e01fec-2dbc-4b87-b93d-a50887bbff73 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:09.947568 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1012/2028] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 08:49:09 2022] POST /identity/v3/projects => generated 371 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:49:09.953171 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea718d0d-bed2-473a-865e-09da5f97569d admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:10.041790 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e01fec-2dbc-4b87-b93d-a50887bbff73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:10.043475 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e01fec-2dbc-4b87-b93d-a50887bbff73 service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:10.048710 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea718d0d-bed2-473a-865e-09da5f97569d admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:10.054446 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b6945-e100-4972-a71b-1c871e1dbfc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:10.055604 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b6945-e100-4972-a71b-1c871e1dbfc6 admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:10.055932 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1017/2029] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:49:09 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:49:10.056315 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b6945-e100-4972-a71b-1c871e1dbfc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:10.056605 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b6945-e100-4972-a71b-1c871e1dbfc6 admin admin] PATH_INFO: `/v3/users` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:10.057430 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b6945-e100-4972-a71b-1c871e1dbfc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:10.060830 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b6945-e100-4972-a71b-1c871e1dbfc6 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:10.096358 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1013/2030] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 08:49:09 2022] POST /identity/v3/users => generated 286 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:49:10.097573 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e01fec-2dbc-4b87-b93d-a50887bbff73 service cinder] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:10.110757 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e01fec-2dbc-4b87-b93d-a50887bbff73 service cinder] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:10.122245 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6659e-8a72-4c97-8186-1464c2b08c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:10.122245 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6659e-8a72-4c97-8186-1464c2b08c94 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:10.122245 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6659e-8a72-4c97-8186-1464c2b08c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:10.122245 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6659e-8a72-4c97-8186-1464c2b08c94 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:10.122592 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d6659e-8a72-4c97-8186-1464c2b08c94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:10.123819 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d6659e-8a72-4c97-8186-1464c2b08c94 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:10.136849 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1018/2031] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:49:10 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:49:10.141110 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b6945-e100-4972-a71b-1c871e1dbfc6 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:10.152081 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b6945-e100-4972-a71b-1c871e1dbfc6 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:10.165931 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6659e-8a72-4c97-8186-1464c2b08c94 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:10.166541 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-54d6659e-8a72-4c97-8186-1464c2b08c94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:10.167110 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57e031a-451b-4a90-a0fc-883f4982fd27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:10.168074 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e031a-451b-4a90-a0fc-883f4982fd27 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:10.168907 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e031a-451b-4a90-a0fc-883f4982fd27 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:10.169390 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e031a-451b-4a90-a0fc-883f4982fd27 admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:10.170592 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57e031a-451b-4a90-a0fc-883f4982fd27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:10.172624 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57e031a-451b-4a90-a0fc-883f4982fd27 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:10.183716 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6659e-8a72-4c97-8186-1464c2b08c94 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:10.189787 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c645f-486c-4bf8-9335-0ded68e48299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:10.190829 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c645f-486c-4bf8-9335-0ded68e48299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:10.191202 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c645f-486c-4bf8-9335-0ded68e48299 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:10.191493 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c645f-486c-4bf8-9335-0ded68e48299 admin admin] PATH_INFO: `/v3/projects/c47f47bde951418f9622593a89b35b32` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:10.192832 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c645f-486c-4bf8-9335-0ded68e48299 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c47f47bde951418f9622593a89b35b32)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:10.195310 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c645f-486c-4bf8-9335-0ded68e48299 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:10.199006 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1014/2032] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:49:10 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:49:10.203986 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57e031a-451b-4a90-a0fc-883f4982fd27 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:10.226810 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57e031a-451b-4a90-a0fc-883f4982fd27 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:10.241663 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f020eb6-c28b-489c-a789-886440d1132c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:10.242895 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f020eb6-c28b-489c-a789-886440d1132c admin admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:10.243177 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f020eb6-c28b-489c-a789-886440d1132c admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:10.243502 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f020eb6-c28b-489c-a789-886440d1132c admin admin] PATH_INFO: `/v3/projects/517954fc82ab432eb6b3b0fff0c58fc2/users/3a496c0da8b24928b36d0c37b7599af1/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:10.279256 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-ae1c645f-486c-4bf8-9335-0ded68e48299 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c47f47bde951418f9622593a89b35b32', 'request_id': 'req-ae1c645f-486c-4bf8-9335-0ded68e48299'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:10.286239 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-ae1c645f-486c-4bf8-9335-0ded68e48299 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c47f47bde951418f9622593a89b35b32', 'request_id': 'req-ae1c645f-486c-4bf8-9335-0ded68e48299'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:10.287563 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f020eb6-c28b-489c-a789-886440d1132c admin admin] RBAC: Authorizing `identity:create_grant(project_id=517954fc82ab432eb6b3b0fff0c58fc2, user_id=3a496c0da8b24928b36d0c37b7599af1, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:10.290421 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f020eb6-c28b-489c-a789-886440d1132c admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:10.296839 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-ae1c645f-486c-4bf8-9335-0ded68e48299 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c47f47bde951418f9622593a89b35b32', 'request_id': 'req-ae1c645f-486c-4bf8-9335-0ded68e48299'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:10.303341 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:10.317453 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-ae1c645f-486c-4bf8-9335-0ded68e48299 admin admin] The token cache is being invalidate because project c47f47bde951418f9622593a89b35b32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 08:49:10.317754 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-ae1c645f-486c-4bf8-9335-0ded68e48299 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:10.318516 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1015/2033] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:49:10 2022] PUT /identity/v3/projects/517954fc82ab432eb6b3b0fff0c58fc2/users/3a496c0da8b24928b36d0c37b7599af1/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:10.319283 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-ae1c645f-486c-4bf8-9335-0ded68e48299 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:10.322924 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1019/2034] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 08:49:10 2022] DELETE /identity/v3/projects/c47f47bde951418f9622593a89b35b32 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 08:49:10.325688 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0e172-7812-40d7-9b2f-68f6657f9e35 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:10.325688 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0e172-7812-40d7-9b2f-68f6657f9e35 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:10.325688 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0e172-7812-40d7-9b2f-68f6657f9e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:10.328620 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e645664-8333-4ccb-a0dc-c26b9219d162 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:10.329607 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e645664-8333-4ccb-a0dc-c26b9219d162 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:10.330153 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e645664-8333-4ccb-a0dc-c26b9219d162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:10.359257 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-47d0e172-7812-40d7-9b2f-68f6657f9e35 None None] MFA Rules not processed for user `3a496c0da8b24928b36d0c37b7599af1`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:10.361535 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-47d0e172-7812-40d7-9b2f-68f6657f9e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:10.379314 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-9e645664-8333-4ccb-a0dc-c26b9219d162 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:10.380542 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-9e645664-8333-4ccb-a0dc-c26b9219d162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:10.394800 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:10.482905 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1016/2035] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:10.504850 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d0e172-7812-40d7-9b2f-68f6657f9e35 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:10.506568 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-47d0e172-7812-40d7-9b2f-68f6657f9e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:10.517873 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1020/2036] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:10.526817 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5609c92-8355-4e0c-8e63-cb29dd226644 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:10.527317 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5609c92-8355-4e0c-8e63-cb29dd226644 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:10.527607 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5609c92-8355-4e0c-8e63-cb29dd226644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:10.553296 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-f5609c92-8355-4e0c-8e63-cb29dd226644 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:10.554666 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-f5609c92-8355-4e0c-8e63-cb29dd226644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:10.564163 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1021/2037] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:10.572601 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5609c92-8355-4e0c-8e63-cb29dd226644 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:10.583801 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5609c92-8355-4e0c-8e63-cb29dd226644 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:10.588958 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338f3a10-0409-4229-b1b5-2e7692fdae96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:10.589669 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f3a10-0409-4229-b1b5-2e7692fdae96 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:10.589955 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f3a10-0409-4229-b1b5-2e7692fdae96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:10.590251 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f3a10-0409-4229-b1b5-2e7692fdae96 admin admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:10.591349 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338f3a10-0409-4229-b1b5-2e7692fdae96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:10.591349 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338f3a10-0409-4229-b1b5-2e7692fdae96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:10.600288 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338f3a10-0409-4229-b1b5-2e7692fdae96 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:10.602108 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d0e172-7812-40d7-9b2f-68f6657f9e35 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:10.608306 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847fefe8-1bc9-4f66-aa39-aa01348d183c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:10.609329 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847fefe8-1bc9-4f66-aa39-aa01348d183c service cinder] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:10.609766 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847fefe8-1bc9-4f66-aa39-aa01348d183c service cinder] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:10.610255 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847fefe8-1bc9-4f66-aa39-aa01348d183c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:10.620151 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1022/2038] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Jun 22 08:49:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:10.621904 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847fefe8-1bc9-4f66-aa39-aa01348d183c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:10.623387 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847fefe8-1bc9-4f66-aa39-aa01348d183c service cinder] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:10.628812 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338f3a10-0409-4229-b1b5-2e7692fdae96 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:10.633044 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1017/2039] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:49:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 08:49:10.648871 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338f3a10-0409-4229-b1b5-2e7692fdae96 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:10.654387 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9431a58a-61db-488b-993c-fde73252908a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:10.655058 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431a58a-61db-488b-993c-fde73252908a admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:10.655346 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431a58a-61db-488b-993c-fde73252908a admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:10.655628 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431a58a-61db-488b-993c-fde73252908a admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:10.656606 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9431a58a-61db-488b-993c-fde73252908a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:10.658969 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9431a58a-61db-488b-993c-fde73252908a admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:10.696102 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1023/2040] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 08:49:10 2022] POST /identity/v3/projects => generated 407 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 08:49:10.697371 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847fefe8-1bc9-4f66-aa39-aa01348d183c service cinder] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:10.710716 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847fefe8-1bc9-4f66-aa39-aa01348d183c service cinder] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:10.726104 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9431a58a-61db-488b-993c-fde73252908a admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:10.728932 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-9431a58a-61db-488b-993c-fde73252908a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:10.791315 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a948509-ce17-42b1-8086-93e1cdc59d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:10.792091 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a948509-ce17-42b1-8086-93e1cdc59d42 admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:10.792492 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a948509-ce17-42b1-8086-93e1cdc59d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:10.792826 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a948509-ce17-42b1-8086-93e1cdc59d42 admin admin] PATH_INFO: `/v3/users` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:10.793793 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a948509-ce17-42b1-8086-93e1cdc59d42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:10.796391 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a948509-ce17-42b1-8086-93e1cdc59d42 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:10.823246 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9431a58a-61db-488b-993c-fde73252908a admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:10.827049 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1018/2041] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 08:49:10 2022] POST /identity/v3/users => generated 304 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:49:10.829902 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c430d375-35fd-48cc-9c28-9de2f0384d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:10.831676 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a948509-ce17-42b1-8086-93e1cdc59d42 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:10.832269 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430d375-35fd-48cc-9c28-9de2f0384d13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:10.832959 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430d375-35fd-48cc-9c28-9de2f0384d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:10.833394 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430d375-35fd-48cc-9c28-9de2f0384d13 admin admin] PATH_INFO: `/v3/users/bb87d3616cb144fea9eced0c2fd8006e` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:10.835089 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c430d375-35fd-48cc-9c28-9de2f0384d13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb87d3616cb144fea9eced0c2fd8006e)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:10.837521 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c430d375-35fd-48cc-9c28-9de2f0384d13 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:10.844864 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a948509-ce17-42b1-8086-93e1cdc59d42 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:10.854966 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3264a8-3557-41c0-8d79-6f3b4f3d08b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:10.855858 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3264a8-3557-41c0-8d79-6f3b4f3d08b5 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:10.856066 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3264a8-3557-41c0-8d79-6f3b4f3d08b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:10.856351 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3264a8-3557-41c0-8d79-6f3b4f3d08b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:10.857147 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3264a8-3557-41c0-8d79-6f3b4f3d08b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:10.858938 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3264a8-3557-41c0-8d79-6f3b4f3d08b5 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:10.878760 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1019/2042] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:49:10 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:49:10.884325 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3264a8-3557-41c0-8d79-6f3b4f3d08b5 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:10.898963 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3264a8-3557-41c0-8d79-6f3b4f3d08b5 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:10.904569 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de0d39-dd92-4ff1-bc23-c8cc06e41379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:10.905503 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de0d39-dd92-4ff1-bc23-c8cc06e41379 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:10.905791 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de0d39-dd92-4ff1-bc23-c8cc06e41379 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:10.906100 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de0d39-dd92-4ff1-bc23-c8cc06e41379 admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:10.906322 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c430d375-35fd-48cc-9c28-9de2f0384d13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb87d3616cb144fea9eced0c2fd8006e'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:10.906887 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37de0d39-dd92-4ff1-bc23-c8cc06e41379 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:10.908766 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37de0d39-dd92-4ff1-bc23-c8cc06e41379 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:10.914773 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c430d375-35fd-48cc-9c28-9de2f0384d13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb87d3616cb144fea9eced0c2fd8006e'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:10.915887 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c430d375-35fd-48cc-9c28-9de2f0384d13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb87d3616cb144fea9eced0c2fd8006e'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:10.920415 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:10.926059 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c430d375-35fd-48cc-9c28-9de2f0384d13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb87d3616cb144fea9eced0c2fd8006e'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:10.930454 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1020/2043] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:49:10 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 08:49:10.930900 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c430d375-35fd-48cc-9c28-9de2f0384d13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb87d3616cb144fea9eced0c2fd8006e'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:10.934859 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de0d39-dd92-4ff1-bc23-c8cc06e41379 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:10.937381 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-37de0d39-dd92-4ff1-bc23-c8cc06e41379 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:10.954266 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1024/2044] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 08:49:10 2022] DELETE /identity/v3/users/bb87d3616cb144fea9eced0c2fd8006e => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:10.958353 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de0d39-dd92-4ff1-bc23-c8cc06e41379 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:10.959321 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21aa15a-d76e-4b98-9adc-24356213fe06 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:10.959802 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21aa15a-d76e-4b98-9adc-24356213fe06 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:10.960091 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21aa15a-d76e-4b98-9adc-24356213fe06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:10.979889 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-a21aa15a-d76e-4b98-9adc-24356213fe06 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:10.981133 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-a21aa15a-d76e-4b98-9adc-24356213fe06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:11.022236 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:11.049142 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c842d4a0-bec5-4b52-b058-ceeb299db6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:11.050369 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842d4a0-bec5-4b52-b058-ceeb299db6b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:11.051105 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842d4a0-bec5-4b52-b058-ceeb299db6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:11.051105 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842d4a0-bec5-4b52-b058-ceeb299db6b7 admin admin] PATH_INFO: `/v3/projects/52d1c9326af941ecaba9c3221811d6b1/users/d7acfad085744837abc64065cfb81917/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:11.064504 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1025/2045] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 08:49:11.068941 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c842d4a0-bec5-4b52-b058-ceeb299db6b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52d1c9326af941ecaba9c3221811d6b1, user_id=d7acfad085744837abc64065cfb81917, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:11.072188 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c842d4a0-bec5-4b52-b058-ceeb299db6b7 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:11.076419 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21aa15a-d76e-4b98-9adc-24356213fe06 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:11.077672 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-a21aa15a-d76e-4b98-9adc-24356213fe06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:11.088681 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1021/2046] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:49:10 2022] PUT /identity/v3/projects/52d1c9326af941ecaba9c3221811d6b1/users/d7acfad085744837abc64065cfb81917/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 08:49:11.100062 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8adb968-d43d-4e02-8a79-a387d3db6aa2 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:11.100345 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8adb968-d43d-4e02-8a79-a387d3db6aa2 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:11.100629 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8adb968-d43d-4e02-8a79-a387d3db6aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:11.129128 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-b8adb968-d43d-4e02-8a79-a387d3db6aa2 None None] MFA Rules not processed for user `d7acfad085744837abc64065cfb81917`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:11.130389 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-b8adb968-d43d-4e02-8a79-a387d3db6aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:11.139405 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21aa15a-d76e-4b98-9adc-24356213fe06 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:11.190007 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f483b3a2-8eb4-43ff-98bc-e6af3f44c26b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:11.191702 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f483b3a2-8eb4-43ff-98bc-e6af3f44c26b service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:11.191995 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f483b3a2-8eb4-43ff-98bc-e6af3f44c26b service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:11.192544 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f483b3a2-8eb4-43ff-98bc-e6af3f44c26b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:11.197524 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1022/2047] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:11 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 08:49:11.202186 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8adb968-d43d-4e02-8a79-a387d3db6aa2 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:11.236876 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:11.266171 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f483b3a2-8eb4-43ff-98bc-e6af3f44c26b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:11.267604 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f483b3a2-8eb4-43ff-98bc-e6af3f44c26b service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:11.281451 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8adb968-d43d-4e02-8a79-a387d3db6aa2 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:11.282934 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1026/2048] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:49:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 08:49:11.290795 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf2d4b-98b7-4c72-bf21-1e2b830dd298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:11.291545 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf2d4b-98b7-4c72-bf21-1e2b830dd298 admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:11.291924 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf2d4b-98b7-4c72-bf21-1e2b830dd298 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:11.292220 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf2d4b-98b7-4c72-bf21-1e2b830dd298 admin admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:11.293242 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bf2d4b-98b7-4c72-bf21-1e2b830dd298 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:11.295247 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bf2d4b-98b7-4c72-bf21-1e2b830dd298 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:11.327920 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1023/2049] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 08:49:11 2022] POST /identity/v3/projects => generated 407 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 08:49:11.332024 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f483b3a2-8eb4-43ff-98bc-e6af3f44c26b service neutron] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:11.347032 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f483b3a2-8eb4-43ff-98bc-e6af3f44c26b service neutron] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:11.423259 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85344e70-06f4-4487-af62-e0528658ce32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:11.423950 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85344e70-06f4-4487-af62-e0528658ce32 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:11.424260 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85344e70-06f4-4487-af62-e0528658ce32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:11.425205 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85344e70-06f4-4487-af62-e0528658ce32 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:11.426139 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85344e70-06f4-4487-af62-e0528658ce32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:11.428172 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85344e70-06f4-4487-af62-e0528658ce32 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:11.462907 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1027/2050] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 08:49:11 2022] POST /identity/v3/users => generated 310 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:49:11.468051 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf2d4b-98b7-4c72-bf21-1e2b830dd298 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:11.481044 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf2d4b-98b7-4c72-bf21-1e2b830dd298 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:11.487798 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a884e6-aa7d-4e5f-baff-b397496fe40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:11.489471 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a884e6-aa7d-4e5f-baff-b397496fe40b admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:11.489904 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a884e6-aa7d-4e5f-baff-b397496fe40b admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:11.490338 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a884e6-aa7d-4e5f-baff-b397496fe40b admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:11.491177 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a884e6-aa7d-4e5f-baff-b397496fe40b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:11.493423 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a884e6-aa7d-4e5f-baff-b397496fe40b admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:11.511924 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1024/2051] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:49:11 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:49:11.513323 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85344e70-06f4-4487-af62-e0528658ce32 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:11.525413 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85344e70-06f4-4487-af62-e0528658ce32 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:11.530877 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f00f0dc-dd3c-47c4-8c32-7f1627f83b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:11.532001 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00f0dc-dd3c-47c4-8c32-7f1627f83b88 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:11.532454 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00f0dc-dd3c-47c4-8c32-7f1627f83b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:11.534488 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00f0dc-dd3c-47c4-8c32-7f1627f83b88 admin admin] PATH_INFO: `/v3/projects/292a948f5eee4322adbffa0d91309ce3/users/9aeb4f2c6a8e4311a19b5f0989306a8b/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:11.552078 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f00f0dc-dd3c-47c4-8c32-7f1627f83b88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=292a948f5eee4322adbffa0d91309ce3, user_id=9aeb4f2c6a8e4311a19b5f0989306a8b, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:11.555881 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f00f0dc-dd3c-47c4-8c32-7f1627f83b88 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:11.575024 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1028/2052] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:49:11 2022] PUT /identity/v3/projects/292a948f5eee4322adbffa0d91309ce3/users/9aeb4f2c6a8e4311a19b5f0989306a8b/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 08:49:11.583464 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a884e6-aa7d-4e5f-baff-b397496fe40b admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:11.602468 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f00f0dc-dd3c-47c4-8c32-7f1627f83b88 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:11.604553 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-3f00f0dc-dd3c-47c4-8c32-7f1627f83b88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:11.609904 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a884e6-aa7d-4e5f-baff-b397496fe40b admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:11.686068 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:11.710685 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f00f0dc-dd3c-47c4-8c32-7f1627f83b88 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:11.716300 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1317dc3e-e829-45f0-9928-65d851a7ad3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:11.717327 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317dc3e-e829-45f0-9928-65d851a7ad3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:11.717793 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317dc3e-e829-45f0-9928-65d851a7ad3d admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:11.718228 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317dc3e-e829-45f0-9928-65d851a7ad3d admin admin] PATH_INFO: `/v3/projects/3ef3bc2a56584745ab4cc785c251d6e4` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:11.719556 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1317dc3e-e829-45f0-9928-65d851a7ad3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ef3bc2a56584745ab4cc785c251d6e4)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:11.727179 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1317dc3e-e829-45f0-9928-65d851a7ad3d admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:11.781084 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce17a6-f5da-4948-85e6-bcd633fd3370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:11.781767 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce17a6-f5da-4948-85e6-bcd633fd3370 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:11.782051 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce17a6-f5da-4948-85e6-bcd633fd3370 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:11.782349 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce17a6-f5da-4948-85e6-bcd633fd3370 admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:11.783080 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdce17a6-f5da-4948-85e6-bcd633fd3370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:11.785289 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdce17a6-f5da-4948-85e6-bcd633fd3370 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:11.797816 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1025/2053] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:49:11 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:49:11.800753 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:11.802355 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce17a6-f5da-4948-85e6-bcd633fd3370 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:11.805695 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-1317dc3e-e829-45f0-9928-65d851a7ad3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ef3bc2a56584745ab4cc785c251d6e4', 'request_id': 'req-1317dc3e-e829-45f0-9928-65d851a7ad3d'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:11.816098 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce17a6-f5da-4948-85e6-bcd633fd3370 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:11.824696 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-1317dc3e-e829-45f0-9928-65d851a7ad3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ef3bc2a56584745ab4cc785c251d6e4', 'request_id': 'req-1317dc3e-e829-45f0-9928-65d851a7ad3d'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:11.831640 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-1317dc3e-e829-45f0-9928-65d851a7ad3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ef3bc2a56584745ab4cc785c251d6e4', 'request_id': 'req-1317dc3e-e829-45f0-9928-65d851a7ad3d'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:11.848522 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-1317dc3e-e829-45f0-9928-65d851a7ad3d admin admin] The token cache is being invalidate because project 3ef3bc2a56584745ab4cc785c251d6e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 08:49:11.848941 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-1317dc3e-e829-45f0-9928-65d851a7ad3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:11.849662 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-1317dc3e-e829-45f0-9928-65d851a7ad3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:11.851504 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1029/2054] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 08:49:11 2022] DELETE /identity/v3/projects/3ef3bc2a56584745ab4cc785c251d6e4 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 08:49:11.856870 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1317dc3e-e829-45f0-9928-65d851a7ad3d admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:11.859555 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-1317dc3e-e829-45f0-9928-65d851a7ad3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:11.897760 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef69b3b8-5bf2-4eea-a761-318769ab6ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:11.898988 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef69b3b8-5bf2-4eea-a761-318769ab6ee7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:11.899279 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef69b3b8-5bf2-4eea-a761-318769ab6ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:11.899564 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef69b3b8-5bf2-4eea-a761-318769ab6ee7 admin admin] PATH_INFO: `/v3/projects/292a948f5eee4322adbffa0d91309ce3/users/9aeb4f2c6a8e4311a19b5f0989306a8b/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:11.901790 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef69b3b8-5bf2-4eea-a761-318769ab6ee7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=292a948f5eee4322adbffa0d91309ce3, user_id=9aeb4f2c6a8e4311a19b5f0989306a8b, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:11.904522 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef69b3b8-5bf2-4eea-a761-318769ab6ee7 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:11.918186 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1026/2055] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:49:11 2022] PUT /identity/v3/projects/292a948f5eee4322adbffa0d91309ce3/users/9aeb4f2c6a8e4311a19b5f0989306a8b/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:11.927748 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d649cb-d2e7-4985-8664-f6c2426329c1 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:11.928050 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d649cb-d2e7-4985-8664-f6c2426329c1 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:11.928338 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d649cb-d2e7-4985-8664-f6c2426329c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:11.950222 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1317dc3e-e829-45f0-9928-65d851a7ad3d admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:11.960589 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-d3d649cb-d2e7-4985-8664-f6c2426329c1 None None] MFA Rules not processed for user `9aeb4f2c6a8e4311a19b5f0989306a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:11.961368 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-d3d649cb-d2e7-4985-8664-f6c2426329c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:12.020405 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177b5cd6-8ec9-46c1-8ef8-d468a64e65bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:12.022187 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b5cd6-8ec9-46c1-8ef8-d468a64e65bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:12.022479 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b5cd6-8ec9-46c1-8ef8-d468a64e65bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:12.022755 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b5cd6-8ec9-46c1-8ef8-d468a64e65bf admin admin] PATH_INFO: `/v3/users/061721393b3b44cf9baa80b017db798d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:12.024370 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177b5cd6-8ec9-46c1-8ef8-d468a64e65bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=061721393b3b44cf9baa80b017db798d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:12.026573 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177b5cd6-8ec9-46c1-8ef8-d468a64e65bf admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:12.061563 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1027/2056] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:11 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 08:49:12.074946 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d649cb-d2e7-4985-8664-f6c2426329c1 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:12.076974 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-d3d649cb-d2e7-4985-8664-f6c2426329c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:12.095901 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-177b5cd6-8ec9-46c1-8ef8-d468a64e65bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '061721393b3b44cf9baa80b017db798d'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:12.105686 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-177b5cd6-8ec9-46c1-8ef8-d468a64e65bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '061721393b3b44cf9baa80b017db798d'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:12.106884 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-177b5cd6-8ec9-46c1-8ef8-d468a64e65bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '061721393b3b44cf9baa80b017db798d'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:12.118573 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-177b5cd6-8ec9-46c1-8ef8-d468a64e65bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '061721393b3b44cf9baa80b017db798d'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:12.119823 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-177b5cd6-8ec9-46c1-8ef8-d468a64e65bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '061721393b3b44cf9baa80b017db798d'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:12.146815 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1030/2057] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 08:49:11 2022] DELETE /identity/v3/users/061721393b3b44cf9baa80b017db798d => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:12.151469 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:12.181628 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d649cb-d2e7-4985-8664-f6c2426329c1 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:12.269113 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec118919-d616-437e-ba43-7611be04db00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:12.269605 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec118919-d616-437e-ba43-7611be04db00 service cinder] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:12.270012 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec118919-d616-437e-ba43-7611be04db00 service cinder] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:12.270537 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec118919-d616-437e-ba43-7611be04db00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:12.272577 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-ec118919-d616-437e-ba43-7611be04db00 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:12.367178 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec118919-d616-437e-ba43-7611be04db00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:12.370399 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec118919-d616-437e-ba43-7611be04db00 service cinder] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:12.400340 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1028/2058] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:49:12 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:49:12.596868 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177b5cd6-8ec9-46c1-8ef8-d468a64e65bf admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:12.598556 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-177b5cd6-8ec9-46c1-8ef8-d468a64e65bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:12.605876 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:12.705631 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec118919-d616-437e-ba43-7611be04db00 service cinder] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:12.707995 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-ec118919-d616-437e-ba43-7611be04db00 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:12.730385 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec118919-d616-437e-ba43-7611be04db00 service cinder] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:12.745522 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177b5cd6-8ec9-46c1-8ef8-d468a64e65bf admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:12.748691 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f05261e-22b3-46a4-a62a-2f767e638935 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:12.750826 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f05261e-22b3-46a4-a62a-2f767e638935 service cinder] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:12.750951 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b24236f-bd19-44b0-9f0f-109e8b301cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:12.751240 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f05261e-22b3-46a4-a62a-2f767e638935 service cinder] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:12.751532 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f05261e-22b3-46a4-a62a-2f767e638935 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:12.751876 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24236f-bd19-44b0-9f0f-109e8b301cec admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:12.752168 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24236f-bd19-44b0-9f0f-109e8b301cec admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:12.752449 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24236f-bd19-44b0-9f0f-109e8b301cec admin admin] PATH_INFO: `/v3/projects/72d72d9cbe934fe9b8ff224dbe273bbc` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:12.754931 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b24236f-bd19-44b0-9f0f-109e8b301cec admin admin] RBAC: Authorizing `identity:delete_project(project_id=72d72d9cbe934fe9b8ff224dbe273bbc)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:12.757070 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-6f05261e-22b3-46a4-a62a-2f767e638935 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:12.757853 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b24236f-bd19-44b0-9f0f-109e8b301cec admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:12.820941 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-7b24236f-bd19-44b0-9f0f-109e8b301cec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72d72d9cbe934fe9b8ff224dbe273bbc', 'request_id': 'req-7b24236f-bd19-44b0-9f0f-109e8b301cec'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:12.834801 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-7b24236f-bd19-44b0-9f0f-109e8b301cec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72d72d9cbe934fe9b8ff224dbe273bbc', 'request_id': 'req-7b24236f-bd19-44b0-9f0f-109e8b301cec'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:12.843149 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-7b24236f-bd19-44b0-9f0f-109e8b301cec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72d72d9cbe934fe9b8ff224dbe273bbc', 'request_id': 'req-7b24236f-bd19-44b0-9f0f-109e8b301cec'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:12.867932 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-7b24236f-bd19-44b0-9f0f-109e8b301cec admin admin] The token cache is being invalidate because project 72d72d9cbe934fe9b8ff224dbe273bbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 08:49:12.868288 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-7b24236f-bd19-44b0-9f0f-109e8b301cec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:12.870685 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-7b24236f-bd19-44b0-9f0f-109e8b301cec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:12.889628 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1031/2059] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 08:49:12 2022] DELETE /identity/v3/projects/72d72d9cbe934fe9b8ff224dbe273bbc => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:12.892216 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838b7bf-9826-4082-bf5d-70bd0715f917 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:12.892518 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838b7bf-9826-4082-bf5d-70bd0715f917 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:12.892814 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838b7bf-9826-4082-bf5d-70bd0715f917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:12.899348 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f05261e-22b3-46a4-a62a-2f767e638935 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:12.901048 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f05261e-22b3-46a4-a62a-2f767e638935 service cinder] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:12.914814 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1029/2060] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:49:12 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:49:12.916381 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e746d9-0a87-43c8-ba2a-a7ee68dfadf1 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:12.916715 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e746d9-0a87-43c8-ba2a-a7ee68dfadf1 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:12.917043 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e746d9-0a87-43c8-ba2a-a7ee68dfadf1 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:12.918546 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1030/2061] 10.222.0.42 () {54 vars in 921 bytes} [Wed Jun 22 08:49:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:49:12.930198 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3901c6e7-f85a-4615-9794-c172cfe6e64a None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:12.931410 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3901c6e7-f85a-4615-9794-c172cfe6e64a None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:12.931838 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3901c6e7-f85a-4615-9794-c172cfe6e64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:12.952418 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-b838b7bf-9826-4082-bf5d-70bd0715f917 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:12.953648 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-b838b7bf-9826-4082-bf5d-70bd0715f917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:12.996445 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-3901c6e7-f85a-4615-9794-c172cfe6e64a None None] MFA Rules not processed for user `4f1809a35b244c1db7a185d82859369e`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:13.005276 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-3901c6e7-f85a-4615-9794-c172cfe6e64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:13.113806 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1032/2062] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:13.121465 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b22b1cf-1720-43ed-9763-4c254ff118dd None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:13.121924 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b22b1cf-1720-43ed-9763-4c254ff118dd None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:13.122329 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b22b1cf-1720-43ed-9763-4c254ff118dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:13.168434 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-7b22b1cf-1720-43ed-9763-4c254ff118dd None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:13.170607 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-7b22b1cf-1720-43ed-9763-4c254ff118dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:13.176564 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:13.196422 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1033/2063] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:13.200121 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b22b1cf-1720-43ed-9763-4c254ff118dd None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:13.230385 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b22b1cf-1720-43ed-9763-4c254ff118dd None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:13.251318 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf61e3-4ea5-4782-9b56-5fa4cf60cad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:13.252008 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf61e3-4ea5-4782-9b56-5fa4cf60cad4 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:13.252359 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf61e3-4ea5-4782-9b56-5fa4cf60cad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:13.252793 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf61e3-4ea5-4782-9b56-5fa4cf60cad4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:13.253683 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaf61e3-4ea5-4782-9b56-5fa4cf60cad4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:13.253993 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaf61e3-4ea5-4782-9b56-5fa4cf60cad4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:13.255950 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaf61e3-4ea5-4782-9b56-5fa4cf60cad4 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:13.261530 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1031/2064] 10.222.0.42 () {58 vars in 1018 bytes} [Wed Jun 22 08:49:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:13.279297 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1034/2065] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Jun 22 08:49:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:13.283279 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3901c6e7-f85a-4615-9794-c172cfe6e64a None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:13.316811 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf61e3-4ea5-4782-9b56-5fa4cf60cad4 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:13.317903 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3901c6e7-f85a-4615-9794-c172cfe6e64a None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:13.318677 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-ebaf61e3-4ea5-4782-9b56-5fa4cf60cad4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:13.334883 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c9d0f9-c3a9-4311-a0ff-180c72df7a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:13.335619 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9d0f9-c3a9-4311-a0ff-180c72df7a9b admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:13.336673 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9d0f9-c3a9-4311-a0ff-180c72df7a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:13.336673 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9d0f9-c3a9-4311-a0ff-180c72df7a9b admin admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:13.337108 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c9d0f9-c3a9-4311-a0ff-180c72df7a9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:13.339147 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c9d0f9-c3a9-4311-a0ff-180c72df7a9b admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:13.348486 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf61e3-4ea5-4782-9b56-5fa4cf60cad4 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:13.365323 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b19be86-5015-4a22-bc8a-5e37d3aaf1fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f1809a35b244c1db7a185d82859369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:13.365868 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19be86-5015-4a22-bc8a-5e37d3aaf1fa service nova] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:13.367347 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19be86-5015-4a22-bc8a-5e37d3aaf1fa service nova] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:13.367347 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19be86-5015-4a22-bc8a-5e37d3aaf1fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:13.405177 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1032/2066] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 08:49:13 2022] POST /identity/v3/projects => generated 381 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:49:13.417678 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b19be86-5015-4a22-bc8a-5e37d3aaf1fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:13.419020 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c9d0f9-c3a9-4311-a0ff-180c72df7a9b admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:13.422736 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b19be86-5015-4a22-bc8a-5e37d3aaf1fa service nova] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:13.452533 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:13.468985 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1035/2067] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:49:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:49:13.617991 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c9d0f9-c3a9-4311-a0ff-180c72df7a9b admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:13.644297 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f03b787-cda1-4965-8070-dd5ef7d24160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:13.644404 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f03b787-cda1-4965-8070-dd5ef7d24160 admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:13.644603 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f03b787-cda1-4965-8070-dd5ef7d24160 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:13.644878 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f03b787-cda1-4965-8070-dd5ef7d24160 admin admin] PATH_INFO: `/v3/users` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:13.645589 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f03b787-cda1-4965-8070-dd5ef7d24160 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:13.647627 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f03b787-cda1-4965-8070-dd5ef7d24160 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:13.708478 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b19be86-5015-4a22-bc8a-5e37d3aaf1fa service nova] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:13.711776 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1033/2068] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 08:49:13 2022] POST /identity/v3/users => generated 291 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:49:13.733406 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b19be86-5015-4a22-bc8a-5e37d3aaf1fa service nova] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:13.743506 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be015b-20fd-4f87-a9b1-f21cba6d79cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:13.745201 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be015b-20fd-4f87-a9b1-f21cba6d79cc admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:13.745499 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be015b-20fd-4f87-a9b1-f21cba6d79cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:13.745819 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be015b-20fd-4f87-a9b1-f21cba6d79cc admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:13.748234 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be015b-20fd-4f87-a9b1-f21cba6d79cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:13.749996 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be015b-20fd-4f87-a9b1-f21cba6d79cc admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:13.777132 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1036/2069] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:49:13 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 08:49:13.780990 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f03b787-cda1-4965-8070-dd5ef7d24160 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:13.801123 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f03b787-cda1-4965-8070-dd5ef7d24160 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:13.814694 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c59b4-2686-4617-8f92-48bc43cbd06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:13.816157 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c59b4-2686-4617-8f92-48bc43cbd06a admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:13.816647 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c59b4-2686-4617-8f92-48bc43cbd06a admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:13.817092 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c59b4-2686-4617-8f92-48bc43cbd06a admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:13.818423 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0c59b4-2686-4617-8f92-48bc43cbd06a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:13.821656 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0c59b4-2686-4617-8f92-48bc43cbd06a admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:13.840006 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1034/2070] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:49:13 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:49:13.845492 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be015b-20fd-4f87-a9b1-f21cba6d79cc admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:13.855465 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be015b-20fd-4f87-a9b1-f21cba6d79cc admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:13.861020 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bbebda-291e-4685-80da-cc730603d3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:13.862096 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bbebda-291e-4685-80da-cc730603d3e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:13.862506 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bbebda-291e-4685-80da-cc730603d3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:13.862971 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bbebda-291e-4685-80da-cc730603d3e9 admin admin] PATH_INFO: `/v3/projects/b32d9c5859e9486aa2595207a002023d/users/dd26922794444479b873546a457253b1/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:13.889551 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bbebda-291e-4685-80da-cc730603d3e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b32d9c5859e9486aa2595207a002023d, user_id=dd26922794444479b873546a457253b1, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:13.890002 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bbebda-291e-4685-80da-cc730603d3e9 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:13.910399 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1037/2071] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:49:13 2022] PUT /identity/v3/projects/b32d9c5859e9486aa2595207a002023d/users/dd26922794444479b873546a457253b1/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:13.919265 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6904805-fae3-4400-9616-4b4625025361 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:13.919585 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6904805-fae3-4400-9616-4b4625025361 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:13.919865 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6904805-fae3-4400-9616-4b4625025361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:13.952559 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-d6904805-fae3-4400-9616-4b4625025361 None None] MFA Rules not processed for user `dd26922794444479b873546a457253b1`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:13.954597 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-d6904805-fae3-4400-9616-4b4625025361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:14.044622 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1035/2072] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:14.049660 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bbebda-291e-4685-80da-cc730603d3e9 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:14.151573 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bbebda-291e-4685-80da-cc730603d3e9 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:14.158795 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090537b0-c29f-400c-8471-da96e99cae4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:14.159501 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090537b0-c29f-400c-8471-da96e99cae4e admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:14.159778 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090537b0-c29f-400c-8471-da96e99cae4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:14.160065 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090537b0-c29f-400c-8471-da96e99cae4e admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:14.161199 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090537b0-c29f-400c-8471-da96e99cae4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:14.163176 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090537b0-c29f-400c-8471-da96e99cae4e admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:14.189254 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1038/2073] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 08:49:14 2022] POST /identity/v3/projects => generated 381 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:49:14.194170 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6904805-fae3-4400-9616-4b4625025361 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:14.204815 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6904805-fae3-4400-9616-4b4625025361 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:14.223349 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:14.264300 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5812b0-0eca-442d-9b16-78746048a973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:14.264982 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5812b0-0eca-442d-9b16-78746048a973 admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:14.265269 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5812b0-0eca-442d-9b16-78746048a973 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:14.265573 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5812b0-0eca-442d-9b16-78746048a973 admin admin] PATH_INFO: `/v3/users` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:14.266314 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5812b0-0eca-442d-9b16-78746048a973 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:14.268787 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5812b0-0eca-442d-9b16-78746048a973 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:14.288789 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1036/2074] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 08:49:14 2022] POST /identity/v3/users => generated 297 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:49:14.292697 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090537b0-c29f-400c-8471-da96e99cae4e admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:14.303927 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090537b0-c29f-400c-8471-da96e99cae4e admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:14.309071 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b02547-3b57-4fe2-90fe-cbe99e797a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:14.309742 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b02547-3b57-4fe2-90fe-cbe99e797a76 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:14.310022 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b02547-3b57-4fe2-90fe-cbe99e797a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:14.310330 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b02547-3b57-4fe2-90fe-cbe99e797a76 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:14.311090 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b02547-3b57-4fe2-90fe-cbe99e797a76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:14.312734 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b02547-3b57-4fe2-90fe-cbe99e797a76 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:14.324013 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1039/2075] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:49:14.328309 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5812b0-0eca-442d-9b16-78746048a973 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:14.338774 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5812b0-0eca-442d-9b16-78746048a973 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:14.343691 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b94213-743b-4091-940a-5580e4e5c814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:14.344596 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b94213-743b-4091-940a-5580e4e5c814 admin admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:14.344879 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b94213-743b-4091-940a-5580e4e5c814 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:14.345159 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b94213-743b-4091-940a-5580e4e5c814 admin admin] PATH_INFO: `/v3/projects/da0d6ddb7e914530ba6245769b1173e4/users/3ba713b070694142b711afe154ca29c7/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:14.360331 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b94213-743b-4091-940a-5580e4e5c814 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da0d6ddb7e914530ba6245769b1173e4, user_id=3ba713b070694142b711afe154ca29c7, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:14.363558 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b94213-743b-4091-940a-5580e4e5c814 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:14.377194 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1037/2076] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:49:14 2022] PUT /identity/v3/projects/da0d6ddb7e914530ba6245769b1173e4/users/3ba713b070694142b711afe154ca29c7/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:14.381930 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b02547-3b57-4fe2-90fe-cbe99e797a76 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:14.392632 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b02547-3b57-4fe2-90fe-cbe99e797a76 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:14.454089 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608af44d-c165-4040-b916-647981eace18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:14.454802 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608af44d-c165-4040-b916-647981eace18 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:14.455080 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608af44d-c165-4040-b916-647981eace18 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:14.455357 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608af44d-c165-4040-b916-647981eace18 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:14.456127 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608af44d-c165-4040-b916-647981eace18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:14.457721 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608af44d-c165-4040-b916-647981eace18 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:14.468216 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1040/2077] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:49:14.472389 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b94213-743b-4091-940a-5580e4e5c814 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:14.482660 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b94213-743b-4091-940a-5580e4e5c814 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:14.487806 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5808fc14-ee9d-47ac-894b-fd2164975a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:14.488683 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5808fc14-ee9d-47ac-894b-fd2164975a7a admin admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:14.488963 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5808fc14-ee9d-47ac-894b-fd2164975a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:14.489236 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5808fc14-ee9d-47ac-894b-fd2164975a7a admin admin] PATH_INFO: `/v3/projects/da0d6ddb7e914530ba6245769b1173e4/users/3ba713b070694142b711afe154ca29c7/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:14.491266 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5808fc14-ee9d-47ac-894b-fd2164975a7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=da0d6ddb7e914530ba6245769b1173e4, user_id=3ba713b070694142b711afe154ca29c7, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:14.493878 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5808fc14-ee9d-47ac-894b-fd2164975a7a admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:14.505435 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1038/2078] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:49:14 2022] PUT /identity/v3/projects/da0d6ddb7e914530ba6245769b1173e4/users/3ba713b070694142b711afe154ca29c7/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 08:49:14.515741 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4ad79-bb83-42e8-9020-65ad87d81fc9 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:14.516304 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4ad79-bb83-42e8-9020-65ad87d81fc9 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:14.516728 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4ad79-bb83-42e8-9020-65ad87d81fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:14.544154 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-7af4ad79-bb83-42e8-9020-65ad87d81fc9 None None] MFA Rules not processed for user `3ba713b070694142b711afe154ca29c7`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:14.545411 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-7af4ad79-bb83-42e8-9020-65ad87d81fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:14.571689 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:14.617028 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1041/2079] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:14 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:14.628666 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5808fc14-ee9d-47ac-894b-fd2164975a7a admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:14.630408 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-5808fc14-ee9d-47ac-894b-fd2164975a7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:14.687672 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5808fc14-ee9d-47ac-894b-fd2164975a7a admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:14.691334 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3b815a-8f1c-43df-8488-f2578f86622d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:14.691972 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3b815a-8f1c-43df-8488-f2578f86622d service cinder] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:14.692256 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3b815a-8f1c-43df-8488-f2578f86622d service cinder] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:14.692534 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3b815a-8f1c-43df-8488-f2578f86622d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:14.701647 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3b815a-8f1c-43df-8488-f2578f86622d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:14.703108 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3b815a-8f1c-43df-8488-f2578f86622d service cinder] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:14.712570 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1039/2080] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:49:14 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:49:15.130583 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af4ad79-bb83-42e8-9020-65ad87d81fc9 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:15.206852 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af4ad79-bb83-42e8-9020-65ad87d81fc9 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:15.211773 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f0f3d-40fe-4ea9-bff4-63bf6e74751a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:15.212699 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f0f3d-40fe-4ea9-bff4-63bf6e74751a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:15.213165 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f0f3d-40fe-4ea9-bff4-63bf6e74751a admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:15.213273 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f0f3d-40fe-4ea9-bff4-63bf6e74751a admin admin] PATH_INFO: `/v3/users/dd26922794444479b873546a457253b1` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:15.214473 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f0f3d-40fe-4ea9-bff4-63bf6e74751a admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd26922794444479b873546a457253b1)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:15.217811 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f0f3d-40fe-4ea9-bff4-63bf6e74751a admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:15.287409 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-5c9f0f3d-40fe-4ea9-bff4-63bf6e74751a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd26922794444479b873546a457253b1'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:15.294397 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-5c9f0f3d-40fe-4ea9-bff4-63bf6e74751a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd26922794444479b873546a457253b1'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:15.295116 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-5c9f0f3d-40fe-4ea9-bff4-63bf6e74751a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd26922794444479b873546a457253b1'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:15.302246 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-5c9f0f3d-40fe-4ea9-bff4-63bf6e74751a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd26922794444479b873546a457253b1'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:15.302919 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-5c9f0f3d-40fe-4ea9-bff4-63bf6e74751a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd26922794444479b873546a457253b1'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:15.320823 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1042/2081] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 08:49:15 2022] DELETE /identity/v3/users/dd26922794444479b873546a457253b1 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:15.325395 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1108b0f-bba6-4ffa-a128-b1f65640176f None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:15.325691 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1108b0f-bba6-4ffa-a128-b1f65640176f None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:15.326152 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1108b0f-bba6-4ffa-a128-b1f65640176f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:15.344938 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-a1108b0f-bba6-4ffa-a128-b1f65640176f None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:15.346170 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-a1108b0f-bba6-4ffa-a128-b1f65640176f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:15.404811 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1040/2082] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:15.414420 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f0f3d-40fe-4ea9-bff4-63bf6e74751a admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:15.415803 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-5c9f0f3d-40fe-4ea9-bff4-63bf6e74751a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:15.459947 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:15.476400 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f0f3d-40fe-4ea9-bff4-63bf6e74751a admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:15.480068 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8156dd-0986-4770-b20e-9421bae3ef26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:15.480714 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8156dd-0986-4770-b20e-9421bae3ef26 service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:15.481000 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8156dd-0986-4770-b20e-9421bae3ef26 service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:15.481451 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8156dd-0986-4770-b20e-9421bae3ef26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:15.491220 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8156dd-0986-4770-b20e-9421bae3ef26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:15.492659 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8156dd-0986-4770-b20e-9421bae3ef26 service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:15.502374 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1043/2083] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:49:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:49:16.038577 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1108b0f-bba6-4ffa-a128-b1f65640176f None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:16.040080 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-a1108b0f-bba6-4ffa-a128-b1f65640176f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:16.054377 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1108b0f-bba6-4ffa-a128-b1f65640176f None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:16.059388 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d1d228-4f35-4783-a138-ccd6918d56d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:16.060326 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d1d228-4f35-4783-a138-ccd6918d56d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:16.060676 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d1d228-4f35-4783-a138-ccd6918d56d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:16.061024 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d1d228-4f35-4783-a138-ccd6918d56d3 admin admin] PATH_INFO: `/v3/projects/b32d9c5859e9486aa2595207a002023d` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:16.062356 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d1d228-4f35-4783-a138-ccd6918d56d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b32d9c5859e9486aa2595207a002023d)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:16.064671 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d1d228-4f35-4783-a138-ccd6918d56d3 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:16.080342 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:16.133710 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-33d1d228-4f35-4783-a138-ccd6918d56d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b32d9c5859e9486aa2595207a002023d', 'request_id': 'req-33d1d228-4f35-4783-a138-ccd6918d56d3'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:16.142113 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-33d1d228-4f35-4783-a138-ccd6918d56d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b32d9c5859e9486aa2595207a002023d', 'request_id': 'req-33d1d228-4f35-4783-a138-ccd6918d56d3'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:16.148850 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-33d1d228-4f35-4783-a138-ccd6918d56d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b32d9c5859e9486aa2595207a002023d', 'request_id': 'req-33d1d228-4f35-4783-a138-ccd6918d56d3'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:16.164782 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-33d1d228-4f35-4783-a138-ccd6918d56d3 admin admin] The token cache is being invalidate because project b32d9c5859e9486aa2595207a002023d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 08:49:16.165073 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-33d1d228-4f35-4783-a138-ccd6918d56d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:16.166188 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-33d1d228-4f35-4783-a138-ccd6918d56d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:16.169418 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1041/2084] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 08:49:16 2022] DELETE /identity/v3/projects/b32d9c5859e9486aa2595207a002023d => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:16.174029 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8156dd-0986-4770-b20e-9421bae3ef26 service neutron] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:16.187902 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8156dd-0986-4770-b20e-9421bae3ef26 service neutron] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:16.245099 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc1a437-6b36-4a61-9ff9-99dd6c413991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:16.245994 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1a437-6b36-4a61-9ff9-99dd6c413991 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:16.246279 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1a437-6b36-4a61-9ff9-99dd6c413991 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:16.252527 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1a437-6b36-4a61-9ff9-99dd6c413991 admin admin] PATH_INFO: `/v3/users/3ba713b070694142b711afe154ca29c7` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:16.252527 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc1a437-6b36-4a61-9ff9-99dd6c413991 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ba713b070694142b711afe154ca29c7)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:16.252527 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc1a437-6b36-4a61-9ff9-99dd6c413991 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:16.309009 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-0cc1a437-6b36-4a61-9ff9-99dd6c413991 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ba713b070694142b711afe154ca29c7'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:16.316139 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-0cc1a437-6b36-4a61-9ff9-99dd6c413991 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ba713b070694142b711afe154ca29c7'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:16.316821 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-0cc1a437-6b36-4a61-9ff9-99dd6c413991 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ba713b070694142b711afe154ca29c7'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:16.324475 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-0cc1a437-6b36-4a61-9ff9-99dd6c413991 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ba713b070694142b711afe154ca29c7'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:16.325210 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-0cc1a437-6b36-4a61-9ff9-99dd6c413991 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ba713b070694142b711afe154ca29c7'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:16.343234 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1044/2085] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 08:49:16 2022] DELETE /identity/v3/users/3ba713b070694142b711afe154ca29c7 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:16.613539 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d1d228-4f35-4783-a138-ccd6918d56d3 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:16.615010 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-33d1d228-4f35-4783-a138-ccd6918d56d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:16.627875 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d1d228-4f35-4783-a138-ccd6918d56d3 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:16.692358 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2365a754-b6e1-4855-aa99-c2587c219b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:16.693134 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365a754-b6e1-4855-aa99-c2587c219b3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:16.693414 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365a754-b6e1-4855-aa99-c2587c219b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:16.693686 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365a754-b6e1-4855-aa99-c2587c219b3d admin admin] PATH_INFO: `/v3/projects/da0d6ddb7e914530ba6245769b1173e4` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:16.695010 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2365a754-b6e1-4855-aa99-c2587c219b3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=da0d6ddb7e914530ba6245769b1173e4)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:16.697127 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2365a754-b6e1-4855-aa99-c2587c219b3d admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:16.747487 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-2365a754-b6e1-4855-aa99-c2587c219b3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da0d6ddb7e914530ba6245769b1173e4', 'request_id': 'req-2365a754-b6e1-4855-aa99-c2587c219b3d'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:16.753247 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-2365a754-b6e1-4855-aa99-c2587c219b3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da0d6ddb7e914530ba6245769b1173e4', 'request_id': 'req-2365a754-b6e1-4855-aa99-c2587c219b3d'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:16.759585 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-2365a754-b6e1-4855-aa99-c2587c219b3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da0d6ddb7e914530ba6245769b1173e4', 'request_id': 'req-2365a754-b6e1-4855-aa99-c2587c219b3d'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:16.773474 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-2365a754-b6e1-4855-aa99-c2587c219b3d admin admin] The token cache is being invalidate because project da0d6ddb7e914530ba6245769b1173e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 08:49:16.773764 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-2365a754-b6e1-4855-aa99-c2587c219b3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:16.774406 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-2365a754-b6e1-4855-aa99-c2587c219b3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:16.775980 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1042/2086] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 08:49:16 2022] DELETE /identity/v3/projects/da0d6ddb7e914530ba6245769b1173e4 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:16.780707 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e525a-9ebc-445f-984d-bf2786597edd None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:16.780996 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e525a-9ebc-445f-984d-bf2786597edd None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:16.781302 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e525a-9ebc-445f-984d-bf2786597edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:16.801197 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-1d4e525a-9ebc-445f-984d-bf2786597edd None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:16.802463 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-1d4e525a-9ebc-445f-984d-bf2786597edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:16.867316 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1045/2087] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 08:49:16.876004 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09990cf-8a6e-4b2d-8db8-b46ee34f1671 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:16.876297 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09990cf-8a6e-4b2d-8db8-b46ee34f1671 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:16.876579 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09990cf-8a6e-4b2d-8db8-b46ee34f1671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:16.896084 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-d09990cf-8a6e-4b2d-8db8-b46ee34f1671 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:16.897309 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-d09990cf-8a6e-4b2d-8db8-b46ee34f1671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:16.905541 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1043/2088] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:16.910063 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e525a-9ebc-445f-984d-bf2786597edd None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:16.915423 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:16.921659 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e525a-9ebc-445f-984d-bf2786597edd None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:16.927444 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de66e9-67f6-479b-90f8-ecb11b50856f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:16.928097 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de66e9-67f6-479b-90f8-ecb11b50856f admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:16.928379 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de66e9-67f6-479b-90f8-ecb11b50856f admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:16.928654 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de66e9-67f6-479b-90f8-ecb11b50856f admin admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:16.929412 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8de66e9-67f6-479b-90f8-ecb11b50856f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:16.929719 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8de66e9-67f6-479b-90f8-ecb11b50856f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:16.931368 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8de66e9-67f6-479b-90f8-ecb11b50856f admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:16.944455 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1046/2089] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Jun 22 08:49:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:49:16.948991 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09990cf-8a6e-4b2d-8db8-b46ee34f1671 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:16.959031 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09990cf-8a6e-4b2d-8db8-b46ee34f1671 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:16.963692 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce485e4b-908b-4d45-aa23-af7c9408a7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:16.964340 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce485e4b-908b-4d45-aa23-af7c9408a7ef admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:16.964626 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce485e4b-908b-4d45-aa23-af7c9408a7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:16.964907 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce485e4b-908b-4d45-aa23-af7c9408a7ef admin admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:16.965613 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce485e4b-908b-4d45-aa23-af7c9408a7ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:16.967580 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce485e4b-908b-4d45-aa23-af7c9408a7ef admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:16.992184 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1044/2090] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 08:49:16 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 08:49:16.996326 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de66e9-67f6-479b-90f8-ecb11b50856f admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:17.006883 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de66e9-67f6-479b-90f8-ecb11b50856f admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:17.068852 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51cbabc-2e45-4eea-8f59-3f25f4ed0323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:17.069637 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51cbabc-2e45-4eea-8f59-3f25f4ed0323 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:17.069995 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51cbabc-2e45-4eea-8f59-3f25f4ed0323 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:17.070389 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51cbabc-2e45-4eea-8f59-3f25f4ed0323 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:17.071184 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51cbabc-2e45-4eea-8f59-3f25f4ed0323 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:17.073251 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51cbabc-2e45-4eea-8f59-3f25f4ed0323 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:17.099478 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1047/2091] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 08:49:16 2022] POST /identity/v3/users => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:49:17.103589 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce485e4b-908b-4d45-aa23-af7c9408a7ef admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:17.109444 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:17.116172 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce485e4b-908b-4d45-aa23-af7c9408a7ef admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:17.122826 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e2b719-5494-4bc9-b146-49215e9bea0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:17.123645 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e2b719-5494-4bc9-b146-49215e9bea0f admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:17.124044 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e2b719-5494-4bc9-b146-49215e9bea0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:17.124422 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e2b719-5494-4bc9-b146-49215e9bea0f admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:17.125478 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e2b719-5494-4bc9-b146-49215e9bea0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:17.128480 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e2b719-5494-4bc9-b146-49215e9bea0f admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:17.141101 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1045/2092] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:49:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:49:17.145779 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51cbabc-2e45-4eea-8f59-3f25f4ed0323 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:17.157659 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51cbabc-2e45-4eea-8f59-3f25f4ed0323 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:17.163188 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8de533-7be2-46e8-986f-31c170620f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:17.163877 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8de533-7be2-46e8-986f-31c170620f32 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:17.164162 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8de533-7be2-46e8-986f-31c170620f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:17.164440 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8de533-7be2-46e8-986f-31c170620f32 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:17.165176 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8de533-7be2-46e8-986f-31c170620f32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:17.166894 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8de533-7be2-46e8-986f-31c170620f32 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:17.177844 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1048/2093] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:49:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:49:17.183648 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e2b719-5494-4bc9-b146-49215e9bea0f admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:17.195910 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e2b719-5494-4bc9-b146-49215e9bea0f admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:17.208320 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74db6b07-87bd-4878-afd5-120fe164311c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:17.209623 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db6b07-87bd-4878-afd5-120fe164311c admin admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:17.209905 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db6b07-87bd-4878-afd5-120fe164311c admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:17.210255 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db6b07-87bd-4878-afd5-120fe164311c admin admin] PATH_INFO: `/v3/projects/75e0599d853b4867a5c0465bb285cd2a/users/ddb8ebfc16fb47608d36052d397a167a/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:17.229084 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74db6b07-87bd-4878-afd5-120fe164311c admin admin] RBAC: Authorizing `identity:create_grant(project_id=75e0599d853b4867a5c0465bb285cd2a, user_id=ddb8ebfc16fb47608d36052d397a167a, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:17.235619 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74db6b07-87bd-4878-afd5-120fe164311c admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:17.267151 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1046/2094] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:49:17 2022] PUT /identity/v3/projects/75e0599d853b4867a5c0465bb285cd2a/users/ddb8ebfc16fb47608d36052d397a167a/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 08:49:17.273176 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71447e-e26c-4f1e-9bd8-3ae3687d51f4 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:17.273565 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71447e-e26c-4f1e-9bd8-3ae3687d51f4 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:17.274019 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71447e-e26c-4f1e-9bd8-3ae3687d51f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:17.299819 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-ca71447e-e26c-4f1e-9bd8-3ae3687d51f4 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:17.301355 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-ca71447e-e26c-4f1e-9bd8-3ae3687d51f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:17.414902 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1049/2095] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:17.431678 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74db6b07-87bd-4878-afd5-120fe164311c admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:17.431678 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-74db6b07-87bd-4878-afd5-120fe164311c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:17.484471 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74db6b07-87bd-4878-afd5-120fe164311c admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:17.488033 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d2f6c1-0c57-4bdd-b86a-d74722690ac5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:17.488681 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2f6c1-0c57-4bdd-b86a-d74722690ac5 service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:17.488962 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2f6c1-0c57-4bdd-b86a-d74722690ac5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:17.489235 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2f6c1-0c57-4bdd-b86a-d74722690ac5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:17.498359 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d2f6c1-0c57-4bdd-b86a-d74722690ac5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:17.499786 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d2f6c1-0c57-4bdd-b86a-d74722690ac5 service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:17.509413 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1047/2096] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:49:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:49:18.207631 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157f699-b57e-4950-8a8d-dd04067de672 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:18.208170 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157f699-b57e-4950-8a8d-dd04067de672 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:18.208170 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157f699-b57e-4950-8a8d-dd04067de672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:18.240225 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-9157f699-b57e-4950-8a8d-dd04067de672 None None] MFA Rules not processed for user `ddb8ebfc16fb47608d36052d397a167a`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:18.241481 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-9157f699-b57e-4950-8a8d-dd04067de672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:18.326759 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:18.334310 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1050/2097] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:18.337910 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d2f6c1-0c57-4bdd-b86a-d74722690ac5 service neutron] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:18.347877 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d2f6c1-0c57-4bdd-b86a-d74722690ac5 service neutron] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:18.352692 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b010b8e4-fa80-4bca-9746-97ae644d1df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:18.353429 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010b8e4-fa80-4bca-9746-97ae644d1df0 admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:18.353771 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010b8e4-fa80-4bca-9746-97ae644d1df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:18.354148 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010b8e4-fa80-4bca-9746-97ae644d1df0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:18.354914 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b010b8e4-fa80-4bca-9746-97ae644d1df0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:18.356920 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b010b8e4-fa80-4bca-9746-97ae644d1df0 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:18.411185 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1048/2098] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 08:49:18 2022] POST /identity/v3/projects => generated 371 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:49:18.414817 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9157f699-b57e-4950-8a8d-dd04067de672 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:18.431711 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9157f699-b57e-4950-8a8d-dd04067de672 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:18.513995 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149f7c26-05fe-4018-8acb-254cd6dedc09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:18.514704 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f7c26-05fe-4018-8acb-254cd6dedc09 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:18.514986 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f7c26-05fe-4018-8acb-254cd6dedc09 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:18.515261 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f7c26-05fe-4018-8acb-254cd6dedc09 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:18.515961 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149f7c26-05fe-4018-8acb-254cd6dedc09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:18.517899 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149f7c26-05fe-4018-8acb-254cd6dedc09 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:18.538736 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1051/2099] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 08:49:18 2022] POST /identity/v3/users => generated 292 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:49:18.542694 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b010b8e4-fa80-4bca-9746-97ae644d1df0 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:18.553500 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b010b8e4-fa80-4bca-9746-97ae644d1df0 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:18.558026 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d0182-07ab-4bee-840c-0b7721ce4863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:18.558707 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d0182-07ab-4bee-840c-0b7721ce4863 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:18.558981 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d0182-07ab-4bee-840c-0b7721ce4863 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:18.559259 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d0182-07ab-4bee-840c-0b7721ce4863 admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:18.559983 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14d0182-07ab-4bee-840c-0b7721ce4863 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:18.561564 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14d0182-07ab-4bee-840c-0b7721ce4863 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:18.572652 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1049/2100] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:49:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 08:49:18.576674 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149f7c26-05fe-4018-8acb-254cd6dedc09 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:18.586840 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149f7c26-05fe-4018-8acb-254cd6dedc09 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:18.591909 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b2204d-a488-45b7-aa4a-434bbcd41c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:18.592902 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2204d-a488-45b7-aa4a-434bbcd41c3d admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:18.593334 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2204d-a488-45b7-aa4a-434bbcd41c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:18.593654 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2204d-a488-45b7-aa4a-434bbcd41c3d admin admin] PATH_INFO: `/v3/projects/88708cce1597417badaa792d27b4a19b/users/55d6c2a0388c4b4d9ed5b666a1bf107c/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:18.609051 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b2204d-a488-45b7-aa4a-434bbcd41c3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=88708cce1597417badaa792d27b4a19b, user_id=55d6c2a0388c4b4d9ed5b666a1bf107c, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:18.611816 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b2204d-a488-45b7-aa4a-434bbcd41c3d admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:18.625134 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1052/2101] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:49:18 2022] PUT /identity/v3/projects/88708cce1597417badaa792d27b4a19b/users/55d6c2a0388c4b4d9ed5b666a1bf107c/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:18.629051 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d0182-07ab-4bee-840c-0b7721ce4863 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:18.639412 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d0182-07ab-4bee-840c-0b7721ce4863 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:18.698361 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d95030-0cd8-46b0-b6c7-31b97f705002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:18.699031 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d95030-0cd8-46b0-b6c7-31b97f705002 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:18.699317 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d95030-0cd8-46b0-b6c7-31b97f705002 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:18.699595 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d95030-0cd8-46b0-b6c7-31b97f705002 admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:18.700322 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d95030-0cd8-46b0-b6c7-31b97f705002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:18.701945 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d95030-0cd8-46b0-b6c7-31b97f705002 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:18.712517 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1050/2102] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:49:18 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:49:18.716678 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b2204d-a488-45b7-aa4a-434bbcd41c3d admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:18.726984 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b2204d-a488-45b7-aa4a-434bbcd41c3d admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:18.731566 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd621486-38b7-404d-8075-5a18cce86335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:18.732444 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd621486-38b7-404d-8075-5a18cce86335 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:18.732726 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd621486-38b7-404d-8075-5a18cce86335 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:18.733003 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd621486-38b7-404d-8075-5a18cce86335 admin admin] PATH_INFO: `/v3/projects/88708cce1597417badaa792d27b4a19b/users/55d6c2a0388c4b4d9ed5b666a1bf107c/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:18.734994 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd621486-38b7-404d-8075-5a18cce86335 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88708cce1597417badaa792d27b4a19b, user_id=55d6c2a0388c4b4d9ed5b666a1bf107c, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:18.737641 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd621486-38b7-404d-8075-5a18cce86335 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:18.747805 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1053/2103] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:49:18 2022] PUT /identity/v3/projects/88708cce1597417badaa792d27b4a19b/users/55d6c2a0388c4b4d9ed5b666a1bf107c/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:19.479392 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd367f-c4fe-42d2-a8b7-41fdcb6b2a33 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:19.479886 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd367f-c4fe-42d2-a8b7-41fdcb6b2a33 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:19.480023 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd367f-c4fe-42d2-a8b7-41fdcb6b2a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:19.525411 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-90fd367f-c4fe-42d2-a8b7-41fdcb6b2a33 None None] MFA Rules not processed for user `55d6c2a0388c4b4d9ed5b666a1bf107c`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:19.526770 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-90fd367f-c4fe-42d2-a8b7-41fdcb6b2a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:19.549363 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:19.617728 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1051/2104] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:19 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:19.642309 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd621486-38b7-404d-8075-5a18cce86335 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:19.648375 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-cd621486-38b7-404d-8075-5a18cce86335 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:19.712847 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd621486-38b7-404d-8075-5a18cce86335 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:19.717134 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ee2f1e-5c4c-4973-bf2e-952b8fcbcd57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:19.718059 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee2f1e-5c4c-4973-bf2e-952b8fcbcd57 service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:19.718380 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee2f1e-5c4c-4973-bf2e-952b8fcbcd57 service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:19.718663 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee2f1e-5c4c-4973-bf2e-952b8fcbcd57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:19.790953 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ee2f1e-5c4c-4973-bf2e-952b8fcbcd57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:19.792427 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ee2f1e-5c4c-4973-bf2e-952b8fcbcd57 service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:19.804523 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1054/2105] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:49:19 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:49:24.354232 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd367f-c4fe-42d2-a8b7-41fdcb6b2a33 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:24.355945 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-90fd367f-c4fe-42d2-a8b7-41fdcb6b2a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:24.371816 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd367f-c4fe-42d2-a8b7-41fdcb6b2a33 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:24.375719 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20725195-a02e-482e-a447-641c1317e903 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:24.376378 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20725195-a02e-482e-a447-641c1317e903 service cinder] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:24.376666 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20725195-a02e-482e-a447-641c1317e903 service cinder] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:24.376948 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20725195-a02e-482e-a447-641c1317e903 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:24.392871 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20725195-a02e-482e-a447-641c1317e903 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:24.395158 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20725195-a02e-482e-a447-641c1317e903 service cinder] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:24.406732 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1052/2106] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:49:24 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:49:24.752981 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ee2f1e-5c4c-4973-bf2e-952b8fcbcd57 service cinder] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:24.755398 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-d9ee2f1e-5c4c-4973-bf2e-952b8fcbcd57 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:24.764332 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:24.860510 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ee2f1e-5c4c-4973-bf2e-952b8fcbcd57 service cinder] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:24.867951 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e3427-8cc3-4243-a9f0-d7cf2fb734c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:24.868917 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e3427-8cc3-4243-a9f0-d7cf2fb734c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:24.869391 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e3427-8cc3-4243-a9f0-d7cf2fb734c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:24.869710 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e3427-8cc3-4243-a9f0-d7cf2fb734c1 admin admin] PATH_INFO: `/v3/users/3a496c0da8b24928b36d0c37b7599af1` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:24.871145 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435e3427-8cc3-4243-a9f0-d7cf2fb734c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a496c0da8b24928b36d0c37b7599af1)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:24.873558 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435e3427-8cc3-4243-a9f0-d7cf2fb734c1 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:24.927441 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-435e3427-8cc3-4243-a9f0-d7cf2fb734c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a496c0da8b24928b36d0c37b7599af1'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:24.936555 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-435e3427-8cc3-4243-a9f0-d7cf2fb734c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a496c0da8b24928b36d0c37b7599af1'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:24.937602 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-435e3427-8cc3-4243-a9f0-d7cf2fb734c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a496c0da8b24928b36d0c37b7599af1'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:24.948859 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-435e3427-8cc3-4243-a9f0-d7cf2fb734c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a496c0da8b24928b36d0c37b7599af1'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:24.949842 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-435e3427-8cc3-4243-a9f0-d7cf2fb734c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a496c0da8b24928b36d0c37b7599af1'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:24.971978 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1055/2107] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 08:49:24 2022] DELETE /identity/v3/users/3a496c0da8b24928b36d0c37b7599af1 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:24.976559 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd8777-bda3-4c28-9cb6-33e8c9918fad None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:24.976886 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd8777-bda3-4c28-9cb6-33e8c9918fad None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:24.977191 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd8777-bda3-4c28-9cb6-33e8c9918fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:24.996505 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-5bdd8777-bda3-4c28-9cb6-33e8c9918fad None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:24.997717 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-5bdd8777-bda3-4c28-9cb6-33e8c9918fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:25.063065 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1053/2108] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:25.073280 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e3427-8cc3-4243-a9f0-d7cf2fb734c1 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:25.074720 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-435e3427-8cc3-4243-a9f0-d7cf2fb734c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:25.134573 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e3427-8cc3-4243-a9f0-d7cf2fb734c1 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:25.139062 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d8c9db-54b2-4f71-80e2-465343c20dea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:25.139714 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8c9db-54b2-4f71-80e2-465343c20dea service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:25.140537 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8c9db-54b2-4f71-80e2-465343c20dea service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:25.140537 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8c9db-54b2-4f71-80e2-465343c20dea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:25.151178 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d8c9db-54b2-4f71-80e2-465343c20dea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:25.152620 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d8c9db-54b2-4f71-80e2-465343c20dea service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:25.162898 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1056/2109] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:49:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:49:25.512492 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd8777-bda3-4c28-9cb6-33e8c9918fad None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:25.514039 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-5bdd8777-bda3-4c28-9cb6-33e8c9918fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:25.527989 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd8777-bda3-4c28-9cb6-33e8c9918fad None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:25.538502 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1fc370-6631-4de7-9728-b1ca3e96bd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:25.539798 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1fc370-6631-4de7-9728-b1ca3e96bd99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:25.540231 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1fc370-6631-4de7-9728-b1ca3e96bd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:25.540513 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1fc370-6631-4de7-9728-b1ca3e96bd99 admin admin] PATH_INFO: `/v3/projects/517954fc82ab432eb6b3b0fff0c58fc2` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:25.541751 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1fc370-6631-4de7-9728-b1ca3e96bd99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=517954fc82ab432eb6b3b0fff0c58fc2)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:25.543813 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1fc370-6631-4de7-9728-b1ca3e96bd99 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:25.603714 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-ea1fc370-6631-4de7-9728-b1ca3e96bd99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '517954fc82ab432eb6b3b0fff0c58fc2', 'request_id': 'req-ea1fc370-6631-4de7-9728-b1ca3e96bd99'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:25.609621 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-ea1fc370-6631-4de7-9728-b1ca3e96bd99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '517954fc82ab432eb6b3b0fff0c58fc2', 'request_id': 'req-ea1fc370-6631-4de7-9728-b1ca3e96bd99'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:25.616799 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-ea1fc370-6631-4de7-9728-b1ca3e96bd99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '517954fc82ab432eb6b3b0fff0c58fc2', 'request_id': 'req-ea1fc370-6631-4de7-9728-b1ca3e96bd99'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:25.629999 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-ea1fc370-6631-4de7-9728-b1ca3e96bd99 admin admin] The token cache is being invalidate because project 517954fc82ab432eb6b3b0fff0c58fc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 08:49:25.630335 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-ea1fc370-6631-4de7-9728-b1ca3e96bd99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:25.630960 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-ea1fc370-6631-4de7-9728-b1ca3e96bd99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:25.632531 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1054/2110] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 08:49:25 2022] DELETE /identity/v3/projects/517954fc82ab432eb6b3b0fff0c58fc2 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:25.637746 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdab608-df47-4bd5-a564-576a6628b0be None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:25.638165 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdab608-df47-4bd5-a564-576a6628b0be None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:25.638491 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdab608-df47-4bd5-a564-576a6628b0be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:25.656096 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-fcdab608-df47-4bd5-a564-576a6628b0be None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:25.657306 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-fcdab608-df47-4bd5-a564-576a6628b0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:25.681484 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:25.738772 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1057/2111] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:25.746230 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a994ee-9ad0-41c5-9315-3aa3ac901bfb None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:25.746736 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a994ee-9ad0-41c5-9315-3aa3ac901bfb None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:25.747183 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a994ee-9ad0-41c5-9315-3aa3ac901bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:25.769960 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-85a994ee-9ad0-41c5-9315-3aa3ac901bfb None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:25.771695 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-85a994ee-9ad0-41c5-9315-3aa3ac901bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:25.781163 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1055/2112] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:25.785510 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdab608-df47-4bd5-a564-576a6628b0be None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:25.796271 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdab608-df47-4bd5-a564-576a6628b0be None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:25.801712 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ff02c-597c-4bc8-9fff-aa4dff60f4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:25.802416 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ff02c-597c-4bc8-9fff-aa4dff60f4b9 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:25.802840 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ff02c-597c-4bc8-9fff-aa4dff60f4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:25.803124 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ff02c-597c-4bc8-9fff-aa4dff60f4b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:25.803865 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9ff02c-597c-4bc8-9fff-aa4dff60f4b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:25.804180 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9ff02c-597c-4bc8-9fff-aa4dff60f4b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:25.805791 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9ff02c-597c-4bc8-9fff-aa4dff60f4b9 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:25.822282 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1058/2113] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Jun 22 08:49:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:25.823702 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a994ee-9ad0-41c5-9315-3aa3ac901bfb None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:25.833243 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a994ee-9ad0-41c5-9315-3aa3ac901bfb None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:25.838182 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff03fdb-5ecd-46a6-9ea4-72e6f0c1150b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:25.838911 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff03fdb-5ecd-46a6-9ea4-72e6f0c1150b admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:25.839265 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff03fdb-5ecd-46a6-9ea4-72e6f0c1150b admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:25.839612 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff03fdb-5ecd-46a6-9ea4-72e6f0c1150b admin admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:25.840389 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff03fdb-5ecd-46a6-9ea4-72e6f0c1150b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:25.843800 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff03fdb-5ecd-46a6-9ea4-72e6f0c1150b admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:25.872528 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:25.883199 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1056/2114] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 08:49:25 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:49:25.889759 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ff02c-597c-4bc8-9fff-aa4dff60f4b9 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:25.902436 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ff02c-597c-4bc8-9fff-aa4dff60f4b9 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:26.031393 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f91ee-c442-4fb0-938c-0b8c87d025b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:26.032081 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f91ee-c442-4fb0-938c-0b8c87d025b1 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:26.032366 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f91ee-c442-4fb0-938c-0b8c87d025b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:26.032699 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f91ee-c442-4fb0-938c-0b8c87d025b1 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:26.035538 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f91ee-c442-4fb0-938c-0b8c87d025b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:26.038205 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f91ee-c442-4fb0-938c-0b8c87d025b1 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:26.067407 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1059/2115] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 08:49:25 2022] POST /identity/v3/users => generated 287 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:49:26.071621 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff03fdb-5ecd-46a6-9ea4-72e6f0c1150b admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:26.092699 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff03fdb-5ecd-46a6-9ea4-72e6f0c1150b admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:26.098376 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3361a46a-1bd8-406f-a2b0-a423f4d53401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:26.099053 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3361a46a-1bd8-406f-a2b0-a423f4d53401 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:26.099339 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3361a46a-1bd8-406f-a2b0-a423f4d53401 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:26.099625 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3361a46a-1bd8-406f-a2b0-a423f4d53401 admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:26.100378 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3361a46a-1bd8-406f-a2b0-a423f4d53401 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:26.102007 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3361a46a-1bd8-406f-a2b0-a423f4d53401 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:26.113789 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1057/2116] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:49:26 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:49:26.117946 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f91ee-c442-4fb0-938c-0b8c87d025b1 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:26.128887 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f91ee-c442-4fb0-938c-0b8c87d025b1 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:26.134506 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf55175-ba0a-490d-bc54-82cf7506b158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:26.136091 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf55175-ba0a-490d-bc54-82cf7506b158 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:26.136382 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf55175-ba0a-490d-bc54-82cf7506b158 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:26.136665 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf55175-ba0a-490d-bc54-82cf7506b158 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:26.137402 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf55175-ba0a-490d-bc54-82cf7506b158 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:26.139080 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf55175-ba0a-490d-bc54-82cf7506b158 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:26.150605 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1060/2117] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:49:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 08:49:26.154741 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3361a46a-1bd8-406f-a2b0-a423f4d53401 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:26.165286 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3361a46a-1bd8-406f-a2b0-a423f4d53401 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:26.170217 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f5419-5120-4e75-947c-cca3ca413a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:26.171121 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f5419-5120-4e75-947c-cca3ca413a48 admin admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:26.171407 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f5419-5120-4e75-947c-cca3ca413a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:26.171685 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f5419-5120-4e75-947c-cca3ca413a48 admin admin] PATH_INFO: `/v3/projects/731340b5aab543259b1721769224f56b/users/325add9a32ee4f66998c62fec214fd3e/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:26.186428 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5f5419-5120-4e75-947c-cca3ca413a48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=731340b5aab543259b1721769224f56b, user_id=325add9a32ee4f66998c62fec214fd3e, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:26.189095 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5f5419-5120-4e75-947c-cca3ca413a48 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:26.205821 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1058/2118] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:49:26 2022] PUT /identity/v3/projects/731340b5aab543259b1721769224f56b/users/325add9a32ee4f66998c62fec214fd3e/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:26.216113 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937fe886-11c1-4cc2-bd7a-c9d3be1be73a None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:26.216389 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937fe886-11c1-4cc2-bd7a-c9d3be1be73a None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:26.216668 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937fe886-11c1-4cc2-bd7a-c9d3be1be73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:26.243585 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-937fe886-11c1-4cc2-bd7a-c9d3be1be73a None None] MFA Rules not processed for user `325add9a32ee4f66998c62fec214fd3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:26.244812 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-937fe886-11c1-4cc2-bd7a-c9d3be1be73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:26.315315 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1061/2119] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:26.327359 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f5419-5120-4e75-947c-cca3ca413a48 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:26.329170 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-ba5f5419-5120-4e75-947c-cca3ca413a48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:26.386448 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f5419-5120-4e75-947c-cca3ca413a48 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:26.390055 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e7b980-60cc-4ffe-9f98-08765f6e0737 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:26.390719 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7b980-60cc-4ffe-9f98-08765f6e0737 service cinder] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:26.391007 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7b980-60cc-4ffe-9f98-08765f6e0737 service cinder] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:26.391275 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7b980-60cc-4ffe-9f98-08765f6e0737 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:26.400428 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e7b980-60cc-4ffe-9f98-08765f6e0737 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:26.401861 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e7b980-60cc-4ffe-9f98-08765f6e0737 service cinder] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:26.412581 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1059/2120] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:49:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:49:26.441881 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937fe886-11c1-4cc2-bd7a-c9d3be1be73a None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:26.466623 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:26.505597 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937fe886-11c1-4cc2-bd7a-c9d3be1be73a None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:26.510146 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060e0cc9-1cf1-46cb-af6b-b10c76dd5ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:26.511282 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e0cc9-1cf1-46cb-af6b-b10c76dd5ad4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:26.511555 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e0cc9-1cf1-46cb-af6b-b10c76dd5ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:26.511824 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e0cc9-1cf1-46cb-af6b-b10c76dd5ad4 admin admin] PATH_INFO: `/v3/users/325add9a32ee4f66998c62fec214fd3e` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:26.513015 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060e0cc9-1cf1-46cb-af6b-b10c76dd5ad4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=325add9a32ee4f66998c62fec214fd3e)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:26.514982 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060e0cc9-1cf1-46cb-af6b-b10c76dd5ad4 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:26.562673 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-060e0cc9-1cf1-46cb-af6b-b10c76dd5ad4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '325add9a32ee4f66998c62fec214fd3e'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:26.571642 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-060e0cc9-1cf1-46cb-af6b-b10c76dd5ad4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '325add9a32ee4f66998c62fec214fd3e'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:26.572371 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-060e0cc9-1cf1-46cb-af6b-b10c76dd5ad4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '325add9a32ee4f66998c62fec214fd3e'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:26.581579 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-060e0cc9-1cf1-46cb-af6b-b10c76dd5ad4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '325add9a32ee4f66998c62fec214fd3e'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:26.583085 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-060e0cc9-1cf1-46cb-af6b-b10c76dd5ad4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '325add9a32ee4f66998c62fec214fd3e'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:26.606138 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1062/2121] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 08:49:26 2022] DELETE /identity/v3/users/325add9a32ee4f66998c62fec214fd3e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:26.607989 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e513df-70ea-487d-9e62-c5bead8a7848 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:26.608447 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e513df-70ea-487d-9e62-c5bead8a7848 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:26.608557 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e513df-70ea-487d-9e62-c5bead8a7848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:26.635200 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-a4e513df-70ea-487d-9e62-c5bead8a7848 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:26.636678 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-a4e513df-70ea-487d-9e62-c5bead8a7848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:26.697212 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1060/2122] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:26.706420 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060e0cc9-1cf1-46cb-af6b-b10c76dd5ad4 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:26.707875 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-060e0cc9-1cf1-46cb-af6b-b10c76dd5ad4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:26.765061 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060e0cc9-1cf1-46cb-af6b-b10c76dd5ad4 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:26.768702 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f28bd-1718-4c4f-84c3-c7d8baefcbd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:26.769350 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f28bd-1718-4c4f-84c3-c7d8baefcbd4 service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:26.769639 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f28bd-1718-4c4f-84c3-c7d8baefcbd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:26.769915 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f28bd-1718-4c4f-84c3-c7d8baefcbd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:26.778992 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3f28bd-1718-4c4f-84c3-c7d8baefcbd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:26.780410 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3f28bd-1718-4c4f-84c3-c7d8baefcbd4 service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:26.790288 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1063/2123] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:49:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:49:27.066706 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e513df-70ea-487d-9e62-c5bead8a7848 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:27.068155 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-a4e513df-70ea-487d-9e62-c5bead8a7848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:27.083881 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e513df-70ea-487d-9e62-c5bead8a7848 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:27.089096 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ae06d-a6f0-4be1-94fc-b80d21a1668f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:27.089969 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ae06d-a6f0-4be1-94fc-b80d21a1668f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:27.090291 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ae06d-a6f0-4be1-94fc-b80d21a1668f admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:27.092081 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ae06d-a6f0-4be1-94fc-b80d21a1668f admin admin] PATH_INFO: `/v3/projects/731340b5aab543259b1721769224f56b` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:27.093322 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ae06d-a6f0-4be1-94fc-b80d21a1668f admin admin] RBAC: Authorizing `identity:delete_project(project_id=731340b5aab543259b1721769224f56b)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:27.095289 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ae06d-a6f0-4be1-94fc-b80d21a1668f admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:27.147218 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-e73ae06d-a6f0-4be1-94fc-b80d21a1668f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '731340b5aab543259b1721769224f56b', 'request_id': 'req-e73ae06d-a6f0-4be1-94fc-b80d21a1668f'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:27.152658 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-e73ae06d-a6f0-4be1-94fc-b80d21a1668f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '731340b5aab543259b1721769224f56b', 'request_id': 'req-e73ae06d-a6f0-4be1-94fc-b80d21a1668f'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:27.159471 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-e73ae06d-a6f0-4be1-94fc-b80d21a1668f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '731340b5aab543259b1721769224f56b', 'request_id': 'req-e73ae06d-a6f0-4be1-94fc-b80d21a1668f'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:27.161123 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:27.172500 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-e73ae06d-a6f0-4be1-94fc-b80d21a1668f admin admin] The token cache is being invalidate because project 731340b5aab543259b1721769224f56b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 08:49:27.172793 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-e73ae06d-a6f0-4be1-94fc-b80d21a1668f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:27.173425 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-e73ae06d-a6f0-4be1-94fc-b80d21a1668f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:27.175071 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1061/2124] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 08:49:27 2022] DELETE /identity/v3/projects/731340b5aab543259b1721769224f56b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:27.179885 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb6189-fc85-49ef-b4cd-dcf8f36a1d89 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:27.180185 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb6189-fc85-49ef-b4cd-dcf8f36a1d89 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:27.180464 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb6189-fc85-49ef-b4cd-dcf8f36a1d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:27.198161 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-cceb6189-fc85-49ef-b4cd-dcf8f36a1d89 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:27.199386 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-cceb6189-fc85-49ef-b4cd-dcf8f36a1d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:27.244764 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:27.273896 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1064/2125] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:27.281477 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a9970-d2cc-4385-8493-9ec77c689abb None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:27.281768 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a9970-d2cc-4385-8493-9ec77c689abb None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:27.282048 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a9970-d2cc-4385-8493-9ec77c689abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:27.300853 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-c70a9970-d2cc-4385-8493-9ec77c689abb None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:27.302057 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-c70a9970-d2cc-4385-8493-9ec77c689abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:27.310873 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1062/2126] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:27.315042 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb6189-fc85-49ef-b4cd-dcf8f36a1d89 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:27.324538 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb6189-fc85-49ef-b4cd-dcf8f36a1d89 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:27.329159 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c430a439-7a47-4c6e-a56b-0a75bbb5d896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:27.329846 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430a439-7a47-4c6e-a56b-0a75bbb5d896 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:27.330667 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430a439-7a47-4c6e-a56b-0a75bbb5d896 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:27.330946 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430a439-7a47-4c6e-a56b-0a75bbb5d896 admin admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:27.331672 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c430a439-7a47-4c6e-a56b-0a75bbb5d896 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:27.331973 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c430a439-7a47-4c6e-a56b-0a75bbb5d896 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:27.333568 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c430a439-7a47-4c6e-a56b-0a75bbb5d896 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:27.345560 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1065/2127] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Jun 22 08:49:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:27.350255 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70a9970-d2cc-4385-8493-9ec77c689abb None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:27.359617 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70a9970-d2cc-4385-8493-9ec77c689abb None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:27.364513 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa1ace7-71e3-4f9b-894c-c5b13dff4eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:27.365166 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1ace7-71e3-4f9b-894c-c5b13dff4eab admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:27.365452 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1ace7-71e3-4f9b-894c-c5b13dff4eab admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:27.365982 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1ace7-71e3-4f9b-894c-c5b13dff4eab admin admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:27.366461 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa1ace7-71e3-4f9b-894c-c5b13dff4eab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:27.368367 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa1ace7-71e3-4f9b-894c-c5b13dff4eab admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:27.397812 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1063/2128] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 08:49:27 2022] POST /identity/v3/projects => generated 389 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:49:27.400910 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c430a439-7a47-4c6e-a56b-0a75bbb5d896 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:27.411068 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c430a439-7a47-4c6e-a56b-0a75bbb5d896 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:27.469619 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a3360b-3aaf-4e21-928e-9251335ec021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:27.470383 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3360b-3aaf-4e21-928e-9251335ec021 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:27.470697 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3360b-3aaf-4e21-928e-9251335ec021 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:27.470983 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3360b-3aaf-4e21-928e-9251335ec021 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:27.471685 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a3360b-3aaf-4e21-928e-9251335ec021 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:27.473612 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a3360b-3aaf-4e21-928e-9251335ec021 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:27.493896 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1066/2129] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 08:49:27 2022] POST /identity/v3/users => generated 295 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:49:27.498540 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa1ace7-71e3-4f9b-894c-c5b13dff4eab admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:27.509794 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa1ace7-71e3-4f9b-894c-c5b13dff4eab admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:27.514730 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d80f2-2559-433c-82c5-361746e1afe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:27.515388 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d80f2-2559-433c-82c5-361746e1afe9 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:27.515709 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d80f2-2559-433c-82c5-361746e1afe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:27.515925 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d80f2-2559-433c-82c5-361746e1afe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:27.516644 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963d80f2-2559-433c-82c5-361746e1afe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:27.518813 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963d80f2-2559-433c-82c5-361746e1afe9 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:27.529452 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1064/2130] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:49:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:49:27.533493 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a3360b-3aaf-4e21-928e-9251335ec021 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:27.543438 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a3360b-3aaf-4e21-928e-9251335ec021 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:27.548021 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9605f547-5fff-4a95-8b3b-daea7d817570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:27.548676 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9605f547-5fff-4a95-8b3b-daea7d817570 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:27.549007 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9605f547-5fff-4a95-8b3b-daea7d817570 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:27.549285 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9605f547-5fff-4a95-8b3b-daea7d817570 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:27.550014 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9605f547-5fff-4a95-8b3b-daea7d817570 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:27.551643 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9605f547-5fff-4a95-8b3b-daea7d817570 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:27.561404 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1067/2131] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:49:27 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:49:27.565838 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d80f2-2559-433c-82c5-361746e1afe9 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:27.575929 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d80f2-2559-433c-82c5-361746e1afe9 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:27.581167 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397fb251-9b27-4f35-b8b6-db16da6a8bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:27.582038 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397fb251-9b27-4f35-b8b6-db16da6a8bcc admin admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:27.582352 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397fb251-9b27-4f35-b8b6-db16da6a8bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:27.582631 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397fb251-9b27-4f35-b8b6-db16da6a8bcc admin admin] PATH_INFO: `/v3/projects/3015ad1c637948829cfcc42a2cb8bd63/users/fe4ebaf138f242a98f34973b9aac5a08/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:27.596847 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397fb251-9b27-4f35-b8b6-db16da6a8bcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3015ad1c637948829cfcc42a2cb8bd63, user_id=fe4ebaf138f242a98f34973b9aac5a08, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:27.599533 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397fb251-9b27-4f35-b8b6-db16da6a8bcc admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:27.612886 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1065/2132] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:49:27 2022] PUT /identity/v3/projects/3015ad1c637948829cfcc42a2cb8bd63/users/fe4ebaf138f242a98f34973b9aac5a08/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:27.623135 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad84d4-e71c-4e09-906a-f918528c5f26 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:27.623432 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad84d4-e71c-4e09-906a-f918528c5f26 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:27.623720 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad84d4-e71c-4e09-906a-f918528c5f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:27.651962 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-c5ad84d4-e71c-4e09-906a-f918528c5f26 None None] MFA Rules not processed for user `fe4ebaf138f242a98f34973b9aac5a08`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:27.653189 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-c5ad84d4-e71c-4e09-906a-f918528c5f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:27.721727 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1068/2133] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:27 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:27.732368 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397fb251-9b27-4f35-b8b6-db16da6a8bcc admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:27.734058 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-397fb251-9b27-4f35-b8b6-db16da6a8bcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:27.792156 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397fb251-9b27-4f35-b8b6-db16da6a8bcc admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:27.795783 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212e99e9-2588-48f3-8a10-96eba42aeba7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:27.796463 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e99e9-2588-48f3-8a10-96eba42aeba7 service cinder] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:27.796744 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e99e9-2588-48f3-8a10-96eba42aeba7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:27.797018 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e99e9-2588-48f3-8a10-96eba42aeba7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:27.806218 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212e99e9-2588-48f3-8a10-96eba42aeba7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:27.807640 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212e99e9-2588-48f3-8a10-96eba42aeba7 service cinder] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:27.817405 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1066/2134] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:49:27 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:49:29.630240 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad84d4-e71c-4e09-906a-f918528c5f26 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:29.632576 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-c5ad84d4-e71c-4e09-906a-f918528c5f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:29.694698 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:29.746362 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad84d4-e71c-4e09-906a-f918528c5f26 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:29.751230 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8526efbe-78e4-4405-a5d9-7361ed2a3641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:29.752316 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526efbe-78e4-4405-a5d9-7361ed2a3641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:29.752610 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526efbe-78e4-4405-a5d9-7361ed2a3641 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:29.752948 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526efbe-78e4-4405-a5d9-7361ed2a3641 admin admin] PATH_INFO: `/v3/users/d7acfad085744837abc64065cfb81917` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:29.754427 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8526efbe-78e4-4405-a5d9-7361ed2a3641 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7acfad085744837abc64065cfb81917)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:29.756535 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8526efbe-78e4-4405-a5d9-7361ed2a3641 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:29.862056 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-8526efbe-78e4-4405-a5d9-7361ed2a3641 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7acfad085744837abc64065cfb81917'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:29.877253 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-8526efbe-78e4-4405-a5d9-7361ed2a3641 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7acfad085744837abc64065cfb81917'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:29.878471 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-8526efbe-78e4-4405-a5d9-7361ed2a3641 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7acfad085744837abc64065cfb81917'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:29.897933 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-8526efbe-78e4-4405-a5d9-7361ed2a3641 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7acfad085744837abc64065cfb81917'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:29.900150 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-8526efbe-78e4-4405-a5d9-7361ed2a3641 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7acfad085744837abc64065cfb81917'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:29.949027 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1069/2135] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 08:49:29 2022] DELETE /identity/v3/users/d7acfad085744837abc64065cfb81917 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:29.953616 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665a198-4e94-45fb-a56c-7a9886c99f90 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:29.954148 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665a198-4e94-45fb-a56c-7a9886c99f90 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:29.954600 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665a198-4e94-45fb-a56c-7a9886c99f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:29.973752 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-5665a198-4e94-45fb-a56c-7a9886c99f90 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:29.975066 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-5665a198-4e94-45fb-a56c-7a9886c99f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:29.979783 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8526efbe-78e4-4405-a5d9-7361ed2a3641 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:29.981148 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-8526efbe-78e4-4405-a5d9-7361ed2a3641 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:30.038481 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1067/2136] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:30.048320 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665a198-4e94-45fb-a56c-7a9886c99f90 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:30.049925 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-5665a198-4e94-45fb-a56c-7a9886c99f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:30.050604 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8526efbe-78e4-4405-a5d9-7361ed2a3641 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:30.055659 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b22cc3-7ba4-480b-bf12-19219ceee0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:30.056539 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b22cc3-7ba4-480b-bf12-19219ceee0f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:30.056820 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b22cc3-7ba4-480b-bf12-19219ceee0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:30.057095 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b22cc3-7ba4-480b-bf12-19219ceee0f3 admin admin] PATH_INFO: `/v3/users/47997c35c3ca4dde90c75e7d2136af50` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:30.058323 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b22cc3-7ba4-480b-bf12-19219ceee0f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47997c35c3ca4dde90c75e7d2136af50)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:30.060234 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b22cc3-7ba4-480b-bf12-19219ceee0f3 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:30.084936 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:INSERT=3,keystone:DELETE=1,keystone:SELECT=96 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:30.111241 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c0b22cc3-7ba4-480b-bf12-19219ceee0f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47997c35c3ca4dde90c75e7d2136af50'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:30.113324 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665a198-4e94-45fb-a56c-7a9886c99f90 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:30.117517 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef31791e-0d58-4eb8-8c3b-9bfa266be47a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:30.118422 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31791e-0d58-4eb8-8c3b-9bfa266be47a service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:30.118747 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31791e-0d58-4eb8-8c3b-9bfa266be47a service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:30.119037 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31791e-0d58-4eb8-8c3b-9bfa266be47a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:30.120842 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c0b22cc3-7ba4-480b-bf12-19219ceee0f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47997c35c3ca4dde90c75e7d2136af50'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:30.121770 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c0b22cc3-7ba4-480b-bf12-19219ceee0f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47997c35c3ca4dde90c75e7d2136af50'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:30.125572 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:30.129766 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c0b22cc3-7ba4-480b-bf12-19219ceee0f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47997c35c3ca4dde90c75e7d2136af50'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:30.130163 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef31791e-0d58-4eb8-8c3b-9bfa266be47a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:30.130625 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c0b22cc3-7ba4-480b-bf12-19219ceee0f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47997c35c3ca4dde90c75e7d2136af50'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:30.131600 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef31791e-0d58-4eb8-8c3b-9bfa266be47a service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:30.143152 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1068/2137] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:49:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 08:49:30.151436 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1070/2138] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 08:49:29 2022] DELETE /identity/v3/users/47997c35c3ca4dde90c75e7d2136af50 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 08:49:30.155828 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19296c-7f5c-4fb5-98d4-f93a0f56b300 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:30.156122 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19296c-7f5c-4fb5-98d4-f93a0f56b300 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:30.156402 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19296c-7f5c-4fb5-98d4-f93a0f56b300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:30.174557 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-9b19296c-7f5c-4fb5-98d4-f93a0f56b300 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:30.175717 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-9b19296c-7f5c-4fb5-98d4-f93a0f56b300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:30.242609 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1069/2139] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:30.254203 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b22cc3-7ba4-480b-bf12-19219ceee0f3 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:30.260699 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-c0b22cc3-7ba4-480b-bf12-19219ceee0f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:30.324274 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b22cc3-7ba4-480b-bf12-19219ceee0f3 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:30.327962 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7891d4f0-c68c-4a05-80fd-602e9116d543 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:30.328731 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891d4f0-c68c-4a05-80fd-602e9116d543 service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:30.329027 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891d4f0-c68c-4a05-80fd-602e9116d543 service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:30.329303 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891d4f0-c68c-4a05-80fd-602e9116d543 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:30.339424 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7891d4f0-c68c-4a05-80fd-602e9116d543 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:30.340867 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7891d4f0-c68c-4a05-80fd-602e9116d543 service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:30.351258 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1071/2140] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:49:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:49:30.431972 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19296c-7f5c-4fb5-98d4-f93a0f56b300 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:30.433779 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-9b19296c-7f5c-4fb5-98d4-f93a0f56b300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:30.450825 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19296c-7f5c-4fb5-98d4-f93a0f56b300 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:30.457935 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b0797f-35b6-44e0-9a43-42b72236a026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:30.460034 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b0797f-35b6-44e0-9a43-42b72236a026 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:30.460284 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b0797f-35b6-44e0-9a43-42b72236a026 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:30.460830 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b0797f-35b6-44e0-9a43-42b72236a026 admin admin] PATH_INFO: `/v3/projects/52d1c9326af941ecaba9c3221811d6b1` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:30.461884 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b0797f-35b6-44e0-9a43-42b72236a026 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52d1c9326af941ecaba9c3221811d6b1)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:30.464328 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b0797f-35b6-44e0-9a43-42b72236a026 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:30.541954 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-00b0797f-35b6-44e0-9a43-42b72236a026 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52d1c9326af941ecaba9c3221811d6b1', 'request_id': 'req-00b0797f-35b6-44e0-9a43-42b72236a026'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:30.548054 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-00b0797f-35b6-44e0-9a43-42b72236a026 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52d1c9326af941ecaba9c3221811d6b1', 'request_id': 'req-00b0797f-35b6-44e0-9a43-42b72236a026'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:30.555471 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-00b0797f-35b6-44e0-9a43-42b72236a026 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52d1c9326af941ecaba9c3221811d6b1', 'request_id': 'req-00b0797f-35b6-44e0-9a43-42b72236a026'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:30.569856 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-00b0797f-35b6-44e0-9a43-42b72236a026 admin admin] The token cache is being invalidate because project 52d1c9326af941ecaba9c3221811d6b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 08:49:30.570184 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-00b0797f-35b6-44e0-9a43-42b72236a026 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:30.570941 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-00b0797f-35b6-44e0-9a43-42b72236a026 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:30.573320 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1070/2141] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 08:49:30 2022] DELETE /identity/v3/projects/52d1c9326af941ecaba9c3221811d6b1 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:30.577048 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7891d4f0-c68c-4a05-80fd-602e9116d543 service neutron] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:30.587744 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7891d4f0-c68c-4a05-80fd-602e9116d543 service neutron] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:30.657054 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b0797f-35b6-44e0-9a43-42b72236a026 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:30.658799 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-00b0797f-35b6-44e0-9a43-42b72236a026 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:30.664920 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f6ea5-a323-4a60-b567-83fad645c9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:30.666359 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f6ea5-a323-4a60-b567-83fad645c9bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:30.666703 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f6ea5-a323-4a60-b567-83fad645c9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:30.667041 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f6ea5-a323-4a60-b567-83fad645c9bf admin admin] PATH_INFO: `/v3/users/9aeb4f2c6a8e4311a19b5f0989306a8b` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:30.668527 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711f6ea5-a323-4a60-b567-83fad645c9bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=9aeb4f2c6a8e4311a19b5f0989306a8b)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:30.670577 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711f6ea5-a323-4a60-b567-83fad645c9bf admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:30.726023 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-711f6ea5-a323-4a60-b567-83fad645c9bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9aeb4f2c6a8e4311a19b5f0989306a8b'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:30.733343 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-711f6ea5-a323-4a60-b567-83fad645c9bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9aeb4f2c6a8e4311a19b5f0989306a8b'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:30.734033 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-711f6ea5-a323-4a60-b567-83fad645c9bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9aeb4f2c6a8e4311a19b5f0989306a8b'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:30.740738 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:30.745616 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b0797f-35b6-44e0-9a43-42b72236a026 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:30.753200 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-711f6ea5-a323-4a60-b567-83fad645c9bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9aeb4f2c6a8e4311a19b5f0989306a8b'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:30.753882 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-711f6ea5-a323-4a60-b567-83fad645c9bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9aeb4f2c6a8e4311a19b5f0989306a8b'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:30.757647 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e71a7a3-2fcc-4f9d-83cc-4434392aab1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:30.759034 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71a7a3-2fcc-4f9d-83cc-4434392aab1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:30.759355 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71a7a3-2fcc-4f9d-83cc-4434392aab1f admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:30.759884 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71a7a3-2fcc-4f9d-83cc-4434392aab1f admin admin] PATH_INFO: `/v3/projects/8bedf9566d714747b50b9e97e9b30053` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:30.761955 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e71a7a3-2fcc-4f9d-83cc-4434392aab1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bedf9566d714747b50b9e97e9b30053)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:30.767280 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e71a7a3-2fcc-4f9d-83cc-4434392aab1f admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:30.773486 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:30.779069 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1072/2142] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 08:49:30 2022] DELETE /identity/v3/users/9aeb4f2c6a8e4311a19b5f0989306a8b => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:30.830886 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-4e71a7a3-2fcc-4f9d-83cc-4434392aab1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bedf9566d714747b50b9e97e9b30053', 'request_id': 'req-4e71a7a3-2fcc-4f9d-83cc-4434392aab1f'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:30.836593 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-4e71a7a3-2fcc-4f9d-83cc-4434392aab1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bedf9566d714747b50b9e97e9b30053', 'request_id': 'req-4e71a7a3-2fcc-4f9d-83cc-4434392aab1f'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:30.842944 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-4e71a7a3-2fcc-4f9d-83cc-4434392aab1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bedf9566d714747b50b9e97e9b30053', 'request_id': 'req-4e71a7a3-2fcc-4f9d-83cc-4434392aab1f'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:30.856661 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-4e71a7a3-2fcc-4f9d-83cc-4434392aab1f admin admin] The token cache is being invalidate because project 8bedf9566d714747b50b9e97e9b30053 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 08:49:30.856963 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-4e71a7a3-2fcc-4f9d-83cc-4434392aab1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:30.857642 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-4e71a7a3-2fcc-4f9d-83cc-4434392aab1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:30.859268 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1071/2143] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 08:49:30 2022] DELETE /identity/v3/projects/8bedf9566d714747b50b9e97e9b30053 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 08:49:30.864291 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f6ea5-a323-4a60-b567-83fad645c9bf admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:30.865772 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-711f6ea5-a323-4a60-b567-83fad645c9bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:30.951175 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f6ea5-a323-4a60-b567-83fad645c9bf admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:31.024308 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f53c64-0a48-4e15-acc9-4d99b6c5bac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:31.025199 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f53c64-0a48-4e15-acc9-4d99b6c5bac4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:31.025482 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f53c64-0a48-4e15-acc9-4d99b6c5bac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:31.025759 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f53c64-0a48-4e15-acc9-4d99b6c5bac4 admin admin] PATH_INFO: `/v3/users/2db435c58fd3458685f8aff0eb567374` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:31.027089 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f53c64-0a48-4e15-acc9-4d99b6c5bac4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2db435c58fd3458685f8aff0eb567374)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:31.029037 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f53c64-0a48-4e15-acc9-4d99b6c5bac4 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:31.104564 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-37f53c64-0a48-4e15-acc9-4d99b6c5bac4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2db435c58fd3458685f8aff0eb567374'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:31.114567 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-37f53c64-0a48-4e15-acc9-4d99b6c5bac4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2db435c58fd3458685f8aff0eb567374'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:31.115828 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-37f53c64-0a48-4e15-acc9-4d99b6c5bac4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2db435c58fd3458685f8aff0eb567374'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:31.126159 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-37f53c64-0a48-4e15-acc9-4d99b6c5bac4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2db435c58fd3458685f8aff0eb567374'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:31.127496 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-37f53c64-0a48-4e15-acc9-4d99b6c5bac4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2db435c58fd3458685f8aff0eb567374'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:31.152551 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1073/2144] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 08:49:30 2022] DELETE /identity/v3/users/2db435c58fd3458685f8aff0eb567374 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:31.224886 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e71a7a3-2fcc-4f9d-83cc-4434392aab1f admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:31.226516 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-4e71a7a3-2fcc-4f9d-83cc-4434392aab1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:31.240790 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e71a7a3-2fcc-4f9d-83cc-4434392aab1f admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:31.342630 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb75c5-3123-4423-ba6a-d488d3064659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:31.344012 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb75c5-3123-4423-ba6a-d488d3064659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:31.344530 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb75c5-3123-4423-ba6a-d488d3064659 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:31.345030 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb75c5-3123-4423-ba6a-d488d3064659 admin admin] PATH_INFO: `/v3/projects/292a948f5eee4322adbffa0d91309ce3` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:31.347188 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb75c5-3123-4423-ba6a-d488d3064659 admin admin] RBAC: Authorizing `identity:delete_project(project_id=292a948f5eee4322adbffa0d91309ce3)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:31.349457 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb75c5-3123-4423-ba6a-d488d3064659 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:31.417192 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-79fb75c5-3123-4423-ba6a-d488d3064659 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '292a948f5eee4322adbffa0d91309ce3', 'request_id': 'req-79fb75c5-3123-4423-ba6a-d488d3064659'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:31.423043 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-79fb75c5-3123-4423-ba6a-d488d3064659 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '292a948f5eee4322adbffa0d91309ce3', 'request_id': 'req-79fb75c5-3123-4423-ba6a-d488d3064659'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:31.431634 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-79fb75c5-3123-4423-ba6a-d488d3064659 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '292a948f5eee4322adbffa0d91309ce3', 'request_id': 'req-79fb75c5-3123-4423-ba6a-d488d3064659'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:31.447390 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-79fb75c5-3123-4423-ba6a-d488d3064659 admin admin] The token cache is being invalidate because project 292a948f5eee4322adbffa0d91309ce3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 08:49:31.448260 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-79fb75c5-3123-4423-ba6a-d488d3064659 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:31.449054 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-79fb75c5-3123-4423-ba6a-d488d3064659 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:31.451022 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1072/2145] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 08:49:31 2022] DELETE /identity/v3/projects/292a948f5eee4322adbffa0d91309ce3 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:31.455829 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc77e25-9932-468e-a872-86c4afa2018c None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:31.456129 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc77e25-9932-468e-a872-86c4afa2018c None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:31.456410 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc77e25-9932-468e-a872-86c4afa2018c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:31.476813 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-ebc77e25-9932-468e-a872-86c4afa2018c None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:31.477939 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-ebc77e25-9932-468e-a872-86c4afa2018c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:31.507524 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:31.524691 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb75c5-3123-4423-ba6a-d488d3064659 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:31.526189 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-79fb75c5-3123-4423-ba6a-d488d3064659 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:31.550486 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:31.564576 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1074/2146] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:31.574338 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4d91a-6b9e-4d87-8779-64d93dd5a618 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:31.574624 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4d91a-6b9e-4d87-8779-64d93dd5a618 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:31.574905 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4d91a-6b9e-4d87-8779-64d93dd5a618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:31.594093 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-b2e4d91a-6b9e-4d87-8779-64d93dd5a618 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:31.595414 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-b2e4d91a-6b9e-4d87-8779-64d93dd5a618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:31.604224 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1075/2147] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:31.608095 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e4d91a-6b9e-4d87-8779-64d93dd5a618 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:31.616827 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb75c5-3123-4423-ba6a-d488d3064659 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:31.617571 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e4d91a-6b9e-4d87-8779-64d93dd5a618 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:31.622573 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ff9196-f48a-4fe4-82b3-0f7615147c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:31.622984 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85d2d3-686c-4cca-b0ac-a01a8b521963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:31.623498 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff9196-f48a-4fe4-82b3-0f7615147c29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:31.623634 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85d2d3-686c-4cca-b0ac-a01a8b521963 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:31.623782 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff9196-f48a-4fe4-82b3-0f7615147c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:31.623896 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85d2d3-686c-4cca-b0ac-a01a8b521963 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:31.624051 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff9196-f48a-4fe4-82b3-0f7615147c29 admin admin] PATH_INFO: `/v3/projects/ec5b3d120bbc4526acc137eb38a944e1` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:31.624166 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85d2d3-686c-4cca-b0ac-a01a8b521963 admin admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:31.624906 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e85d2d3-686c-4cca-b0ac-a01a8b521963 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:31.625217 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e85d2d3-686c-4cca-b0ac-a01a8b521963 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:31.625321 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ff9196-f48a-4fe4-82b3-0f7615147c29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec5b3d120bbc4526acc137eb38a944e1)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:31.626919 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e85d2d3-686c-4cca-b0ac-a01a8b521963 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:31.627218 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ff9196-f48a-4fe4-82b3-0f7615147c29 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:31.639780 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1076/2148] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Jun 22 08:49:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:49:31.644584 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85d2d3-686c-4cca-b0ac-a01a8b521963 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:31.654451 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85d2d3-686c-4cca-b0ac-a01a8b521963 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:31.661140 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa96ec8d-b2e9-4399-8235-77c76a83dbc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:31.661806 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96ec8d-b2e9-4399-8235-77c76a83dbc5 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:31.662166 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96ec8d-b2e9-4399-8235-77c76a83dbc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:31.662392 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96ec8d-b2e9-4399-8235-77c76a83dbc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:31.663105 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa96ec8d-b2e9-4399-8235-77c76a83dbc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:31.665015 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa96ec8d-b2e9-4399-8235-77c76a83dbc5 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:31.683757 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-32ff9196-f48a-4fe4-82b3-0f7615147c29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec5b3d120bbc4526acc137eb38a944e1', 'request_id': 'req-32ff9196-f48a-4fe4-82b3-0f7615147c29'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:31.691370 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-32ff9196-f48a-4fe4-82b3-0f7615147c29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec5b3d120bbc4526acc137eb38a944e1', 'request_id': 'req-32ff9196-f48a-4fe4-82b3-0f7615147c29'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:31.698615 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-32ff9196-f48a-4fe4-82b3-0f7615147c29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec5b3d120bbc4526acc137eb38a944e1', 'request_id': 'req-32ff9196-f48a-4fe4-82b3-0f7615147c29'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:31.698896 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1077/2149] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 08:49:31 2022] POST /identity/v3/projects => generated 365 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:49:31.702956 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa96ec8d-b2e9-4399-8235-77c76a83dbc5 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:31.727582 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-32ff9196-f48a-4fe4-82b3-0f7615147c29 admin admin] The token cache is being invalidate because project ec5b3d120bbc4526acc137eb38a944e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 08:49:31.727859 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-32ff9196-f48a-4fe4-82b3-0f7615147c29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:31.728535 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-32ff9196-f48a-4fe4-82b3-0f7615147c29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:31.730992 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1073/2150] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 08:49:31 2022] DELETE /identity/v3/projects/ec5b3d120bbc4526acc137eb38a944e1 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 08:49:31.737014 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ecefd-13a1-4a72-a5d8-8144691e2ea9 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:31.737181 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ecefd-13a1-4a72-a5d8-8144691e2ea9 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:31.737454 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ecefd-13a1-4a72-a5d8-8144691e2ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:31.758172 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-f72ecefd-13a1-4a72-a5d8-8144691e2ea9 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:31.758607 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-f72ecefd-13a1-4a72-a5d8-8144691e2ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:31.775166 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa96ec8d-b2e9-4399-8235-77c76a83dbc5 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:31.781489 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e566035-b136-4701-be75-e34441cd3c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:31.782268 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e566035-b136-4701-be75-e34441cd3c7c admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:31.782553 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e566035-b136-4701-be75-e34441cd3c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:31.782978 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e566035-b136-4701-be75-e34441cd3c7c admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:31.784179 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e566035-b136-4701-be75-e34441cd3c7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:31.786639 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e566035-b136-4701-be75-e34441cd3c7c admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:31.822578 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1078/2151] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 08:49:31 2022] POST /identity/v3/users => generated 283 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 08:49:31.823870 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e566035-b136-4701-be75-e34441cd3c7c admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:31.825703 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-5e566035-b136-4701-be75-e34441cd3c7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:31.839571 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1074/2152] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 08:49:31.846067 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e566035-b136-4701-be75-e34441cd3c7c admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:31.847648 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fd10c-63d0-4f20-a9ba-76bfbfc7d489 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:31.847871 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa33e8f-9589-44f9-9974-264929147594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:31.847999 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fd10c-63d0-4f20-a9ba-76bfbfc7d489 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:31.848365 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fd10c-63d0-4f20-a9ba-76bfbfc7d489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:31.848479 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa33e8f-9589-44f9-9974-264929147594 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:31.848758 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa33e8f-9589-44f9-9974-264929147594 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:31.849029 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa33e8f-9589-44f9-9974-264929147594 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:31.849756 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa33e8f-9589-44f9-9974-264929147594 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:31.851388 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa33e8f-9589-44f9-9974-264929147594 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:31.865453 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1079/2153] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 08:49:31.869288 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa33e8f-9589-44f9-9974-264929147594 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:31.869437 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-328fd10c-63d0-4f20-a9ba-76bfbfc7d489 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:31.870644 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-328fd10c-63d0-4f20-a9ba-76bfbfc7d489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:31.879608 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1075/2154] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:31.880758 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa33e8f-9589-44f9-9974-264929147594 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:31.883463 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328fd10c-63d0-4f20-a9ba-76bfbfc7d489 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:31.886669 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c898e4-20a2-4667-a02c-7eb264c3e267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:31.887355 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c898e4-20a2-4667-a02c-7eb264c3e267 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:31.887772 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c898e4-20a2-4667-a02c-7eb264c3e267 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:31.888055 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c898e4-20a2-4667-a02c-7eb264c3e267 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:31.888850 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c898e4-20a2-4667-a02c-7eb264c3e267 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:31.890485 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c898e4-20a2-4667-a02c-7eb264c3e267 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:31.894585 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328fd10c-63d0-4f20-a9ba-76bfbfc7d489 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:31.900030 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44338ab4-e096-4604-a241-15a56c7f17f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:31.900760 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44338ab4-e096-4604-a241-15a56c7f17f4 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:31.901046 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44338ab4-e096-4604-a241-15a56c7f17f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:31.901320 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44338ab4-e096-4604-a241-15a56c7f17f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:31.902050 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44338ab4-e096-4604-a241-15a56c7f17f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:31.902392 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44338ab4-e096-4604-a241-15a56c7f17f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:31.903120 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1080/2155] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 08:49:31.907031 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c898e4-20a2-4667-a02c-7eb264c3e267 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:31.907158 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44338ab4-e096-4604-a241-15a56c7f17f4 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:31.920634 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c898e4-20a2-4667-a02c-7eb264c3e267 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:31.924817 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1076/2156] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Jun 22 08:49:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:49:31.928283 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d434680-204f-4295-a75f-20dd0f46d2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:31.928283 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d434680-204f-4295-a75f-20dd0f46d2b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:31.928457 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d434680-204f-4295-a75f-20dd0f46d2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:31.928726 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d434680-204f-4295-a75f-20dd0f46d2b7 admin admin] PATH_INFO: `/v3/projects/f1b650bc2c7f4e6da8de05e39a70a29b/users/d4034a21ed804934ab1cf7dd84f897cf/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:31.929701 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44338ab4-e096-4604-a241-15a56c7f17f4 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:31.943192 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44338ab4-e096-4604-a241-15a56c7f17f4 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:31.944690 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d434680-204f-4295-a75f-20dd0f46d2b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1b650bc2c7f4e6da8de05e39a70a29b, user_id=d4034a21ed804934ab1cf7dd84f897cf, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:31.947430 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d434680-204f-4295-a75f-20dd0f46d2b7 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:31.949925 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417c144-d6fb-4127-9490-ba05b0c911c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:31.950928 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417c144-d6fb-4127-9490-ba05b0c911c2 admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:31.951393 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417c144-d6fb-4127-9490-ba05b0c911c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:31.951784 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417c144-d6fb-4127-9490-ba05b0c911c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:31.952398 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8417c144-d6fb-4127-9490-ba05b0c911c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:31.954639 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8417c144-d6fb-4127-9490-ba05b0c911c2 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:31.973575 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1081/2157] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:49:31 2022] PUT /identity/v3/projects/f1b650bc2c7f4e6da8de05e39a70a29b/users/d4034a21ed804934ab1cf7dd84f897cf/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:31.980106 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42454204-6ab5-440a-b514-b9627c9b6447 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:31.980354 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42454204-6ab5-440a-b514-b9627c9b6447 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:31.980607 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42454204-6ab5-440a-b514-b9627c9b6447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:32.013244 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-42454204-6ab5-440a-b514-b9627c9b6447 None None] MFA Rules not processed for user `d4034a21ed804934ab1cf7dd84f897cf`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:32.014835 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-42454204-6ab5-440a-b514-b9627c9b6447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:32.021980 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1077/2158] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 08:49:31 2022] POST /identity/v3/projects => generated 383 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:49:32.023431 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417c144-d6fb-4127-9490-ba05b0c911c2 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:32.035979 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:32.037547 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:32.096142 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1082/2159] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:31 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:32.100393 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42454204-6ab5-440a-b514-b9627c9b6447 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:32.108652 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417c144-d6fb-4127-9490-ba05b0c911c2 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:32.115199 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938e2904-aa4a-4556-aca6-779cb78eb000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:32.115804 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e2904-aa4a-4556-aca6-779cb78eb000 admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:32.116087 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e2904-aa4a-4556-aca6-779cb78eb000 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:32.116365 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e2904-aa4a-4556-aca6-779cb78eb000 admin admin] PATH_INFO: `/v3/users` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:32.117070 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938e2904-aa4a-4556-aca6-779cb78eb000 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:32.119144 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938e2904-aa4a-4556-aca6-779cb78eb000 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:32.141167 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1078/2160] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 08:49:32 2022] POST /identity/v3/users => generated 292 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:49:32.145645 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938e2904-aa4a-4556-aca6-779cb78eb000 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:32.156086 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938e2904-aa4a-4556-aca6-779cb78eb000 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:32.161865 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a0d94-0622-4c02-8323-b938a07a5a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:32.162586 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a0d94-0622-4c02-8323-b938a07a5a0b admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:32.162854 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a0d94-0622-4c02-8323-b938a07a5a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:32.163390 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a0d94-0622-4c02-8323-b938a07a5a0b admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:32.163863 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57a0d94-0622-4c02-8323-b938a07a5a0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:32.165589 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57a0d94-0622-4c02-8323-b938a07a5a0b admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:32.178974 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1079/2161] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 08:49:32.182817 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a0d94-0622-4c02-8323-b938a07a5a0b admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:32.185510 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42454204-6ab5-440a-b514-b9627c9b6447 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:32.190699 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0edbe93-a287-405c-bb23-5a8ded5090a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:32.191384 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0edbe93-a287-405c-bb23-5a8ded5090a1 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:32.191699 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0edbe93-a287-405c-bb23-5a8ded5090a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:32.191937 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0edbe93-a287-405c-bb23-5a8ded5090a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:32.192694 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0edbe93-a287-405c-bb23-5a8ded5090a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:32.194821 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0edbe93-a287-405c-bb23-5a8ded5090a1 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:32.195166 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a0d94-0622-4c02-8323-b938a07a5a0b admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:32.200562 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca93bef5-42ab-47ce-beb2-f135e2d5dcb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:32.201402 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93bef5-42ab-47ce-beb2-f135e2d5dcb4 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:32.201694 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93bef5-42ab-47ce-beb2-f135e2d5dcb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:32.202155 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93bef5-42ab-47ce-beb2-f135e2d5dcb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:32.202908 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca93bef5-42ab-47ce-beb2-f135e2d5dcb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:32.205203 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca93bef5-42ab-47ce-beb2-f135e2d5dcb4 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:32.218148 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1080/2162] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 08:49:32.222787 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca93bef5-42ab-47ce-beb2-f135e2d5dcb4 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:32.227881 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1083/2163] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 08:49:32 2022] POST /identity/v3/projects => generated 365 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:49:32.232096 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0edbe93-a287-405c-bb23-5a8ded5090a1 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:32.236929 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca93bef5-42ab-47ce-beb2-f135e2d5dcb4 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:32.301532 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bdd379-06e8-4174-83ba-f4bb3ab0d3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:32.302455 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bdd379-06e8-4174-83ba-f4bb3ab0d3f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:32.302870 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bdd379-06e8-4174-83ba-f4bb3ab0d3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:32.303151 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bdd379-06e8-4174-83ba-f4bb3ab0d3f8 admin admin] PATH_INFO: `/v3/projects/3764b77a92b34958aef5a62d9ae6ed51/users/7801ddd806754d96bc17b90fee139455/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:32.315465 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0edbe93-a287-405c-bb23-5a8ded5090a1 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:32.320463 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bdd379-06e8-4174-83ba-f4bb3ab0d3f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3764b77a92b34958aef5a62d9ae6ed51, user_id=7801ddd806754d96bc17b90fee139455, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:32.322732 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4aa928-a77d-4403-9bd4-593ee972b660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:32.323402 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bdd379-06e8-4174-83ba-f4bb3ab0d3f8 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:32.323584 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4aa928-a77d-4403-9bd4-593ee972b660 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:32.323894 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4aa928-a77d-4403-9bd4-593ee972b660 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:32.324172 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4aa928-a77d-4403-9bd4-593ee972b660 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:32.325101 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4aa928-a77d-4403-9bd4-593ee972b660 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:32.327254 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4aa928-a77d-4403-9bd4-593ee972b660 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:32.339734 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1081/2164] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:49:32 2022] PUT /identity/v3/projects/3764b77a92b34958aef5a62d9ae6ed51/users/7801ddd806754d96bc17b90fee139455/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 08:49:32.351790 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3143d-84b0-41ee-b0c5-1b3b59073ba9 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:32.353617 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3143d-84b0-41ee-b0c5-1b3b59073ba9 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:32.353898 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3143d-84b0-41ee-b0c5-1b3b59073ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:32.358238 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1084/2165] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 08:49:32 2022] POST /identity/v3/users => generated 289 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 08:49:32.366781 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4aa928-a77d-4403-9bd4-593ee972b660 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:32.378860 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4aa928-a77d-4403-9bd4-593ee972b660 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:32.388441 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-3ce3143d-84b0-41ee-b0c5-1b3b59073ba9 None None] MFA Rules not processed for user `7801ddd806754d96bc17b90fee139455`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:32.390044 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-3ce3143d-84b0-41ee-b0c5-1b3b59073ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:32.417401 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:32.443425 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:32.451391 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5e26da-4584-4f52-97bb-07cc3cefa31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:32.452664 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e26da-4584-4f52-97bb-07cc3cefa31c admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:32.452664 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e26da-4584-4f52-97bb-07cc3cefa31c admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:32.452664 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e26da-4584-4f52-97bb-07cc3cefa31c admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:32.453330 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5e26da-4584-4f52-97bb-07cc3cefa31c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:32.455660 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5e26da-4584-4f52-97bb-07cc3cefa31c admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:32.467519 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1085/2166] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:49:32.471824 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5e26da-4584-4f52-97bb-07cc3cefa31c admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:32.472793 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1082/2167] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 08:49:32.477461 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce3143d-84b0-41ee-b0c5-1b3b59073ba9 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:32.486283 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5e26da-4584-4f52-97bb-07cc3cefa31c admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:32.491017 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfdcf62-3720-49b4-9bfd-2541f5da2577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:32.491902 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfdcf62-3720-49b4-9bfd-2541f5da2577 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:32.492185 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfdcf62-3720-49b4-9bfd-2541f5da2577 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:32.492459 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfdcf62-3720-49b4-9bfd-2541f5da2577 admin admin] PATH_INFO: `/v3/projects/7a38f92219ee4a8f9aff696510664132/users/d5cf2df204f74574be3cbe1bd5fbf9b0/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:32.498549 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce3143d-84b0-41ee-b0c5-1b3b59073ba9 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:32.505280 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae87633-5705-4f43-bd4f-e834ee350892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:32.505956 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae87633-5705-4f43-bd4f-e834ee350892 admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:32.506301 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae87633-5705-4f43-bd4f-e834ee350892 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:32.506587 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae87633-5705-4f43-bd4f-e834ee350892 admin admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:32.507289 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae87633-5705-4f43-bd4f-e834ee350892 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:32.509230 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae87633-5705-4f43-bd4f-e834ee350892 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:32.513492 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfdcf62-3720-49b4-9bfd-2541f5da2577 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a38f92219ee4a8f9aff696510664132, user_id=d5cf2df204f74574be3cbe1bd5fbf9b0, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:32.516525 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfdcf62-3720-49b4-9bfd-2541f5da2577 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:32.533885 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1086/2168] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:49:32 2022] PUT /identity/v3/projects/7a38f92219ee4a8f9aff696510664132/users/d5cf2df204f74574be3cbe1bd5fbf9b0/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:32.537800 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfdcf62-3720-49b4-9bfd-2541f5da2577 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:32.541901 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1083/2169] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 08:49:32 2022] POST /identity/v3/projects => generated 379 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:49:32.542885 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae87633-5705-4f43-bd4f-e834ee350892 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:32.614746 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfdcf62-3720-49b4-9bfd-2541f5da2577 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:32.616454 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae87633-5705-4f43-bd4f-e834ee350892 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:32.620778 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4b136-ddfe-4c82-a6c9-e67ca40c3a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:32.621468 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4b136-ddfe-4c82-a6c9-e67ca40c3a12 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:32.621596 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58fd826-dd21-4bd4-82aa-5d7b1b679cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:32.621750 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4b136-ddfe-4c82-a6c9-e67ca40c3a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:32.622040 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4b136-ddfe-4c82-a6c9-e67ca40c3a12 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:32.622326 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58fd826-dd21-4bd4-82aa-5d7b1b679cc6 admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:32.622611 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58fd826-dd21-4bd4-82aa-5d7b1b679cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:32.622807 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde4b136-ddfe-4c82-a6c9-e67ca40c3a12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:32.623014 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58fd826-dd21-4bd4-82aa-5d7b1b679cc6 admin admin] PATH_INFO: `/v3/users` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:32.623834 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58fd826-dd21-4bd4-82aa-5d7b1b679cc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:32.624431 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde4b136-ddfe-4c82-a6c9-e67ca40c3a12 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:32.626037 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58fd826-dd21-4bd4-82aa-5d7b1b679cc6 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:32.636068 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1087/2170] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 08:49:32.640798 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4b136-ddfe-4c82-a6c9-e67ca40c3a12 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:32.651027 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1084/2171] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 08:49:32 2022] POST /identity/v3/users => generated 296 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:49:32.653140 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4b136-ddfe-4c82-a6c9-e67ca40c3a12 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:32.654777 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58fd826-dd21-4bd4-82aa-5d7b1b679cc6 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:32.658794 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af433548-516e-4737-bda3-722c685f86ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:32.659691 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af433548-516e-4737-bda3-722c685f86ea admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:32.659979 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af433548-516e-4737-bda3-722c685f86ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:32.660319 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af433548-516e-4737-bda3-722c685f86ea admin admin] PATH_INFO: `/v3/projects/7a38f92219ee4a8f9aff696510664132/users/d5cf2df204f74574be3cbe1bd5fbf9b0/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:32.663215 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af433548-516e-4737-bda3-722c685f86ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a38f92219ee4a8f9aff696510664132, user_id=d5cf2df204f74574be3cbe1bd5fbf9b0, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:32.665629 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af433548-516e-4737-bda3-722c685f86ea admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:32.667670 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58fd826-dd21-4bd4-82aa-5d7b1b679cc6 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:32.675462 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d32919-2672-4069-8e91-e5274f04db56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:32.676215 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d32919-2672-4069-8e91-e5274f04db56 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:32.676574 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d32919-2672-4069-8e91-e5274f04db56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:32.676930 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d32919-2672-4069-8e91-e5274f04db56 admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:32.677293 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1088/2172] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:49:32 2022] PUT /identity/v3/projects/7a38f92219ee4a8f9aff696510664132/users/d5cf2df204f74574be3cbe1bd5fbf9b0/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 08:49:32.686322 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d32919-2672-4069-8e91-e5274f04db56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:32.686322 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d32919-2672-4069-8e91-e5274f04db56 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:32.687901 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb63f77-6d0b-4b31-b0bc-4b6cb5989ea6 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:32.688737 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb63f77-6d0b-4b31-b0bc-4b6cb5989ea6 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:32.689103 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb63f77-6d0b-4b31-b0bc-4b6cb5989ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:32.696971 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1085/2173] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:49:32.696971 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d32919-2672-4069-8e91-e5274f04db56 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:32.707542 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d32919-2672-4069-8e91-e5274f04db56 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:32.721349 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-1bb63f77-6d0b-4b31-b0bc-4b6cb5989ea6 None None] MFA Rules not processed for user `d5cf2df204f74574be3cbe1bd5fbf9b0`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:32.722745 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-1bb63f77-6d0b-4b31-b0bc-4b6cb5989ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:32.771097 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba360539-1f3e-4c75-84e6-0345425cef99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:32.771995 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba360539-1f3e-4c75-84e6-0345425cef99 admin admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:32.772278 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba360539-1f3e-4c75-84e6-0345425cef99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:32.772560 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba360539-1f3e-4c75-84e6-0345425cef99 admin admin] PATH_INFO: `/v3/projects/01cfa4e448ed408db9b331342dc53699/users/ca01a658d57f49f8b27c1404f017a5d4/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:32.788722 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba360539-1f3e-4c75-84e6-0345425cef99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01cfa4e448ed408db9b331342dc53699, user_id=ca01a658d57f49f8b27c1404f017a5d4, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:32.791949 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba360539-1f3e-4c75-84e6-0345425cef99 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:32.818722 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1086/2174] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:49:32 2022] PUT /identity/v3/projects/01cfa4e448ed408db9b331342dc53699/users/ca01a658d57f49f8b27c1404f017a5d4/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 08:49:32.823004 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba360539-1f3e-4c75-84e6-0345425cef99 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:32.839645 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1089/2175] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:32 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 08:49:32.852747 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb63f77-6d0b-4b31-b0bc-4b6cb5989ea6 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:32.855641 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-1bb63f77-6d0b-4b31-b0bc-4b6cb5989ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:32.870405 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:32.879822 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:32.920952 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba360539-1f3e-4c75-84e6-0345425cef99 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:32.927671 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c6d4cd-45d1-4b21-95df-0d050ba6e20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:32.928945 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c6d4cd-45d1-4b21-95df-0d050ba6e20a admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:32.928945 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c6d4cd-45d1-4b21-95df-0d050ba6e20a admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:32.929153 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c6d4cd-45d1-4b21-95df-0d050ba6e20a admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:32.930164 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c6d4cd-45d1-4b21-95df-0d050ba6e20a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:32.932433 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c6d4cd-45d1-4b21-95df-0d050ba6e20a admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:32.939112 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb63f77-6d0b-4b31-b0bc-4b6cb5989ea6 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:32.943648 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1087/2176] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:49:32.948161 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c6d4cd-45d1-4b21-95df-0d050ba6e20a admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:32.960259 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c6d4cd-45d1-4b21-95df-0d050ba6e20a admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:32.965172 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c404f7f1-4249-463e-9f8a-b30f5f4dfdaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:32.966199 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c404f7f1-4249-463e-9f8a-b30f5f4dfdaf admin admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:32.966558 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c404f7f1-4249-463e-9f8a-b30f5f4dfdaf admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:32.966909 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c404f7f1-4249-463e-9f8a-b30f5f4dfdaf admin admin] PATH_INFO: `/v3/projects/01cfa4e448ed408db9b331342dc53699/users/ca01a658d57f49f8b27c1404f017a5d4/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:32.969209 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c404f7f1-4249-463e-9f8a-b30f5f4dfdaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=01cfa4e448ed408db9b331342dc53699, user_id=ca01a658d57f49f8b27c1404f017a5d4, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:32.972020 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c404f7f1-4249-463e-9f8a-b30f5f4dfdaf admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:32.984913 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1088/2177] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:49:32 2022] PUT /identity/v3/projects/01cfa4e448ed408db9b331342dc53699/users/ca01a658d57f49f8b27c1404f017a5d4/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:32.995558 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06cfda5-af91-40fc-98b0-59f7e0ff75a8 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:32.995756 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06cfda5-af91-40fc-98b0-59f7e0ff75a8 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:32.996051 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06cfda5-af91-40fc-98b0-59f7e0ff75a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:33.002748 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d8855f-33aa-4e36-8686-a0ce41881a23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:33.003603 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8855f-33aa-4e36-8686-a0ce41881a23 service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:33.004067 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8855f-33aa-4e36-8686-a0ce41881a23 service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:33.004458 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8855f-33aa-4e36-8686-a0ce41881a23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:33.043794 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-c06cfda5-af91-40fc-98b0-59f7e0ff75a8 None None] MFA Rules not processed for user `ca01a658d57f49f8b27c1404f017a5d4`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:33.054355 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-c06cfda5-af91-40fc-98b0-59f7e0ff75a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:33.091623 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d8855f-33aa-4e36-8686-a0ce41881a23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:33.093202 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d8855f-33aa-4e36-8686-a0ce41881a23 service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:33.104426 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1090/2178] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:49:32 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 08:49:33.138476 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1089/2179] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:32 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:33.151838 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d8855f-33aa-4e36-8686-a0ce41881a23 service cinder] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:33.155148 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-02d8855f-33aa-4e36-8686-a0ce41881a23 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:33.178402 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d8855f-33aa-4e36-8686-a0ce41881a23 service cinder] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:33.212781 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06cfda5-af91-40fc-98b0-59f7e0ff75a8 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:33.286784 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2861e446-1410-4808-8c00-60f6ef3f716c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:33.287538 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861e446-1410-4808-8c00-60f6ef3f716c service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:33.287876 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861e446-1410-4808-8c00-60f6ef3f716c service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:33.288163 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861e446-1410-4808-8c00-60f6ef3f716c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:33.303763 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2861e446-1410-4808-8c00-60f6ef3f716c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:33.308794 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2861e446-1410-4808-8c00-60f6ef3f716c service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:33.321515 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1091/2180] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:49:33 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:49:33.348472 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06cfda5-af91-40fc-98b0-59f7e0ff75a8 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:33.353150 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed0dea-0651-4205-97f4-d722d599d1a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:33.353808 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed0dea-0651-4205-97f4-d722d599d1a7 service cinder] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:33.354105 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed0dea-0651-4205-97f4-d722d599d1a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:33.354399 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed0dea-0651-4205-97f4-d722d599d1a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:33.428695 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:33.442837 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ed0dea-0651-4205-97f4-d722d599d1a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:33.444660 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ed0dea-0651-4205-97f4-d722d599d1a7 service cinder] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:33.462395 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1090/2181] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:49:33 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 08:49:33.676812 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2861e446-1410-4808-8c00-60f6ef3f716c service cinder] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:33.696281 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2861e446-1410-4808-8c00-60f6ef3f716c service cinder] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:33.714652 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f68e56-6641-427c-8dba-615f99ad5a4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:33.715736 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f68e56-6641-427c-8dba-615f99ad5a4a service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:33.716736 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f68e56-6641-427c-8dba-615f99ad5a4a service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:33.717184 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f68e56-6641-427c-8dba-615f99ad5a4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:33.752343 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:33.858804 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f68e56-6641-427c-8dba-615f99ad5a4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:33.860507 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f68e56-6641-427c-8dba-615f99ad5a4a service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:33.878748 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1092/2182] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:49:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:49:39.731646 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed0dea-0651-4205-97f4-d722d599d1a7 service cinder] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:39.733116 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-06ed0dea-0651-4205-97f4-d722d599d1a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:39.798454 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed0dea-0651-4205-97f4-d722d599d1a7 service cinder] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:39.802914 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ed30e6-1f98-482f-8ce5-3559fa3676f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:39.803785 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed30e6-1f98-482f-8ce5-3559fa3676f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:39.804069 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed30e6-1f98-482f-8ce5-3559fa3676f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:39.804347 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed30e6-1f98-482f-8ce5-3559fa3676f4 admin admin] PATH_INFO: `/v3/users/9f8688dfd0a14a6d96ae1c5f2093933b` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:39.805541 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ed30e6-1f98-482f-8ce5-3559fa3676f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f8688dfd0a14a6d96ae1c5f2093933b)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:39.807483 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ed30e6-1f98-482f-8ce5-3559fa3676f4 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:39.860123 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-05ed30e6-1f98-482f-8ce5-3559fa3676f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f8688dfd0a14a6d96ae1c5f2093933b'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:39.866928 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-05ed30e6-1f98-482f-8ce5-3559fa3676f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f8688dfd0a14a6d96ae1c5f2093933b'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:39.867589 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-05ed30e6-1f98-482f-8ce5-3559fa3676f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f8688dfd0a14a6d96ae1c5f2093933b'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:39.874984 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-05ed30e6-1f98-482f-8ce5-3559fa3676f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f8688dfd0a14a6d96ae1c5f2093933b'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:39.875706 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-05ed30e6-1f98-482f-8ce5-3559fa3676f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f8688dfd0a14a6d96ae1c5f2093933b'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:39.893516 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1091/2183] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 08:49:39 2022] DELETE /identity/v3/users/9f8688dfd0a14a6d96ae1c5f2093933b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:39.898027 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00a5cb-49bb-4305-959d-eba6fffb5f9b None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:39.898532 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00a5cb-49bb-4305-959d-eba6fffb5f9b None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:39.898643 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00a5cb-49bb-4305-959d-eba6fffb5f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:39.916089 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-cb00a5cb-49bb-4305-959d-eba6fffb5f9b None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:39.917301 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-cb00a5cb-49bb-4305-959d-eba6fffb5f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:39.975849 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1093/2184] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:39.985241 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ed30e6-1f98-482f-8ce5-3559fa3676f4 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:39.986680 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-05ed30e6-1f98-482f-8ce5-3559fa3676f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:40.046510 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ed30e6-1f98-482f-8ce5-3559fa3676f4 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:40.050885 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c03c7dd-d6c9-4ae0-bd80-dc9ef96a171f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:40.051770 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03c7dd-d6c9-4ae0-bd80-dc9ef96a171f service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:40.052059 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03c7dd-d6c9-4ae0-bd80-dc9ef96a171f service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:40.052338 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03c7dd-d6c9-4ae0-bd80-dc9ef96a171f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:40.062058 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c03c7dd-d6c9-4ae0-bd80-dc9ef96a171f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:40.063512 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c03c7dd-d6c9-4ae0-bd80-dc9ef96a171f service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:40.073270 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1092/2185] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:49:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:49:40.345767 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb00a5cb-49bb-4305-959d-eba6fffb5f9b None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:40.347297 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-cb00a5cb-49bb-4305-959d-eba6fffb5f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:40.360733 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb00a5cb-49bb-4305-959d-eba6fffb5f9b None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:40.366295 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6379d8-0469-412c-9e8b-b88a88fee1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:40.367872 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6379d8-0469-412c-9e8b-b88a88fee1a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:40.368159 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6379d8-0469-412c-9e8b-b88a88fee1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:40.368516 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6379d8-0469-412c-9e8b-b88a88fee1a4 admin admin] PATH_INFO: `/v3/projects/8e5c0b0999704731a733734ed52ead02` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:40.369661 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6379d8-0469-412c-9e8b-b88a88fee1a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e5c0b0999704731a733734ed52ead02)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:40.371588 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6379d8-0469-412c-9e8b-b88a88fee1a4 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:40.419699 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-0c6379d8-0469-412c-9e8b-b88a88fee1a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e5c0b0999704731a733734ed52ead02', 'request_id': 'req-0c6379d8-0469-412c-9e8b-b88a88fee1a4'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:40.425742 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-0c6379d8-0469-412c-9e8b-b88a88fee1a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e5c0b0999704731a733734ed52ead02', 'request_id': 'req-0c6379d8-0469-412c-9e8b-b88a88fee1a4'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:40.431828 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-0c6379d8-0469-412c-9e8b-b88a88fee1a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e5c0b0999704731a733734ed52ead02', 'request_id': 'req-0c6379d8-0469-412c-9e8b-b88a88fee1a4'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:40.443915 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-0c6379d8-0469-412c-9e8b-b88a88fee1a4 admin admin] The token cache is being invalidate because project 8e5c0b0999704731a733734ed52ead02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 08:49:40.444201 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-0c6379d8-0469-412c-9e8b-b88a88fee1a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:40.444829 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-0c6379d8-0469-412c-9e8b-b88a88fee1a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:40.446674 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1094/2186] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 08:49:40 2022] DELETE /identity/v3/projects/8e5c0b0999704731a733734ed52ead02 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:40.450435 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c03c7dd-d6c9-4ae0-bd80-dc9ef96a171f service neutron] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:40.460119 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c03c7dd-d6c9-4ae0-bd80-dc9ef96a171f service neutron] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:40.467774 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:40.518879 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7535f4-a2fb-41fe-8dfb-20777050c725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:40.519752 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7535f4-a2fb-41fe-8dfb-20777050c725 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:40.520036 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7535f4-a2fb-41fe-8dfb-20777050c725 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:40.520307 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7535f4-a2fb-41fe-8dfb-20777050c725 admin admin] PATH_INFO: `/v3/users/cf7c59aed22a4946a26369ee683dbd2e` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:40.521490 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7535f4-a2fb-41fe-8dfb-20777050c725 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf7c59aed22a4946a26369ee683dbd2e)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:40.523436 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7535f4-a2fb-41fe-8dfb-20777050c725 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:40.568022 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-ac7535f4-a2fb-41fe-8dfb-20777050c725 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf7c59aed22a4946a26369ee683dbd2e'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:40.574856 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-ac7535f4-a2fb-41fe-8dfb-20777050c725 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf7c59aed22a4946a26369ee683dbd2e'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:40.575507 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-ac7535f4-a2fb-41fe-8dfb-20777050c725 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf7c59aed22a4946a26369ee683dbd2e'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:40.582431 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-ac7535f4-a2fb-41fe-8dfb-20777050c725 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf7c59aed22a4946a26369ee683dbd2e'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:40.583112 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-ac7535f4-a2fb-41fe-8dfb-20777050c725 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf7c59aed22a4946a26369ee683dbd2e'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:40.600447 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1093/2187] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 08:49:40 2022] DELETE /identity/v3/users/cf7c59aed22a4946a26369ee683dbd2e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:40.872799 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6379d8-0469-412c-9e8b-b88a88fee1a4 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:40.876860 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-0c6379d8-0469-412c-9e8b-b88a88fee1a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:40.894268 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6379d8-0469-412c-9e8b-b88a88fee1a4 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:40.944465 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:40.960702 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca449f6-ed9e-4056-93c6-5c1ea0818bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:40.961565 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca449f6-ed9e-4056-93c6-5c1ea0818bd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:40.961848 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca449f6-ed9e-4056-93c6-5c1ea0818bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:40.962160 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca449f6-ed9e-4056-93c6-5c1ea0818bd8 admin admin] PATH_INFO: `/v3/projects/c65e59beb623423b9f871f7334264f80` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:40.963403 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca449f6-ed9e-4056-93c6-5c1ea0818bd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c65e59beb623423b9f871f7334264f80)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:40.965410 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca449f6-ed9e-4056-93c6-5c1ea0818bd8 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:41.016909 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-0ca449f6-ed9e-4056-93c6-5c1ea0818bd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c65e59beb623423b9f871f7334264f80', 'request_id': 'req-0ca449f6-ed9e-4056-93c6-5c1ea0818bd8'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:41.022345 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-0ca449f6-ed9e-4056-93c6-5c1ea0818bd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c65e59beb623423b9f871f7334264f80', 'request_id': 'req-0ca449f6-ed9e-4056-93c6-5c1ea0818bd8'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:41.028494 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-0ca449f6-ed9e-4056-93c6-5c1ea0818bd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c65e59beb623423b9f871f7334264f80', 'request_id': 'req-0ca449f6-ed9e-4056-93c6-5c1ea0818bd8'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:41.041778 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-0ca449f6-ed9e-4056-93c6-5c1ea0818bd8 admin admin] The token cache is being invalidate because project c65e59beb623423b9f871f7334264f80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 08:49:41.042070 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-0ca449f6-ed9e-4056-93c6-5c1ea0818bd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:41.042801 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-0ca449f6-ed9e-4056-93c6-5c1ea0818bd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:41.044361 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1095/2188] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 08:49:40 2022] DELETE /identity/v3/projects/c65e59beb623423b9f871f7334264f80 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:41.050224 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ec0b0-7519-490f-8f92-81d31eb2b822 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:41.050752 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ec0b0-7519-490f-8f92-81d31eb2b822 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:41.050860 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ec0b0-7519-490f-8f92-81d31eb2b822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:41.068933 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-fa1ec0b0-7519-490f-8f92-81d31eb2b822 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:41.070211 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-fa1ec0b0-7519-490f-8f92-81d31eb2b822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:41.130859 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1094/2189] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:41.143573 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee559b30-6245-460b-a074-fb981098f3af None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:41.143909 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee559b30-6245-460b-a074-fb981098f3af None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:41.144177 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee559b30-6245-460b-a074-fb981098f3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:41.163017 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-ee559b30-6245-460b-a074-fb981098f3af None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:41.164223 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-ee559b30-6245-460b-a074-fb981098f3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:41.172143 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1096/2190] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:41.177054 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1ec0b0-7519-490f-8f92-81d31eb2b822 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:41.186745 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1ec0b0-7519-490f-8f92-81d31eb2b822 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:41.191357 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df97f3-4083-48fd-a4ea-fed8a25b04f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:41.192005 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df97f3-4083-48fd-a4ea-fed8a25b04f0 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:41.192296 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df97f3-4083-48fd-a4ea-fed8a25b04f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:41.192575 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df97f3-4083-48fd-a4ea-fed8a25b04f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:41.193306 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75df97f3-4083-48fd-a4ea-fed8a25b04f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:41.193617 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75df97f3-4083-48fd-a4ea-fed8a25b04f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:41.195293 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75df97f3-4083-48fd-a4ea-fed8a25b04f0 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:41.206774 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1095/2191] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Jun 22 08:49:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:41.211090 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee559b30-6245-460b-a074-fb981098f3af None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:41.220787 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee559b30-6245-460b-a074-fb981098f3af None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:41.225420 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79d42f1-8d2d-440d-bd2b-83f00d1c8123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:41.226044 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d42f1-8d2d-440d-bd2b-83f00d1c8123 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:41.226355 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d42f1-8d2d-440d-bd2b-83f00d1c8123 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:41.226636 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d42f1-8d2d-440d-bd2b-83f00d1c8123 admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:41.227345 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79d42f1-8d2d-440d-bd2b-83f00d1c8123 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:41.229247 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79d42f1-8d2d-440d-bd2b-83f00d1c8123 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:41.256716 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1097/2192] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 08:49:41 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:49:41.261096 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df97f3-4083-48fd-a4ea-fed8a25b04f0 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:41.271739 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df97f3-4083-48fd-a4ea-fed8a25b04f0 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:41.284511 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:41.330794 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de37abfd-3c68-4b2b-ab0f-d7f414eb5531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:41.331467 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37abfd-3c68-4b2b-ab0f-d7f414eb5531 admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:41.331748 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37abfd-3c68-4b2b-ab0f-d7f414eb5531 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:41.332030 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37abfd-3c68-4b2b-ab0f-d7f414eb5531 admin admin] PATH_INFO: `/v3/users` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:41.332735 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de37abfd-3c68-4b2b-ab0f-d7f414eb5531 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:41.334805 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de37abfd-3c68-4b2b-ab0f-d7f414eb5531 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:41.359656 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1096/2193] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 08:49:41 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:49:41.360837 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79d42f1-8d2d-440d-bd2b-83f00d1c8123 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:41.371424 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79d42f1-8d2d-440d-bd2b-83f00d1c8123 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:41.376263 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080a06b6-360e-4fc9-8f9e-51e389af44fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:41.376926 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a06b6-360e-4fc9-8f9e-51e389af44fd admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:41.377213 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a06b6-360e-4fc9-8f9e-51e389af44fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:41.377496 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a06b6-360e-4fc9-8f9e-51e389af44fd admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:41.378261 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080a06b6-360e-4fc9-8f9e-51e389af44fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:41.379878 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080a06b6-360e-4fc9-8f9e-51e389af44fd admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:41.390696 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1098/2194] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:49:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:49:41.395285 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de37abfd-3c68-4b2b-ab0f-d7f414eb5531 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:41.405327 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de37abfd-3c68-4b2b-ab0f-d7f414eb5531 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:41.410893 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab1fa78-9384-4d27-9fef-bb84c450af93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:41.411561 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1fa78-9384-4d27-9fef-bb84c450af93 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:41.411852 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1fa78-9384-4d27-9fef-bb84c450af93 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:41.412131 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1fa78-9384-4d27-9fef-bb84c450af93 admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:41.412919 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab1fa78-9384-4d27-9fef-bb84c450af93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:41.414551 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab1fa78-9384-4d27-9fef-bb84c450af93 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:41.424723 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1097/2195] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:49:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:49:41.429221 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080a06b6-360e-4fc9-8f9e-51e389af44fd admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:41.439758 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080a06b6-360e-4fc9-8f9e-51e389af44fd admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:41.444493 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e6a2b-56b1-4cc0-80ab-2eaad6aaf5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:41.445399 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e6a2b-56b1-4cc0-80ab-2eaad6aaf5e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:41.445662 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e6a2b-56b1-4cc0-80ab-2eaad6aaf5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:41.445944 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e6a2b-56b1-4cc0-80ab-2eaad6aaf5e9 admin admin] PATH_INFO: `/v3/projects/b89755b8ece445448699f79df102d8fe/users/dce801e8be544cfd93214a18c5e4299d/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:41.462518 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490e6a2b-56b1-4cc0-80ab-2eaad6aaf5e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b89755b8ece445448699f79df102d8fe, user_id=dce801e8be544cfd93214a18c5e4299d, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:41.465199 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490e6a2b-56b1-4cc0-80ab-2eaad6aaf5e9 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:41.478432 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1099/2196] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:49:41 2022] PUT /identity/v3/projects/b89755b8ece445448699f79df102d8fe/users/dce801e8be544cfd93214a18c5e4299d/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:41.488834 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719f344-44ef-41d9-8fff-679a8dff990e None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:41.489129 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719f344-44ef-41d9-8fff-679a8dff990e None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:41.489409 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719f344-44ef-41d9-8fff-679a8dff990e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:41.515991 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-9719f344-44ef-41d9-8fff-679a8dff990e None None] MFA Rules not processed for user `dce801e8be544cfd93214a18c5e4299d`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:41.517746 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-9719f344-44ef-41d9-8fff-679a8dff990e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:41.580623 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1098/2197] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:41.591743 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e6a2b-56b1-4cc0-80ab-2eaad6aaf5e9 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:41.593406 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-490e6a2b-56b1-4cc0-80ab-2eaad6aaf5e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:41.650369 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e6a2b-56b1-4cc0-80ab-2eaad6aaf5e9 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:41.653943 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72375236-cf3e-41da-bc72-f383153ed78c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589eb8cc97714580840ac7a48ea38ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:41.654604 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72375236-cf3e-41da-bc72-f383153ed78c service glance] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:41.654885 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72375236-cf3e-41da-bc72-f383153ed78c service glance] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:41.655159 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72375236-cf3e-41da-bc72-f383153ed78c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:41.663364 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72375236-cf3e-41da-bc72-f383153ed78c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:41.664788 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72375236-cf3e-41da-bc72-f383153ed78c service glance] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:41.673507 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1100/2198] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:49:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:49:42.924468 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719f344-44ef-41d9-8fff-679a8dff990e None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:42.926003 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-9719f344-44ef-41d9-8fff-679a8dff990e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:42.999122 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719f344-44ef-41d9-8fff-679a8dff990e None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:43.004258 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b236ed6e-8c42-4014-b1fb-7411a91af128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:43.005386 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b236ed6e-8c42-4014-b1fb-7411a91af128 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:43.005804 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b236ed6e-8c42-4014-b1fb-7411a91af128 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:43.006253 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b236ed6e-8c42-4014-b1fb-7411a91af128 admin admin] PATH_INFO: `/v3/users/d4034a21ed804934ab1cf7dd84f897cf` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:43.010653 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b236ed6e-8c42-4014-b1fb-7411a91af128 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4034a21ed804934ab1cf7dd84f897cf)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:43.012722 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b236ed6e-8c42-4014-b1fb-7411a91af128 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:43.046289 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:43.070240 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-b236ed6e-8c42-4014-b1fb-7411a91af128 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4034a21ed804934ab1cf7dd84f897cf'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:43.078699 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-b236ed6e-8c42-4014-b1fb-7411a91af128 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4034a21ed804934ab1cf7dd84f897cf'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:43.079215 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-b236ed6e-8c42-4014-b1fb-7411a91af128 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4034a21ed804934ab1cf7dd84f897cf'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:43.090327 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-b236ed6e-8c42-4014-b1fb-7411a91af128 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4034a21ed804934ab1cf7dd84f897cf'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:43.091014 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-b236ed6e-8c42-4014-b1fb-7411a91af128 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4034a21ed804934ab1cf7dd84f897cf'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:43.112094 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1099/2199] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 08:49:42 2022] DELETE /identity/v3/users/d4034a21ed804934ab1cf7dd84f897cf => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:43.116890 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8da74-735f-40ed-a86e-b522ac58c253 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:43.117414 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8da74-735f-40ed-a86e-b522ac58c253 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:43.117826 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8da74-735f-40ed-a86e-b522ac58c253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:43.153791 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-54d8da74-735f-40ed-a86e-b522ac58c253 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:43.163943 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-54d8da74-735f-40ed-a86e-b522ac58c253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:43.169702 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b236ed6e-8c42-4014-b1fb-7411a91af128 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:43.172905 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-b236ed6e-8c42-4014-b1fb-7411a91af128 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:43.178044 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:43.316186 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1101/2200] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:43.327616 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8da74-735f-40ed-a86e-b522ac58c253 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:43.329107 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-54d8da74-735f-40ed-a86e-b522ac58c253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:43.329280 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b236ed6e-8c42-4014-b1fb-7411a91af128 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:43.334915 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4517b2d-f75e-4d6b-8191-876c51b5c79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:43.336605 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4517b2d-f75e-4d6b-8191-876c51b5c79e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:43.337116 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4517b2d-f75e-4d6b-8191-876c51b5c79e admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:43.337559 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4517b2d-f75e-4d6b-8191-876c51b5c79e admin admin] PATH_INFO: `/v3/users/7801ddd806754d96bc17b90fee139455` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:43.339314 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4517b2d-f75e-4d6b-8191-876c51b5c79e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7801ddd806754d96bc17b90fee139455)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:43.341736 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4517b2d-f75e-4d6b-8191-876c51b5c79e admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:43.409312 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-a4517b2d-f75e-4d6b-8191-876c51b5c79e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7801ddd806754d96bc17b90fee139455'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:43.422288 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8da74-735f-40ed-a86e-b522ac58c253 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:43.424392 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-a4517b2d-f75e-4d6b-8191-876c51b5c79e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7801ddd806754d96bc17b90fee139455'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:43.425312 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-a4517b2d-f75e-4d6b-8191-876c51b5c79e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7801ddd806754d96bc17b90fee139455'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:43.427928 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a5c8ec-065c-46ab-b815-5afdbf4f075d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:43.428606 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5c8ec-065c-46ab-b815-5afdbf4f075d service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:43.430624 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5c8ec-065c-46ab-b815-5afdbf4f075d service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:43.430960 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5c8ec-065c-46ab-b815-5afdbf4f075d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:43.447032 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a5c8ec-065c-46ab-b815-5afdbf4f075d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:43.448611 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a5c8ec-065c-46ab-b815-5afdbf4f075d service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:43.449564 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-a4517b2d-f75e-4d6b-8191-876c51b5c79e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7801ddd806754d96bc17b90fee139455'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:43.450236 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-a4517b2d-f75e-4d6b-8191-876c51b5c79e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7801ddd806754d96bc17b90fee139455'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:43.463891 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1102/2201] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:49:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 08:49:43.487848 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1100/2202] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 08:49:43 2022] DELETE /identity/v3/users/7801ddd806754d96bc17b90fee139455 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:43.492229 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aab877-4bba-4d23-a4d7-25ead7ee1c2d None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:43.493048 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aab877-4bba-4d23-a4d7-25ead7ee1c2d None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:43.494507 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aab877-4bba-4d23-a4d7-25ead7ee1c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:43.521571 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-14aab877-4bba-4d23-a4d7-25ead7ee1c2d None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:43.523308 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-14aab877-4bba-4d23-a4d7-25ead7ee1c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:43.615253 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1103/2203] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 08:49:43.627439 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4517b2d-f75e-4d6b-8191-876c51b5c79e admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:43.629371 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-a4517b2d-f75e-4d6b-8191-876c51b5c79e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:43.679513 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:43.769595 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4517b2d-f75e-4d6b-8191-876c51b5c79e admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:43.784885 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df99171-6c41-4652-b757-a97d1d3ef399 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:43.785568 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df99171-6c41-4652-b757-a97d1d3ef399 service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:43.786030 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df99171-6c41-4652-b757-a97d1d3ef399 service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:43.786340 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df99171-6c41-4652-b757-a97d1d3ef399 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:43.808564 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df99171-6c41-4652-b757-a97d1d3ef399 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:43.810816 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df99171-6c41-4652-b757-a97d1d3ef399 service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:43.834169 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1101/2204] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:49:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:49:43.931935 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aab877-4bba-4d23-a4d7-25ead7ee1c2d None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:43.933446 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-14aab877-4bba-4d23-a4d7-25ead7ee1c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:43.945744 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aab877-4bba-4d23-a4d7-25ead7ee1c2d None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:43.950453 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd89ae-53ab-4d2e-b79a-fff01088d775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:43.951288 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd89ae-53ab-4d2e-b79a-fff01088d775 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:43.951573 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd89ae-53ab-4d2e-b79a-fff01088d775 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:43.951856 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd89ae-53ab-4d2e-b79a-fff01088d775 admin admin] PATH_INFO: `/v3/projects/f1b650bc2c7f4e6da8de05e39a70a29b` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:43.953088 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fd89ae-53ab-4d2e-b79a-fff01088d775 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1b650bc2c7f4e6da8de05e39a70a29b)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:43.955134 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fd89ae-53ab-4d2e-b79a-fff01088d775 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:44.011296 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-83fd89ae-53ab-4d2e-b79a-fff01088d775 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1b650bc2c7f4e6da8de05e39a70a29b', 'request_id': 'req-83fd89ae-53ab-4d2e-b79a-fff01088d775'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:44.013560 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:44.018626 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-83fd89ae-53ab-4d2e-b79a-fff01088d775 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1b650bc2c7f4e6da8de05e39a70a29b', 'request_id': 'req-83fd89ae-53ab-4d2e-b79a-fff01088d775'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:44.025725 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-83fd89ae-53ab-4d2e-b79a-fff01088d775 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1b650bc2c7f4e6da8de05e39a70a29b', 'request_id': 'req-83fd89ae-53ab-4d2e-b79a-fff01088d775'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:44.040435 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-83fd89ae-53ab-4d2e-b79a-fff01088d775 admin admin] The token cache is being invalidate because project f1b650bc2c7f4e6da8de05e39a70a29b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 08:49:44.040728 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-83fd89ae-53ab-4d2e-b79a-fff01088d775 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:44.041366 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-83fd89ae-53ab-4d2e-b79a-fff01088d775 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:44.043581 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1104/2205] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 08:49:43 2022] DELETE /identity/v3/projects/f1b650bc2c7f4e6da8de05e39a70a29b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:44.047900 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df99171-6c41-4652-b757-a97d1d3ef399 service neutron] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:44.059762 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df99171-6c41-4652-b757-a97d1d3ef399 service neutron] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:44.135932 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b097554-83da-4db5-ae04-21247ce71b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:44.136950 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b097554-83da-4db5-ae04-21247ce71b13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:44.137239 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b097554-83da-4db5-ae04-21247ce71b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:44.137518 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b097554-83da-4db5-ae04-21247ce71b13 admin admin] PATH_INFO: `/v3/users/d5cf2df204f74574be3cbe1bd5fbf9b0` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:44.138895 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b097554-83da-4db5-ae04-21247ce71b13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5cf2df204f74574be3cbe1bd5fbf9b0)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:44.141002 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b097554-83da-4db5-ae04-21247ce71b13 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:44.187170 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd89ae-53ab-4d2e-b79a-fff01088d775 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:44.189132 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-83fd89ae-53ab-4d2e-b79a-fff01088d775 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:44.194660 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-8b097554-83da-4db5-ae04-21247ce71b13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5cf2df204f74574be3cbe1bd5fbf9b0'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:44.204343 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-8b097554-83da-4db5-ae04-21247ce71b13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5cf2df204f74574be3cbe1bd5fbf9b0'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:44.205253 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-8b097554-83da-4db5-ae04-21247ce71b13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5cf2df204f74574be3cbe1bd5fbf9b0'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:44.213101 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd89ae-53ab-4d2e-b79a-fff01088d775 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:44.215887 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-8b097554-83da-4db5-ae04-21247ce71b13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5cf2df204f74574be3cbe1bd5fbf9b0'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:44.216747 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-8b097554-83da-4db5-ae04-21247ce71b13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5cf2df204f74574be3cbe1bd5fbf9b0'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:44.221457 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b3149-4520-496e-b429-023bb0820988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:44.222499 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b3149-4520-496e-b429-023bb0820988 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:44.222781 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b3149-4520-496e-b429-023bb0820988 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:44.223061 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b3149-4520-496e-b429-023bb0820988 admin admin] PATH_INFO: `/v3/projects/3764b77a92b34958aef5a62d9ae6ed51` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:44.224689 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b3149-4520-496e-b429-023bb0820988 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3764b77a92b34958aef5a62d9ae6ed51)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:44.226692 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b3149-4520-496e-b429-023bb0820988 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:44.239866 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1102/2206] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 08:49:44 2022] DELETE /identity/v3/users/d5cf2df204f74574be3cbe1bd5fbf9b0 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:44.303954 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-a66b3149-4520-496e-b429-023bb0820988 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3764b77a92b34958aef5a62d9ae6ed51', 'request_id': 'req-a66b3149-4520-496e-b429-023bb0820988'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:44.311615 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-a66b3149-4520-496e-b429-023bb0820988 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3764b77a92b34958aef5a62d9ae6ed51', 'request_id': 'req-a66b3149-4520-496e-b429-023bb0820988'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:44.318775 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-a66b3149-4520-496e-b429-023bb0820988 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3764b77a92b34958aef5a62d9ae6ed51', 'request_id': 'req-a66b3149-4520-496e-b429-023bb0820988'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:44.337094 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-a66b3149-4520-496e-b429-023bb0820988 admin admin] The token cache is being invalidate because project 3764b77a92b34958aef5a62d9ae6ed51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 08:49:44.337646 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-a66b3149-4520-496e-b429-023bb0820988 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:44.338515 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-a66b3149-4520-496e-b429-023bb0820988 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:44.340672 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1105/2207] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 08:49:44 2022] DELETE /identity/v3/projects/3764b77a92b34958aef5a62d9ae6ed51 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:44.344384 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b097554-83da-4db5-ae04-21247ce71b13 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:44.347494 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-8b097554-83da-4db5-ae04-21247ce71b13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:44.442507 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:44.468114 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b097554-83da-4db5-ae04-21247ce71b13 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:44.541914 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355636a8-638a-4beb-9da0-123790246491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:44.542853 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355636a8-638a-4beb-9da0-123790246491 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:44.543136 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355636a8-638a-4beb-9da0-123790246491 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:44.543411 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355636a8-638a-4beb-9da0-123790246491 admin admin] PATH_INFO: `/v3/users/ca01a658d57f49f8b27c1404f017a5d4` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:44.544634 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355636a8-638a-4beb-9da0-123790246491 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca01a658d57f49f8b27c1404f017a5d4)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:44.546593 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355636a8-638a-4beb-9da0-123790246491 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:44.574607 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b3149-4520-496e-b429-023bb0820988 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:44.577202 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-a66b3149-4520-496e-b429-023bb0820988 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:44.597539 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b3149-4520-496e-b429-023bb0820988 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:44.603995 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09320bcc-ffdc-4040-8977-eb054a292012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:44.604957 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09320bcc-ffdc-4040-8977-eb054a292012 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:44.605140 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09320bcc-ffdc-4040-8977-eb054a292012 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:44.605523 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09320bcc-ffdc-4040-8977-eb054a292012 admin admin] PATH_INFO: `/v3/projects/7a38f92219ee4a8f9aff696510664132` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:44.606668 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09320bcc-ffdc-4040-8977-eb054a292012 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a38f92219ee4a8f9aff696510664132)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:44.608643 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09320bcc-ffdc-4040-8977-eb054a292012 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:44.610512 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-355636a8-638a-4beb-9da0-123790246491 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca01a658d57f49f8b27c1404f017a5d4'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:44.617961 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-355636a8-638a-4beb-9da0-123790246491 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca01a658d57f49f8b27c1404f017a5d4'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:44.618690 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-355636a8-638a-4beb-9da0-123790246491 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca01a658d57f49f8b27c1404f017a5d4'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:44.627845 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-355636a8-638a-4beb-9da0-123790246491 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca01a658d57f49f8b27c1404f017a5d4'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:44.628599 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-355636a8-638a-4beb-9da0-123790246491 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca01a658d57f49f8b27c1404f017a5d4'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:44.649003 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1103/2208] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 08:49:44 2022] DELETE /identity/v3/users/ca01a658d57f49f8b27c1404f017a5d4 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 08:49:44.663310 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-09320bcc-ffdc-4040-8977-eb054a292012 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a38f92219ee4a8f9aff696510664132', 'request_id': 'req-09320bcc-ffdc-4040-8977-eb054a292012'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:44.668978 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-09320bcc-ffdc-4040-8977-eb054a292012 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a38f92219ee4a8f9aff696510664132', 'request_id': 'req-09320bcc-ffdc-4040-8977-eb054a292012'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:44.675454 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-09320bcc-ffdc-4040-8977-eb054a292012 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a38f92219ee4a8f9aff696510664132', 'request_id': 'req-09320bcc-ffdc-4040-8977-eb054a292012'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:44.690819 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-09320bcc-ffdc-4040-8977-eb054a292012 admin admin] The token cache is being invalidate because project 7a38f92219ee4a8f9aff696510664132 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 08:49:44.691141 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-09320bcc-ffdc-4040-8977-eb054a292012 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:44.691879 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-09320bcc-ffdc-4040-8977-eb054a292012 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:44.693864 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1106/2209] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 08:49:44 2022] DELETE /identity/v3/projects/7a38f92219ee4a8f9aff696510664132 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 08:49:44.699381 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde19993-4ed2-44a6-bd83-f307726e79da None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:44.699675 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde19993-4ed2-44a6-bd83-f307726e79da None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:44.699944 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde19993-4ed2-44a6-bd83-f307726e79da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:44.721177 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-dde19993-4ed2-44a6-bd83-f307726e79da None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:44.722907 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-dde19993-4ed2-44a6-bd83-f307726e79da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:44.793345 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1104/2210] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:44.802635 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ea7db-ae5d-42f7-8e4d-a92e88aced07 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:44.802996 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ea7db-ae5d-42f7-8e4d-a92e88aced07 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:44.803342 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ea7db-ae5d-42f7-8e4d-a92e88aced07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:44.823581 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-0f6ea7db-ae5d-42f7-8e4d-a92e88aced07 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:44.825366 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-0f6ea7db-ae5d-42f7-8e4d-a92e88aced07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:44.837671 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1107/2211] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:44.841769 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde19993-4ed2-44a6-bd83-f307726e79da None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:44.852536 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde19993-4ed2-44a6-bd83-f307726e79da None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:44.857380 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b883a0-cc8b-481e-87af-1f9884cec786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:44.858169 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b883a0-cc8b-481e-87af-1f9884cec786 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:44.858525 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b883a0-cc8b-481e-87af-1f9884cec786 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:44.858810 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b883a0-cc8b-481e-87af-1f9884cec786 admin admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:44.859588 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b883a0-cc8b-481e-87af-1f9884cec786 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:44.859901 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b883a0-cc8b-481e-87af-1f9884cec786 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:44.862033 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b883a0-cc8b-481e-87af-1f9884cec786 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:44.875396 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:44.875670 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1105/2212] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Jun 22 08:49:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:44.880581 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ea7db-ae5d-42f7-8e4d-a92e88aced07 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:44.894130 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ea7db-ae5d-42f7-8e4d-a92e88aced07 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:44.899914 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492fb07a-450a-4f24-bf04-62775d091284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:44.900581 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fb07a-450a-4f24-bf04-62775d091284 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:44.900871 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fb07a-450a-4f24-bf04-62775d091284 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:44.901158 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fb07a-450a-4f24-bf04-62775d091284 admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:44.902093 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492fb07a-450a-4f24-bf04-62775d091284 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:44.904058 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492fb07a-450a-4f24-bf04-62775d091284 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:44.957394 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1108/2213] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 08:49:44 2022] POST /identity/v3/projects => generated 385 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:49:44.960934 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b883a0-cc8b-481e-87af-1f9884cec786 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:44.973744 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b883a0-cc8b-481e-87af-1f9884cec786 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:44.975784 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492fb07a-450a-4f24-bf04-62775d091284 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:44.977652 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-492fb07a-450a-4f24-bf04-62775d091284 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:45.016493 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=80,keystone:DELETE=16,keystone:INSERT=4 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:45.090392 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492fb07a-450a-4f24-bf04-62775d091284 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:45.095295 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c20013-a711-491c-bf86-10cc84b0c76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:45.096170 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c20013-a711-491c-bf86-10cc84b0c76a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:45.096461 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c20013-a711-491c-bf86-10cc84b0c76a admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:45.096869 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c20013-a711-491c-bf86-10cc84b0c76a admin admin] PATH_INFO: `/v3/projects/01cfa4e448ed408db9b331342dc53699` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:45.098474 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c20013-a711-491c-bf86-10cc84b0c76a admin admin] RBAC: Authorizing `identity:delete_project(project_id=01cfa4e448ed408db9b331342dc53699)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:45.104272 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c20013-a711-491c-bf86-10cc84b0c76a admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:45.109543 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92967ddb-4323-4549-a48d-fe8683103823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:45.109543 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92967ddb-4323-4549-a48d-fe8683103823 admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:45.109543 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92967ddb-4323-4549-a48d-fe8683103823 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:45.109543 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92967ddb-4323-4549-a48d-fe8683103823 admin admin] PATH_INFO: `/v3/users` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:45.110974 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92967ddb-4323-4549-a48d-fe8683103823 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:45.113987 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92967ddb-4323-4549-a48d-fe8683103823 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:45.144694 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1106/2214] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 08:49:44 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 08:49:45.148927 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92967ddb-4323-4549-a48d-fe8683103823 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:45.160770 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92967ddb-4323-4549-a48d-fe8683103823 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:45.177487 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-f9c20013-a711-491c-bf86-10cc84b0c76a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01cfa4e448ed408db9b331342dc53699', 'request_id': 'req-f9c20013-a711-491c-bf86-10cc84b0c76a'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:45.185245 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-f9c20013-a711-491c-bf86-10cc84b0c76a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01cfa4e448ed408db9b331342dc53699', 'request_id': 'req-f9c20013-a711-491c-bf86-10cc84b0c76a'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:45.193166 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-f9c20013-a711-491c-bf86-10cc84b0c76a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01cfa4e448ed408db9b331342dc53699', 'request_id': 'req-f9c20013-a711-491c-bf86-10cc84b0c76a'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:45.206647 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-f9c20013-a711-491c-bf86-10cc84b0c76a admin admin] The token cache is being invalidate because project 01cfa4e448ed408db9b331342dc53699 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 08:49:45.206937 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-f9c20013-a711-491c-bf86-10cc84b0c76a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:45.207589 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-f9c20013-a711-491c-bf86-10cc84b0c76a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:45.209158 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1109/2215] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 08:49:44 2022] DELETE /identity/v3/projects/01cfa4e448ed408db9b331342dc53699 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:45.214627 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19b561-35c4-4774-b2b4-3d07477d72c6 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:45.214919 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19b561-35c4-4774-b2b4-3d07477d72c6 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:45.215196 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19b561-35c4-4774-b2b4-3d07477d72c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:45.238044 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b6b897-f1f5-4e98-9046-5aee9aaed227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:45.238501 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-9e19b561-35c4-4774-b2b4-3d07477d72c6 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:45.238908 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b6b897-f1f5-4e98-9046-5aee9aaed227 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:45.239276 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b6b897-f1f5-4e98-9046-5aee9aaed227 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:45.239638 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b6b897-f1f5-4e98-9046-5aee9aaed227 admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:45.239838 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-9e19b561-35c4-4774-b2b4-3d07477d72c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:45.240808 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b6b897-f1f5-4e98-9046-5aee9aaed227 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:45.242655 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b6b897-f1f5-4e98-9046-5aee9aaed227 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:45.249361 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1110/2216] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:45.256373 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1107/2217] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:49:45 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 08:49:45.260606 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19b561-35c4-4774-b2b4-3d07477d72c6 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:45.261621 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b26e11-00b4-4358-90dc-62238961bba9 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:45.262059 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b26e11-00b4-4358-90dc-62238961bba9 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:45.262392 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b26e11-00b4-4358-90dc-62238961bba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:45.263194 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-9e19b561-35c4-4774-b2b4-3d07477d72c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:45.276205 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19b561-35c4-4774-b2b4-3d07477d72c6 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:45.281751 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c08b8d-11f5-4aba-85c0-9745c49c49e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:45.282743 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c08b8d-11f5-4aba-85c0-9745c49c49e7 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:45.282999 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c08b8d-11f5-4aba-85c0-9745c49c49e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:45.283261 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c08b8d-11f5-4aba-85c0-9745c49c49e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:45.284164 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c08b8d-11f5-4aba-85c0-9745c49c49e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:45.284782 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-37b26e11-00b4-4358-90dc-62238961bba9 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:45.285837 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c08b8d-11f5-4aba-85c0-9745c49c49e7 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:45.286013 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-37b26e11-00b4-4358-90dc-62238961bba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:45.301619 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1108/2218] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:45.301906 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1111/2219] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:49:45 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:49:45.302795 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b26e11-00b4-4358-90dc-62238961bba9 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:45.303123 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c08b8d-11f5-4aba-85c0-9745c49c49e7 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:45.312517 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b26e11-00b4-4358-90dc-62238961bba9 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:45.316514 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c08b8d-11f5-4aba-85c0-9745c49c49e7 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:45.319223 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75beae8-43a0-40f6-af43-0bd80a0bf0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:45.319899 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75beae8-43a0-40f6-af43-0bd80a0bf0ef admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:45.320181 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75beae8-43a0-40f6-af43-0bd80a0bf0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:45.320717 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75beae8-43a0-40f6-af43-0bd80a0bf0ef admin admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:45.321223 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75beae8-43a0-40f6-af43-0bd80a0bf0ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:45.321574 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75beae8-43a0-40f6-af43-0bd80a0bf0ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:45.322222 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd7a89e-7dc1-4726-8210-276bc680ca03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:45.323311 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7a89e-7dc1-4726-8210-276bc680ca03 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:45.323497 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75beae8-43a0-40f6-af43-0bd80a0bf0ef admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:45.323796 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7a89e-7dc1-4726-8210-276bc680ca03 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:45.324176 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7a89e-7dc1-4726-8210-276bc680ca03 admin admin] PATH_INFO: `/v3/projects/183ea9acdf344573b52a733477ced208/users/4dc5e6a433e24eebad7d495dceaadb65/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:45.338131 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1109/2220] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Jun 22 08:49:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:49:45.342566 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75beae8-43a0-40f6-af43-0bd80a0bf0ef admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:45.350835 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd7a89e-7dc1-4726-8210-276bc680ca03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=183ea9acdf344573b52a733477ced208, user_id=4dc5e6a433e24eebad7d495dceaadb65, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:45.352671 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75beae8-43a0-40f6-af43-0bd80a0bf0ef admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:45.353550 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd7a89e-7dc1-4726-8210-276bc680ca03 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:45.357383 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab15ed5-df7b-4822-ac6b-4209ca485a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:45.358495 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab15ed5-df7b-4822-ac6b-4209ca485a63 admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:45.358825 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab15ed5-df7b-4822-ac6b-4209ca485a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:45.359144 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab15ed5-df7b-4822-ac6b-4209ca485a63 admin admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:45.359993 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab15ed5-df7b-4822-ac6b-4209ca485a63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:45.362657 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab15ed5-df7b-4822-ac6b-4209ca485a63 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:45.368828 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1112/2221] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:49:45 2022] PUT /identity/v3/projects/183ea9acdf344573b52a733477ced208/users/4dc5e6a433e24eebad7d495dceaadb65/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:45.377669 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30724f9b-8af9-4a1f-82f0-a6e58d9c0a52 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:45.377977 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30724f9b-8af9-4a1f-82f0-a6e58d9c0a52 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:45.378311 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30724f9b-8af9-4a1f-82f0-a6e58d9c0a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:45.396632 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1110/2222] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 08:49:45 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 08:49:45.397680 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab15ed5-df7b-4822-ac6b-4209ca485a63 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:45.400407 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-30724f9b-8af9-4a1f-82f0-a6e58d9c0a52 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:45.401633 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-30724f9b-8af9-4a1f-82f0-a6e58d9c0a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:45.457853 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:45.478358 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1113/2223] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:45.479761 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab15ed5-df7b-4822-ac6b-4209ca485a63 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:45.485053 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7946bd8-f08c-4bf9-a44e-ac8ed84fd9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:45.486428 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7946bd8-f08c-4bf9-a44e-ac8ed84fd9b0 admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:45.486712 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7946bd8-f08c-4bf9-a44e-ac8ed84fd9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:45.486993 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7946bd8-f08c-4bf9-a44e-ac8ed84fd9b0 admin admin] PATH_INFO: `/v3/users` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:45.487695 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7946bd8-f08c-4bf9-a44e-ac8ed84fd9b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:45.489696 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7946bd8-f08c-4bf9-a44e-ac8ed84fd9b0 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:45.494177 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30724f9b-8af9-4a1f-82f0-a6e58d9c0a52 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:45.495753 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-30724f9b-8af9-4a1f-82f0-a6e58d9c0a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:45.510822 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:45.513685 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1111/2224] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 08:49:45 2022] POST /identity/v3/users => generated 292 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 08:49:45.518525 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7946bd8-f08c-4bf9-a44e-ac8ed84fd9b0 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:45.536890 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7946bd8-f08c-4bf9-a44e-ac8ed84fd9b0 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:45.542979 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01644f87-4c70-4e3f-9f96-19adb64cae91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:45.543704 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01644f87-4c70-4e3f-9f96-19adb64cae91 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:45.544000 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01644f87-4c70-4e3f-9f96-19adb64cae91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:45.544279 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01644f87-4c70-4e3f-9f96-19adb64cae91 admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:45.545076 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01644f87-4c70-4e3f-9f96-19adb64cae91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:45.546929 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01644f87-4c70-4e3f-9f96-19adb64cae91 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:45.559254 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1112/2225] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:49:45 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 08:49:45.563300 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01644f87-4c70-4e3f-9f96-19adb64cae91 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:45.578294 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01644f87-4c70-4e3f-9f96-19adb64cae91 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:45.583553 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633537f8-5684-4eed-9464-8ed812c9e1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:45.584306 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633537f8-5684-4eed-9464-8ed812c9e1ce admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:45.585236 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633537f8-5684-4eed-9464-8ed812c9e1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:45.585513 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633537f8-5684-4eed-9464-8ed812c9e1ce admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:45.586298 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633537f8-5684-4eed-9464-8ed812c9e1ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:45.587977 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633537f8-5684-4eed-9464-8ed812c9e1ce admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:45.596574 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30724f9b-8af9-4a1f-82f0-a6e58d9c0a52 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:45.602058 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce7bbd1-7c42-42c0-b94e-f266beea65a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:45.603058 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce7bbd1-7c42-42c0-b94e-f266beea65a2 service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:45.603411 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce7bbd1-7c42-42c0-b94e-f266beea65a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:45.603703 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce7bbd1-7c42-42c0-b94e-f266beea65a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:45.604271 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1113/2226] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:49:45 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:49:45.611293 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633537f8-5684-4eed-9464-8ed812c9e1ce admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:45.620539 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce7bbd1-7c42-42c0-b94e-f266beea65a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:45.622282 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce7bbd1-7c42-42c0-b94e-f266beea65a2 service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:45.624818 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633537f8-5684-4eed-9464-8ed812c9e1ce admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:45.635717 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46edb56-8207-409e-8b42-572f68a39c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:45.636712 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46edb56-8207-409e-8b42-572f68a39c9c admin admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:45.637658 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46edb56-8207-409e-8b42-572f68a39c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:45.637947 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46edb56-8207-409e-8b42-572f68a39c9c admin admin] PATH_INFO: `/v3/projects/75ad206ddf2c4a43b78da6924cf7f1fc/users/299cb454546a4e79aedc8cffef95ecab/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:45.643612 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1114/2227] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:49:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:49:45.655624 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46edb56-8207-409e-8b42-572f68a39c9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=75ad206ddf2c4a43b78da6924cf7f1fc, user_id=299cb454546a4e79aedc8cffef95ecab, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:45.659525 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46edb56-8207-409e-8b42-572f68a39c9c admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:45.676924 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1114/2228] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:49:45 2022] PUT /identity/v3/projects/75ad206ddf2c4a43b78da6924cf7f1fc/users/299cb454546a4e79aedc8cffef95ecab/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:45.688822 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5914c-4303-414a-960a-54681fa20099 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:45.689282 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5914c-4303-414a-960a-54681fa20099 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:45.689775 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5914c-4303-414a-960a-54681fa20099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:45.735979 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-6cc5914c-4303-414a-960a-54681fa20099 None None] MFA Rules not processed for user `299cb454546a4e79aedc8cffef95ecab`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:45.737092 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-6cc5914c-4303-414a-960a-54681fa20099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:45.815593 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1115/2229] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:45.819966 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46edb56-8207-409e-8b42-572f68a39c9c admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:45.895046 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46edb56-8207-409e-8b42-572f68a39c9c admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:45.906585 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198e7bc-8090-465f-a662-2041287ac6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:45.907918 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198e7bc-8090-465f-a662-2041287ac6b6 admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:45.908271 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198e7bc-8090-465f-a662-2041287ac6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:45.909024 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198e7bc-8090-465f-a662-2041287ac6b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:45.909427 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f198e7bc-8090-465f-a662-2041287ac6b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:45.911590 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f198e7bc-8090-465f-a662-2041287ac6b6 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:45.937739 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1115/2230] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 08:49:45 2022] POST /identity/v3/projects => generated 381 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 08:49:45.941654 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc5914c-4303-414a-960a-54681fa20099 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:45.952955 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc5914c-4303-414a-960a-54681fa20099 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:46.020739 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f285c-66d6-4c70-be48-1daf2b6b43cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:46.021944 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f285c-66d6-4c70-be48-1daf2b6b43cf admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:46.022778 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f285c-66d6-4c70-be48-1daf2b6b43cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:46.023011 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f285c-66d6-4c70-be48-1daf2b6b43cf admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:46.024746 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36f285c-66d6-4c70-be48-1daf2b6b43cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:46.030180 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36f285c-66d6-4c70-be48-1daf2b6b43cf admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:46.082136 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1116/2231] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 08:49:45 2022] POST /identity/v3/users => generated 297 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:49:46.087548 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198e7bc-8090-465f-a662-2041287ac6b6 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:46.101779 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198e7bc-8090-465f-a662-2041287ac6b6 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:46.107025 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e767bcf-5c04-436d-8ecd-9e19e16ba232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:46.109160 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e767bcf-5c04-436d-8ecd-9e19e16ba232 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:46.109160 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e767bcf-5c04-436d-8ecd-9e19e16ba232 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:46.109160 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e767bcf-5c04-436d-8ecd-9e19e16ba232 admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:46.109603 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e767bcf-5c04-436d-8ecd-9e19e16ba232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:46.111375 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e767bcf-5c04-436d-8ecd-9e19e16ba232 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:46.128130 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1116/2232] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:49:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:49:46.129565 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f285c-66d6-4c70-be48-1daf2b6b43cf admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:46.143287 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f285c-66d6-4c70-be48-1daf2b6b43cf admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:46.160179 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e52af4-9f11-4570-bd9b-604bf1c080e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:46.160179 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e52af4-9f11-4570-bd9b-604bf1c080e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:46.160179 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e52af4-9f11-4570-bd9b-604bf1c080e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:46.160179 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e52af4-9f11-4570-bd9b-604bf1c080e0 admin admin] PATH_INFO: `/v3/projects/ef4c7591885340fa9587aca0de28eeb3/users/462b7b16397749aca76c0d8f7651b4d7/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:46.177672 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e52af4-9f11-4570-bd9b-604bf1c080e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef4c7591885340fa9587aca0de28eeb3, user_id=462b7b16397749aca76c0d8f7651b4d7, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:46.184678 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e52af4-9f11-4570-bd9b-604bf1c080e0 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:46.200893 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1117/2233] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:49:46 2022] PUT /identity/v3/projects/ef4c7591885340fa9587aca0de28eeb3/users/462b7b16397749aca76c0d8f7651b4d7/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:46.205730 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e767bcf-5c04-436d-8ecd-9e19e16ba232 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:46.216670 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e767bcf-5c04-436d-8ecd-9e19e16ba232 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:46.301861 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbd02c9-b620-4ec8-9417-bfd3cba0bc1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:46.302581 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd02c9-b620-4ec8-9417-bfd3cba0bc1c admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:46.302998 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd02c9-b620-4ec8-9417-bfd3cba0bc1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:46.303186 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd02c9-b620-4ec8-9417-bfd3cba0bc1c admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:46.303928 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbd02c9-b620-4ec8-9417-bfd3cba0bc1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:46.305532 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbd02c9-b620-4ec8-9417-bfd3cba0bc1c admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:46.309063 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:46.323467 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e52af4-9f11-4570-bd9b-604bf1c080e0 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:46.324615 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1117/2234] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:49:46 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 08:49:46.332749 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:46.338495 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e52af4-9f11-4570-bd9b-604bf1c080e0 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:46.347848 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3254cc3-c12b-4159-9738-d9e31f55e106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:46.350125 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3254cc3-c12b-4159-9738-d9e31f55e106 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:46.350125 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3254cc3-c12b-4159-9738-d9e31f55e106 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:46.350387 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3254cc3-c12b-4159-9738-d9e31f55e106 admin admin] PATH_INFO: `/v3/projects/ef4c7591885340fa9587aca0de28eeb3/users/462b7b16397749aca76c0d8f7651b4d7/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:46.362132 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3254cc3-c12b-4159-9738-d9e31f55e106 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef4c7591885340fa9587aca0de28eeb3, user_id=462b7b16397749aca76c0d8f7651b4d7, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:46.371218 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3254cc3-c12b-4159-9738-d9e31f55e106 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:46.390496 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1118/2235] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:49:46 2022] PUT /identity/v3/projects/ef4c7591885340fa9587aca0de28eeb3/users/462b7b16397749aca76c0d8f7651b4d7/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 08:49:46.403628 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6257395-4884-4f22-9231-8c37655dd50f None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:46.404388 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6257395-4884-4f22-9231-8c37655dd50f None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:46.404688 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6257395-4884-4f22-9231-8c37655dd50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:46.449464 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-e6257395-4884-4f22-9231-8c37655dd50f None None] MFA Rules not processed for user `462b7b16397749aca76c0d8f7651b4d7`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:46.451294 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-e6257395-4884-4f22-9231-8c37655dd50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:46.628999 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1118/2236] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:46 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:46.693206 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3254cc3-c12b-4159-9738-d9e31f55e106 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:46.695045 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-c3254cc3-c12b-4159-9738-d9e31f55e106 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:46.841257 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3254cc3-c12b-4159-9738-d9e31f55e106 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:46.846523 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c96ab2e-9e6b-4b9b-ae4d-1eca34994be7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:46.847329 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96ab2e-9e6b-4b9b-ae4d-1eca34994be7 service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:46.847708 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96ab2e-9e6b-4b9b-ae4d-1eca34994be7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:46.848083 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96ab2e-9e6b-4b9b-ae4d-1eca34994be7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:46.861461 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c96ab2e-9e6b-4b9b-ae4d-1eca34994be7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:46.863549 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c96ab2e-9e6b-4b9b-ae4d-1eca34994be7 service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:46.875344 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1119/2237] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:49:46 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:49:46.970991 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6257395-4884-4f22-9231-8c37655dd50f None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:46.983282 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6257395-4884-4f22-9231-8c37655dd50f None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:46.988237 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f1da0b-b08c-494f-8abc-c75707fbc0d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:46.988897 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1da0b-b08c-494f-8abc-c75707fbc0d7 service cinder] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:46.989178 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1da0b-b08c-494f-8abc-c75707fbc0d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:46.989454 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1da0b-b08c-494f-8abc-c75707fbc0d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:47.061688 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f1da0b-b08c-494f-8abc-c75707fbc0d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:47.063237 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f1da0b-b08c-494f-8abc-c75707fbc0d7 service cinder] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:47.086849 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1119/2238] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:49:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:49:47.490347 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c96ab2e-9e6b-4b9b-ae4d-1eca34994be7 service cinder] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:47.585635 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c96ab2e-9e6b-4b9b-ae4d-1eca34994be7 service cinder] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:47.590456 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f8e0f-ff47-4877-a082-39667d0f71ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:47.591469 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f8e0f-ff47-4877-a082-39667d0f71ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:47.591810 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f8e0f-ff47-4877-a082-39667d0f71ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:47.592113 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f8e0f-ff47-4877-a082-39667d0f71ea admin admin] PATH_INFO: `/v3/users/299cb454546a4e79aedc8cffef95ecab` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:47.593502 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29f8e0f-ff47-4877-a082-39667d0f71ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=299cb454546a4e79aedc8cffef95ecab)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:47.596338 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29f8e0f-ff47-4877-a082-39667d0f71ea admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:47.654754 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-a29f8e0f-ff47-4877-a082-39667d0f71ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '299cb454546a4e79aedc8cffef95ecab'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:47.662824 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-a29f8e0f-ff47-4877-a082-39667d0f71ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '299cb454546a4e79aedc8cffef95ecab'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:47.664060 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-a29f8e0f-ff47-4877-a082-39667d0f71ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '299cb454546a4e79aedc8cffef95ecab'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:47.672784 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-a29f8e0f-ff47-4877-a082-39667d0f71ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '299cb454546a4e79aedc8cffef95ecab'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:47.673566 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-a29f8e0f-ff47-4877-a082-39667d0f71ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '299cb454546a4e79aedc8cffef95ecab'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:47.731472 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1120/2239] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 08:49:47 2022] DELETE /identity/v3/users/299cb454546a4e79aedc8cffef95ecab => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:47.735978 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eef653-247d-4600-af56-007adf55a993 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:47.736475 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eef653-247d-4600-af56-007adf55a993 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:47.736662 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eef653-247d-4600-af56-007adf55a993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:47.758544 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-d7eef653-247d-4600-af56-007adf55a993 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:47.760446 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-d7eef653-247d-4600-af56-007adf55a993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:47.864340 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1120/2240] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:47.874238 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f8e0f-ff47-4877-a082-39667d0f71ea admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:47.875795 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-a29f8e0f-ff47-4877-a082-39667d0f71ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:47.901671 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:47.971097 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f8e0f-ff47-4877-a082-39667d0f71ea admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:47.976017 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9baf7f-33ed-43e6-8a48-00a95a6ac00a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:47.976757 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9baf7f-33ed-43e6-8a48-00a95a6ac00a service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:47.977351 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9baf7f-33ed-43e6-8a48-00a95a6ac00a service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:47.977463 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9baf7f-33ed-43e6-8a48-00a95a6ac00a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:47.994883 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9baf7f-33ed-43e6-8a48-00a95a6ac00a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:47.996431 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9baf7f-33ed-43e6-8a48-00a95a6ac00a service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:48.007782 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1121/2241] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:49:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:49:48.432841 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eef653-247d-4600-af56-007adf55a993 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:48.436076 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-d7eef653-247d-4600-af56-007adf55a993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:48.456264 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eef653-247d-4600-af56-007adf55a993 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:48.463599 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4290da6-e0c9-4573-a802-59097500580a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:48.465127 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4290da6-e0c9-4573-a802-59097500580a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:48.465477 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4290da6-e0c9-4573-a802-59097500580a admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:48.465827 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4290da6-e0c9-4573-a802-59097500580a admin admin] PATH_INFO: `/v3/users/fe4ebaf138f242a98f34973b9aac5a08` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:48.471835 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4290da6-e0c9-4573-a802-59097500580a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe4ebaf138f242a98f34973b9aac5a08)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:48.474243 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4290da6-e0c9-4573-a802-59097500580a admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:48.483818 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9baf7f-33ed-43e6-8a48-00a95a6ac00a service neutron] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:48.486535 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-bb9baf7f-33ed-43e6-8a48-00a95a6ac00a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:48.503059 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:48.576875 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9baf7f-33ed-43e6-8a48-00a95a6ac00a service neutron] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:48.582768 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b9846-8c68-4ee4-a863-92339f2d63ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:48.583732 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b9846-8c68-4ee4-a863-92339f2d63ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:48.584088 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b9846-8c68-4ee4-a863-92339f2d63ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:48.584436 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b9846-8c68-4ee4-a863-92339f2d63ea admin admin] PATH_INFO: `/v3/projects/75ad206ddf2c4a43b78da6924cf7f1fc` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:48.586201 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55b9846-8c68-4ee4-a863-92339f2d63ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=75ad206ddf2c4a43b78da6924cf7f1fc)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:48.588813 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55b9846-8c68-4ee4-a863-92339f2d63ea admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:48.601130 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-c4290da6-e0c9-4573-a802-59097500580a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe4ebaf138f242a98f34973b9aac5a08'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:48.611169 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-c4290da6-e0c9-4573-a802-59097500580a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe4ebaf138f242a98f34973b9aac5a08'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:48.612415 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-c4290da6-e0c9-4573-a802-59097500580a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe4ebaf138f242a98f34973b9aac5a08'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:48.623443 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-c4290da6-e0c9-4573-a802-59097500580a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe4ebaf138f242a98f34973b9aac5a08'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:48.624429 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-c4290da6-e0c9-4573-a802-59097500580a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe4ebaf138f242a98f34973b9aac5a08'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:48.651962 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1121/2242] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 08:49:48 2022] DELETE /identity/v3/users/fe4ebaf138f242a98f34973b9aac5a08 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:48.656953 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81608dac-604c-4212-a6ca-56d494f5c129 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:48.657540 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81608dac-604c-4212-a6ca-56d494f5c129 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:48.657832 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81608dac-604c-4212-a6ca-56d494f5c129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:48.681600 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-81608dac-604c-4212-a6ca-56d494f5c129 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:48.682907 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-81608dac-604c-4212-a6ca-56d494f5c129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:48.695586 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c55b9846-8c68-4ee4-a863-92339f2d63ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75ad206ddf2c4a43b78da6924cf7f1fc', 'request_id': 'req-c55b9846-8c68-4ee4-a863-92339f2d63ea'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:48.702923 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c55b9846-8c68-4ee4-a863-92339f2d63ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75ad206ddf2c4a43b78da6924cf7f1fc', 'request_id': 'req-c55b9846-8c68-4ee4-a863-92339f2d63ea'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:48.713144 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c55b9846-8c68-4ee4-a863-92339f2d63ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75ad206ddf2c4a43b78da6924cf7f1fc', 'request_id': 'req-c55b9846-8c68-4ee4-a863-92339f2d63ea'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:48.732773 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c55b9846-8c68-4ee4-a863-92339f2d63ea admin admin] The token cache is being invalidate because project 75ad206ddf2c4a43b78da6924cf7f1fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 08:49:48.733291 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c55b9846-8c68-4ee4-a863-92339f2d63ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:48.735008 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c55b9846-8c68-4ee4-a863-92339f2d63ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:48.745155 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1122/2243] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 08:49:48 2022] DELETE /identity/v3/projects/75ad206ddf2c4a43b78da6924cf7f1fc => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:48.746617 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b9846-8c68-4ee4-a863-92339f2d63ea admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:48.748768 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-c55b9846-8c68-4ee4-a863-92339f2d63ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:48.793394 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1122/2244] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:48.804109 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81608dac-604c-4212-a6ca-56d494f5c129 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:48.805781 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-81608dac-604c-4212-a6ca-56d494f5c129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:48.873207 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b9846-8c68-4ee4-a863-92339f2d63ea admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:48.881483 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2602624-c379-4960-bd69-15eaf02666b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:48.882544 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2602624-c379-4960-bd69-15eaf02666b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:48.883126 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2602624-c379-4960-bd69-15eaf02666b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:48.883208 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2602624-c379-4960-bd69-15eaf02666b3 admin admin] PATH_INFO: `/v3/users/462b7b16397749aca76c0d8f7651b4d7` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:48.885151 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2602624-c379-4960-bd69-15eaf02666b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=462b7b16397749aca76c0d8f7651b4d7)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:48.889325 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2602624-c379-4960-bd69-15eaf02666b3 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:48.936211 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81608dac-604c-4212-a6ca-56d494f5c129 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:48.946835 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d1a8ea-8841-478d-93ca-2b103308dc30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:48.948071 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d1a8ea-8841-478d-93ca-2b103308dc30 service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:48.948456 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d1a8ea-8841-478d-93ca-2b103308dc30 service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:48.949115 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d1a8ea-8841-478d-93ca-2b103308dc30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:48.958297 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:48.962404 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d1a8ea-8841-478d-93ca-2b103308dc30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:48.964251 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d1a8ea-8841-478d-93ca-2b103308dc30 service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:48.967706 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-f2602624-c379-4960-bd69-15eaf02666b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '462b7b16397749aca76c0d8f7651b4d7'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:48.978119 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1123/2245] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:49:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 08:49:48.982438 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-f2602624-c379-4960-bd69-15eaf02666b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '462b7b16397749aca76c0d8f7651b4d7'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:48.983392 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-f2602624-c379-4960-bd69-15eaf02666b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '462b7b16397749aca76c0d8f7651b4d7'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:48.996368 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-f2602624-c379-4960-bd69-15eaf02666b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '462b7b16397749aca76c0d8f7651b4d7'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:48.997122 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-f2602624-c379-4960-bd69-15eaf02666b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '462b7b16397749aca76c0d8f7651b4d7'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:49.023744 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1123/2246] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 08:49:48 2022] DELETE /identity/v3/users/462b7b16397749aca76c0d8f7651b4d7 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:49.390553 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d1a8ea-8841-478d-93ca-2b103308dc30 service neutron] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:49.392451 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-32d1a8ea-8841-478d-93ca-2b103308dc30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:49.406384 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d1a8ea-8841-478d-93ca-2b103308dc30 service neutron] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:49.453231 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:49.497165 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea359a13-2fce-47a2-9432-74655f97a0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:49.498330 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea359a13-2fce-47a2-9432-74655f97a0ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:49.498715 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea359a13-2fce-47a2-9432-74655f97a0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:49.499075 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea359a13-2fce-47a2-9432-74655f97a0ac admin admin] PATH_INFO: `/v3/projects/3015ad1c637948829cfcc42a2cb8bd63` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:49.500698 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea359a13-2fce-47a2-9432-74655f97a0ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=3015ad1c637948829cfcc42a2cb8bd63)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:49.503381 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea359a13-2fce-47a2-9432-74655f97a0ac admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:49.606068 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-ea359a13-2fce-47a2-9432-74655f97a0ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3015ad1c637948829cfcc42a2cb8bd63', 'request_id': 'req-ea359a13-2fce-47a2-9432-74655f97a0ac'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:49.621554 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-ea359a13-2fce-47a2-9432-74655f97a0ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3015ad1c637948829cfcc42a2cb8bd63', 'request_id': 'req-ea359a13-2fce-47a2-9432-74655f97a0ac'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:49.645200 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-ea359a13-2fce-47a2-9432-74655f97a0ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3015ad1c637948829cfcc42a2cb8bd63', 'request_id': 'req-ea359a13-2fce-47a2-9432-74655f97a0ac'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:49.670025 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-ea359a13-2fce-47a2-9432-74655f97a0ac admin admin] The token cache is being invalidate because project 3015ad1c637948829cfcc42a2cb8bd63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 08:49:49.670377 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-ea359a13-2fce-47a2-9432-74655f97a0ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:49.671068 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-ea359a13-2fce-47a2-9432-74655f97a0ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:49.672950 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1124/2247] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 08:49:49 2022] DELETE /identity/v3/projects/3015ad1c637948829cfcc42a2cb8bd63 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:50.443380 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2602624-c379-4960-bd69-15eaf02666b3 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:50.448723 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-f2602624-c379-4960-bd69-15eaf02666b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:50.479625 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2602624-c379-4960-bd69-15eaf02666b3 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:50.576580 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b3857b-d94a-4df6-a8d7-75b5d7ed2304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:50.577672 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3857b-d94a-4df6-a8d7-75b5d7ed2304 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:50.580563 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3857b-d94a-4df6-a8d7-75b5d7ed2304 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:50.581082 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3857b-d94a-4df6-a8d7-75b5d7ed2304 admin admin] PATH_INFO: `/v3/projects/ef4c7591885340fa9587aca0de28eeb3` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:50.583176 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b3857b-d94a-4df6-a8d7-75b5d7ed2304 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef4c7591885340fa9587aca0de28eeb3)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:50.585457 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b3857b-d94a-4df6-a8d7-75b5d7ed2304 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:50.649755 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-85b3857b-d94a-4df6-a8d7-75b5d7ed2304 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef4c7591885340fa9587aca0de28eeb3', 'request_id': 'req-85b3857b-d94a-4df6-a8d7-75b5d7ed2304'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:50.656579 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-85b3857b-d94a-4df6-a8d7-75b5d7ed2304 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef4c7591885340fa9587aca0de28eeb3', 'request_id': 'req-85b3857b-d94a-4df6-a8d7-75b5d7ed2304'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:50.664427 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-85b3857b-d94a-4df6-a8d7-75b5d7ed2304 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef4c7591885340fa9587aca0de28eeb3', 'request_id': 'req-85b3857b-d94a-4df6-a8d7-75b5d7ed2304'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:50.682897 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-85b3857b-d94a-4df6-a8d7-75b5d7ed2304 admin admin] The token cache is being invalidate because project ef4c7591885340fa9587aca0de28eeb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 08:49:50.683407 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-85b3857b-d94a-4df6-a8d7-75b5d7ed2304 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:50.684449 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-85b3857b-d94a-4df6-a8d7-75b5d7ed2304 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:50.690261 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1124/2248] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 08:49:50 2022] DELETE /identity/v3/projects/ef4c7591885340fa9587aca0de28eeb3 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:50.691995 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2acff7-73d2-4a2e-9620-86144c2d3c0b None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:50.692448 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2acff7-73d2-4a2e-9620-86144c2d3c0b None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:50.692562 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2acff7-73d2-4a2e-9620-86144c2d3c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:50.720290 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-ce2acff7-73d2-4a2e-9620-86144c2d3c0b None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:50.722626 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-ce2acff7-73d2-4a2e-9620-86144c2d3c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:50.907762 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1125/2249] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:50.910385 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc6524-d615-4680-ab3e-ab03c6827990 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:50.911786 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc6524-d615-4680-ab3e-ab03c6827990 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:50.913860 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc6524-d615-4680-ab3e-ab03c6827990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:50.949299 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-25dc6524-d615-4680-ab3e-ab03c6827990 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:50.952978 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-25dc6524-d615-4680-ab3e-ab03c6827990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:50.972204 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1125/2250] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:50.976968 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2acff7-73d2-4a2e-9620-86144c2d3c0b None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:50.996492 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2acff7-73d2-4a2e-9620-86144c2d3c0b None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:51.002558 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c1ec32-98c8-4be8-afec-e397a0f15cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:51.003629 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1ec32-98c8-4be8-afec-e397a0f15cd4 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:51.004017 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1ec32-98c8-4be8-afec-e397a0f15cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:51.004448 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1ec32-98c8-4be8-afec-e397a0f15cd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:51.005304 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c1ec32-98c8-4be8-afec-e397a0f15cd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:51.005911 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c1ec32-98c8-4be8-afec-e397a0f15cd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:51.008414 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c1ec32-98c8-4be8-afec-e397a0f15cd4 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:51.026952 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1126/2251] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Jun 22 08:49:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:51.028209 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc6524-d615-4680-ab3e-ab03c6827990 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:51.040247 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc6524-d615-4680-ab3e-ab03c6827990 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:51.045088 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29aa4f4-7688-4501-832f-3d57b91e9cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:51.045772 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29aa4f4-7688-4501-832f-3d57b91e9cf3 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:51.046060 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29aa4f4-7688-4501-832f-3d57b91e9cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:51.046375 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29aa4f4-7688-4501-832f-3d57b91e9cf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:51.047244 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29aa4f4-7688-4501-832f-3d57b91e9cf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:51.050094 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29aa4f4-7688-4501-832f-3d57b91e9cf3 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:51.101346 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1126/2252] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 08:49:51 2022] POST /identity/v3/projects => generated 383 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:49:51.106027 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c1ec32-98c8-4be8-afec-e397a0f15cd4 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:51.124358 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c1ec32-98c8-4be8-afec-e397a0f15cd4 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:51.215660 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:51.230096 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d69ae5f-5d08-4ca4-b929-e5f1e76f72f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:51.231090 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69ae5f-5d08-4ca4-b929-e5f1e76f72f8 admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:51.231661 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69ae5f-5d08-4ca4-b929-e5f1e76f72f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:51.232575 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69ae5f-5d08-4ca4-b929-e5f1e76f72f8 admin admin] PATH_INFO: `/v3/users` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:51.234939 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d69ae5f-5d08-4ca4-b929-e5f1e76f72f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:51.239671 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d69ae5f-5d08-4ca4-b929-e5f1e76f72f8 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:51.284621 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1127/2253] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 08:49:51 2022] POST /identity/v3/users => generated 292 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 08:49:51.285381 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29aa4f4-7688-4501-832f-3d57b91e9cf3 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:51.299392 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29aa4f4-7688-4501-832f-3d57b91e9cf3 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:51.315680 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee22f1-3db9-491e-80eb-0b84b6720a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:51.316377 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee22f1-3db9-491e-80eb-0b84b6720a45 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:51.316666 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee22f1-3db9-491e-80eb-0b84b6720a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:51.316947 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee22f1-3db9-491e-80eb-0b84b6720a45 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:51.318801 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aee22f1-3db9-491e-80eb-0b84b6720a45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:51.320472 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aee22f1-3db9-491e-80eb-0b84b6720a45 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:51.340176 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1127/2254] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:49:51 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:49:51.341613 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d69ae5f-5d08-4ca4-b929-e5f1e76f72f8 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:51.362295 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d69ae5f-5d08-4ca4-b929-e5f1e76f72f8 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:51.367720 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d11a209-4c63-4e41-a7e0-94892365dacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:51.368672 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11a209-4c63-4e41-a7e0-94892365dacb admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:51.369142 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11a209-4c63-4e41-a7e0-94892365dacb admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:51.370245 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11a209-4c63-4e41-a7e0-94892365dacb admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:51.371811 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d11a209-4c63-4e41-a7e0-94892365dacb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:51.373923 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d11a209-4c63-4e41-a7e0-94892365dacb admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:51.396148 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1128/2255] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:49:51 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 08:49:51.400322 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee22f1-3db9-491e-80eb-0b84b6720a45 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:51.420513 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee22f1-3db9-491e-80eb-0b84b6720a45 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:51.435108 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d8d9a-bfd3-4c57-ab45-a547c2756e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:51.438524 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d8d9a-bfd3-4c57-ab45-a547c2756e6a admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:51.439265 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d8d9a-bfd3-4c57-ab45-a547c2756e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:51.439818 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d8d9a-bfd3-4c57-ab45-a547c2756e6a admin admin] PATH_INFO: `/v3/projects/c8e9fb98a6794eca8499f1886a18b951/users/106473e3997a4ae3a549f269f8b243ad/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:51.444912 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:51.519223 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94d8d9a-bfd3-4c57-ab45-a547c2756e6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8e9fb98a6794eca8499f1886a18b951, user_id=106473e3997a4ae3a549f269f8b243ad, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:51.525138 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94d8d9a-bfd3-4c57-ab45-a547c2756e6a admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:51.549864 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1128/2256] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:49:51 2022] PUT /identity/v3/projects/c8e9fb98a6794eca8499f1886a18b951/users/106473e3997a4ae3a549f269f8b243ad/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:51.564827 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5963e6-1463-42ce-80f1-79d6999748e5 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:51.567432 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5963e6-1463-42ce-80f1-79d6999748e5 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:51.567871 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5963e6-1463-42ce-80f1-79d6999748e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:51.617472 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-8e5963e6-1463-42ce-80f1-79d6999748e5 None None] MFA Rules not processed for user `106473e3997a4ae3a549f269f8b243ad`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:51.618887 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-8e5963e6-1463-42ce-80f1-79d6999748e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:51.800642 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1129/2257] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:51.806716 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d8d9a-bfd3-4c57-ab45-a547c2756e6a admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:51.906282 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5963e6-1463-42ce-80f1-79d6999748e5 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:51.909374 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-8e5963e6-1463-42ce-80f1-79d6999748e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:52.005310 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d8d9a-bfd3-4c57-ab45-a547c2756e6a admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:52.013580 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c00db-f7b5-4892-a852-bb9e5772cc1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:52.014869 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c00db-f7b5-4892-a852-bb9e5772cc1a admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:52.015379 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c00db-f7b5-4892-a852-bb9e5772cc1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:52.015885 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c00db-f7b5-4892-a852-bb9e5772cc1a admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:52.017079 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9c00db-f7b5-4892-a852-bb9e5772cc1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:52.019691 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9c00db-f7b5-4892-a852-bb9e5772cc1a admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:52.082987 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1129/2258] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 08:49:51 2022] POST /identity/v3/projects => generated 385 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:49:52.095872 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c00db-f7b5-4892-a852-bb9e5772cc1a admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:52.107748 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5963e6-1463-42ce-80f1-79d6999748e5 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:52.271067 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a27cc5-2935-4bec-aa12-a1f345d91c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:52.272340 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a27cc5-2935-4bec-aa12-a1f345d91c1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:52.277228 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a27cc5-2935-4bec-aa12-a1f345d91c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:52.277515 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a27cc5-2935-4bec-aa12-a1f345d91c1f admin admin] PATH_INFO: `/v3/users/ddb8ebfc16fb47608d36052d397a167a` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:52.282688 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a27cc5-2935-4bec-aa12-a1f345d91c1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddb8ebfc16fb47608d36052d397a167a)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:52.283609 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c00db-f7b5-4892-a852-bb9e5772cc1a admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:52.284666 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a27cc5-2935-4bec-aa12-a1f345d91c1f admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:52.290857 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d0773-4700-4933-9619-cad6613e3a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:52.292430 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d0773-4700-4933-9619-cad6613e3a5b admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:52.293059 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d0773-4700-4933-9619-cad6613e3a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:52.293361 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d0773-4700-4933-9619-cad6613e3a5b admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:52.294264 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131d0773-4700-4933-9619-cad6613e3a5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:52.300192 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131d0773-4700-4933-9619-cad6613e3a5b admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:52.301196 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:52.331719 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1130/2259] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 08:49:52 2022] POST /identity/v3/users => generated 299 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:49:52.336291 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d0773-4700-4933-9619-cad6613e3a5b admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:52.363045 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d0773-4700-4933-9619-cad6613e3a5b admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:52.373507 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea2b8a-72b0-458c-9458-aa058344be16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:52.374402 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-88a27cc5-2935-4bec-aa12-a1f345d91c1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddb8ebfc16fb47608d36052d397a167a'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:52.379674 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea2b8a-72b0-458c-9458-aa058344be16 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:52.379674 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea2b8a-72b0-458c-9458-aa058344be16 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:52.379674 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea2b8a-72b0-458c-9458-aa058344be16 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:52.381429 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ea2b8a-72b0-458c-9458-aa058344be16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:52.383149 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ea2b8a-72b0-458c-9458-aa058344be16 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:52.390778 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-88a27cc5-2935-4bec-aa12-a1f345d91c1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddb8ebfc16fb47608d36052d397a167a'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:52.397940 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-88a27cc5-2935-4bec-aa12-a1f345d91c1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddb8ebfc16fb47608d36052d397a167a'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:52.402593 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1131/2260] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 08:49:52.405016 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea2b8a-72b0-458c-9458-aa058344be16 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:52.409776 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-88a27cc5-2935-4bec-aa12-a1f345d91c1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddb8ebfc16fb47608d36052d397a167a'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:52.414945 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-88a27cc5-2935-4bec-aa12-a1f345d91c1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddb8ebfc16fb47608d36052d397a167a'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:52.418943 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea2b8a-72b0-458c-9458-aa058344be16 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:52.424824 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0c28d5-c19d-4838-961d-9abcd94e4f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:52.425766 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c28d5-c19d-4838-961d-9abcd94e4f8c admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:52.427013 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c28d5-c19d-4838-961d-9abcd94e4f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:52.427217 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c28d5-c19d-4838-961d-9abcd94e4f8c admin admin] PATH_INFO: `/v3/projects/9c30f31030924253b73ad6de45f391d1/users/210f857c0b5e4021ab35124fe794b755/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:52.448463 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1130/2261] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 08:49:51 2022] DELETE /identity/v3/users/ddb8ebfc16fb47608d36052d397a167a => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 08:49:52.451088 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0c28d5-c19d-4838-961d-9abcd94e4f8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c30f31030924253b73ad6de45f391d1, user_id=210f857c0b5e4021ab35124fe794b755, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:52.454117 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0c28d5-c19d-4838-961d-9abcd94e4f8c admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:52.475153 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1132/2262] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:49:52 2022] PUT /identity/v3/projects/9c30f31030924253b73ad6de45f391d1/users/210f857c0b5e4021ab35124fe794b755/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:52.482200 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a27cc5-2935-4bec-aa12-a1f345d91c1f admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:52.484325 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-88a27cc5-2935-4bec-aa12-a1f345d91c1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:52.628810 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a27cc5-2935-4bec-aa12-a1f345d91c1f admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:52.772586 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0c28d5-c19d-4838-961d-9abcd94e4f8c admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:52.774674 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-2c0c28d5-c19d-4838-961d-9abcd94e4f8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:52.831388 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cfa309-95a0-405c-b508-0959531dc637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:52.832103 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cfa309-95a0-405c-b508-0959531dc637 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:52.832391 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cfa309-95a0-405c-b508-0959531dc637 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:52.832674 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cfa309-95a0-405c-b508-0959531dc637 admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:52.833452 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cfa309-95a0-405c-b508-0959531dc637 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:52.837409 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cfa309-95a0-405c-b508-0959531dc637 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:52.866169 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:52.887510 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1131/2263] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:49:52.895135 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cfa309-95a0-405c-b508-0959531dc637 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:52.911298 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cfa309-95a0-405c-b508-0959531dc637 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:52.918747 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eabc145-451d-458b-aa50-a4fd6074ee0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:52.920134 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eabc145-451d-458b-aa50-a4fd6074ee0b admin admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:52.920733 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eabc145-451d-458b-aa50-a4fd6074ee0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:52.921231 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eabc145-451d-458b-aa50-a4fd6074ee0b admin admin] PATH_INFO: `/v3/projects/9c30f31030924253b73ad6de45f391d1/users/210f857c0b5e4021ab35124fe794b755/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:52.926351 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eabc145-451d-458b-aa50-a4fd6074ee0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c30f31030924253b73ad6de45f391d1, user_id=210f857c0b5e4021ab35124fe794b755, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:52.933623 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eabc145-451d-458b-aa50-a4fd6074ee0b admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:52.971469 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1132/2264] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:49:52 2022] PUT /identity/v3/projects/9c30f31030924253b73ad6de45f391d1/users/210f857c0b5e4021ab35124fe794b755/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:52.988988 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50883dd1-ecfd-464d-8752-cb10a10c18d5 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:52.989273 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50883dd1-ecfd-464d-8752-cb10a10c18d5 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:52.989507 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50883dd1-ecfd-464d-8752-cb10a10c18d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:52.989938 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0c28d5-c19d-4838-961d-9abcd94e4f8c admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:53.056275 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-50883dd1-ecfd-464d-8752-cb10a10c18d5 None None] MFA Rules not processed for user `210f857c0b5e4021ab35124fe794b755`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:53.057594 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-50883dd1-ecfd-464d-8752-cb10a10c18d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:53.089612 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:53.191481 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0bd28-2ed4-487f-b648-c22719694824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:53.192464 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0bd28-2ed4-487f-b648-c22719694824 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:53.192831 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0bd28-2ed4-487f-b648-c22719694824 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:53.193185 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0bd28-2ed4-487f-b648-c22719694824 admin admin] PATH_INFO: `/v3/projects/75e0599d853b4867a5c0465bb285cd2a` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:53.194556 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f0bd28-2ed4-487f-b648-c22719694824 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75e0599d853b4867a5c0465bb285cd2a)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:53.196581 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f0bd28-2ed4-487f-b648-c22719694824 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:53.216950 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1133/2265] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:52 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:53.230235 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50883dd1-ecfd-464d-8752-cb10a10c18d5 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:53.232148 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-50883dd1-ecfd-464d-8752-cb10a10c18d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:53.293845 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-d3f0bd28-2ed4-487f-b648-c22719694824 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75e0599d853b4867a5c0465bb285cd2a', 'request_id': 'req-d3f0bd28-2ed4-487f-b648-c22719694824'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:53.304433 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-d3f0bd28-2ed4-487f-b648-c22719694824 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75e0599d853b4867a5c0465bb285cd2a', 'request_id': 'req-d3f0bd28-2ed4-487f-b648-c22719694824'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:53.312472 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-d3f0bd28-2ed4-487f-b648-c22719694824 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75e0599d853b4867a5c0465bb285cd2a', 'request_id': 'req-d3f0bd28-2ed4-487f-b648-c22719694824'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:53.330353 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-d3f0bd28-2ed4-487f-b648-c22719694824 admin admin] The token cache is being invalidate because project 75e0599d853b4867a5c0465bb285cd2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 08:49:53.330953 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-d3f0bd28-2ed4-487f-b648-c22719694824 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:53.331667 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-d3f0bd28-2ed4-487f-b648-c22719694824 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:53.341649 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50883dd1-ecfd-464d-8752-cb10a10c18d5 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:53.342795 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1133/2266] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 08:49:52 2022] DELETE /identity/v3/projects/75e0599d853b4867a5c0465bb285cd2a => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:53.344457 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf43dab5-ce06-4f95-a48b-6b7fd2b78891 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:53.344748 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf43dab5-ce06-4f95-a48b-6b7fd2b78891 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:53.345075 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf43dab5-ce06-4f95-a48b-6b7fd2b78891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:53.379158 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-cf43dab5-ce06-4f95-a48b-6b7fd2b78891 None None] MFA Rules not processed for user `4dc5e6a433e24eebad7d495dceaadb65`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:53.380477 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-cf43dab5-ce06-4f95-a48b-6b7fd2b78891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:53.415377 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f07299-d42b-4f16-8cc8-7270eb9c8485 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:53.416042 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f07299-d42b-4f16-8cc8-7270eb9c8485 service cinder] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:53.416329 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f07299-d42b-4f16-8cc8-7270eb9c8485 service cinder] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:53.416920 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f07299-d42b-4f16-8cc8-7270eb9c8485 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:53.418612 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-56f07299-d42b-4f16-8cc8-7270eb9c8485 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:53.434096 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:53.454927 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1134/2267] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:53.455861 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf43dab5-ce06-4f95-a48b-6b7fd2b78891 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:53.457261 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-cf43dab5-ce06-4f95-a48b-6b7fd2b78891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:53.491122 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f07299-d42b-4f16-8cc8-7270eb9c8485 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:53.492488 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f07299-d42b-4f16-8cc8-7270eb9c8485 service cinder] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:53.501758 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1134/2268] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:49:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:49:53.502618 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f07299-d42b-4f16-8cc8-7270eb9c8485 service cinder] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:53.504163 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-56f07299-d42b-4f16-8cc8-7270eb9c8485 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:53.530479 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:53.532592 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf43dab5-ce06-4f95-a48b-6b7fd2b78891 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:53.540004 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f8f119-c760-4a19-b52b-b7eb304699d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:53.540917 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8f119-c760-4a19-b52b-b7eb304699d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:53.541344 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8f119-c760-4a19-b52b-b7eb304699d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:53.541633 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8f119-c760-4a19-b52b-b7eb304699d1 admin admin] PATH_INFO: `/v3/users/55d6c2a0388c4b4d9ed5b666a1bf107c` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:53.543220 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f8f119-c760-4a19-b52b-b7eb304699d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55d6c2a0388c4b4d9ed5b666a1bf107c)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:53.545198 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f8f119-c760-4a19-b52b-b7eb304699d1 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:53.606458 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f07299-d42b-4f16-8cc8-7270eb9c8485 service cinder] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:53.606696 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-87f8f119-c760-4a19-b52b-b7eb304699d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55d6c2a0388c4b4d9ed5b666a1bf107c'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:53.614534 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8e03e2-b41d-4b3c-aa46-eceaef37e322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:53.615213 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e03e2-b41d-4b3c-aa46-eceaef37e322 admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:53.615496 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e03e2-b41d-4b3c-aa46-eceaef37e322 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:53.617154 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e03e2-b41d-4b3c-aa46-eceaef37e322 admin admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:53.617812 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8e03e2-b41d-4b3c-aa46-eceaef37e322 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:53.618717 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-87f8f119-c760-4a19-b52b-b7eb304699d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55d6c2a0388c4b4d9ed5b666a1bf107c'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:53.621232 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8e03e2-b41d-4b3c-aa46-eceaef37e322 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:53.621751 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-87f8f119-c760-4a19-b52b-b7eb304699d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55d6c2a0388c4b4d9ed5b666a1bf107c'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:53.633770 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-87f8f119-c760-4a19-b52b-b7eb304699d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55d6c2a0388c4b4d9ed5b666a1bf107c'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:53.634603 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-87f8f119-c760-4a19-b52b-b7eb304699d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55d6c2a0388c4b4d9ed5b666a1bf107c'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:53.667154 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1135/2269] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 08:49:53 2022] POST /identity/v3/projects => generated 385 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:49:53.671605 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8e03e2-b41d-4b3c-aa46-eceaef37e322 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:53.673424 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-2e8e03e2-b41d-4b3c-aa46-eceaef37e322 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:53.678720 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1135/2270] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 08:49:53 2022] DELETE /identity/v3/users/55d6c2a0388c4b4d9ed5b666a1bf107c => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:53.776141 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8e03e2-b41d-4b3c-aa46-eceaef37e322 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:53.876953 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7795961-2bd5-4496-a792-4918d7e6bdac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:53.877789 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7795961-2bd5-4496-a792-4918d7e6bdac admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:53.878157 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7795961-2bd5-4496-a792-4918d7e6bdac admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:53.878550 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7795961-2bd5-4496-a792-4918d7e6bdac admin admin] PATH_INFO: `/v3/users` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:53.879315 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7795961-2bd5-4496-a792-4918d7e6bdac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:53.881689 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7795961-2bd5-4496-a792-4918d7e6bdac admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:53.919873 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1136/2271] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 08:49:53 2022] POST /identity/v3/users => generated 299 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:49:53.922061 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f8f119-c760-4a19-b52b-b7eb304699d1 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:53.940672 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f8f119-c760-4a19-b52b-b7eb304699d1 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:53.947558 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83dac80-b005-4a12-b2ea-6f9fe4e2a86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:53.948326 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83dac80-b005-4a12-b2ea-6f9fe4e2a86b admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:53.948678 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83dac80-b005-4a12-b2ea-6f9fe4e2a86b admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:53.949023 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83dac80-b005-4a12-b2ea-6f9fe4e2a86b admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:53.950213 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83dac80-b005-4a12-b2ea-6f9fe4e2a86b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:53.952607 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83dac80-b005-4a12-b2ea-6f9fe4e2a86b admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:53.978126 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1136/2272] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:49:53.980913 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7795961-2bd5-4496-a792-4918d7e6bdac admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:54.007153 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7795961-2bd5-4496-a792-4918d7e6bdac admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:54.013434 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b3c98c-730e-4e73-be70-5ba052144e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:54.014511 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3c98c-730e-4e73-be70-5ba052144e4b admin admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:54.014822 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3c98c-730e-4e73-be70-5ba052144e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:54.015074 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3c98c-730e-4e73-be70-5ba052144e4b admin admin] PATH_INFO: `/v3/projects/98916dd74e484b86a4ebed934138c0cc/users/1e2282b381e64067a8535b3d23e6c91f/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:54.040478 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83dac80-b005-4a12-b2ea-6f9fe4e2a86b admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:54.042326 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-e83dac80-b005-4a12-b2ea-6f9fe4e2a86b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:54.053673 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b3c98c-730e-4e73-be70-5ba052144e4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=98916dd74e484b86a4ebed934138c0cc, user_id=1e2282b381e64067a8535b3d23e6c91f, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:54.062623 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b3c98c-730e-4e73-be70-5ba052144e4b admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:54.075572 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83dac80-b005-4a12-b2ea-6f9fe4e2a86b admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:54.075572 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdff4c0-7144-414d-8f49-b26d6617e255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:54.075572 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdff4c0-7144-414d-8f49-b26d6617e255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:54.075572 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdff4c0-7144-414d-8f49-b26d6617e255 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:54.075856 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdff4c0-7144-414d-8f49-b26d6617e255 admin admin] PATH_INFO: `/v3/projects/88708cce1597417badaa792d27b4a19b` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:54.086372 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdff4c0-7144-414d-8f49-b26d6617e255 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88708cce1597417badaa792d27b4a19b)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:54.094179 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdff4c0-7144-414d-8f49-b26d6617e255 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:54.102773 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1137/2273] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:49:53 2022] PUT /identity/v3/projects/98916dd74e484b86a4ebed934138c0cc/users/1e2282b381e64067a8535b3d23e6c91f/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 08:49:54.106581 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b3c98c-730e-4e73-be70-5ba052144e4b admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:54.148148 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:54.218674 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-dbdff4c0-7144-414d-8f49-b26d6617e255 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88708cce1597417badaa792d27b4a19b', 'request_id': 'req-dbdff4c0-7144-414d-8f49-b26d6617e255'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:54.224859 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:54.233875 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-dbdff4c0-7144-414d-8f49-b26d6617e255 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88708cce1597417badaa792d27b4a19b', 'request_id': 'req-dbdff4c0-7144-414d-8f49-b26d6617e255'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:54.249212 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-dbdff4c0-7144-414d-8f49-b26d6617e255 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88708cce1597417badaa792d27b4a19b', 'request_id': 'req-dbdff4c0-7144-414d-8f49-b26d6617e255'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:54.285241 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-dbdff4c0-7144-414d-8f49-b26d6617e255 admin admin] The token cache is being invalidate because project 88708cce1597417badaa792d27b4a19b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 08:49:54.285470 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-dbdff4c0-7144-414d-8f49-b26d6617e255 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:54.292223 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-dbdff4c0-7144-414d-8f49-b26d6617e255 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:54.295420 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1137/2274] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 08:49:54 2022] DELETE /identity/v3/projects/88708cce1597417badaa792d27b4a19b => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:54.302249 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16767c66-4481-41a8-a338-c0d090e34cb5 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:54.302530 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16767c66-4481-41a8-a338-c0d090e34cb5 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:54.302820 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16767c66-4481-41a8-a338-c0d090e34cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:54.303311 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b3c98c-730e-4e73-be70-5ba052144e4b admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:54.347394 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-16767c66-4481-41a8-a338-c0d090e34cb5 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:54.348933 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-16767c66-4481-41a8-a338-c0d090e34cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:54.382467 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68411ac-5f5f-4c99-9410-b9b9b565711e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:54.383399 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68411ac-5f5f-4c99-9410-b9b9b565711e admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:54.383955 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68411ac-5f5f-4c99-9410-b9b9b565711e admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:54.384455 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68411ac-5f5f-4c99-9410-b9b9b565711e admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:54.385539 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68411ac-5f5f-4c99-9410-b9b9b565711e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:54.387498 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68411ac-5f5f-4c99-9410-b9b9b565711e admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:54.401194 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1138/2275] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:49:54 2022] GET /identity/v3/roles => generated 1420 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 08:49:54.409171 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68411ac-5f5f-4c99-9410-b9b9b565711e admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:54.411018 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-a68411ac-5f5f-4c99-9410-b9b9b565711e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:54.426396 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68411ac-5f5f-4c99-9410-b9b9b565711e admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:54.431700 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b0f36-5c35-4bfb-8fac-ca6c8b649a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:54.432966 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b0f36-5c35-4bfb-8fac-ca6c8b649a75 admin admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:54.433467 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b0f36-5c35-4bfb-8fac-ca6c8b649a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:54.433874 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b0f36-5c35-4bfb-8fac-ca6c8b649a75 admin admin] PATH_INFO: `/v3/projects/98916dd74e484b86a4ebed934138c0cc/users/1e2282b381e64067a8535b3d23e6c91f/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:54.436324 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02b0f36-5c35-4bfb-8fac-ca6c8b649a75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98916dd74e484b86a4ebed934138c0cc, user_id=1e2282b381e64067a8535b3d23e6c91f, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:54.439866 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02b0f36-5c35-4bfb-8fac-ca6c8b649a75 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:54.460754 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1139/2276] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:49:54 2022] PUT /identity/v3/projects/98916dd74e484b86a4ebed934138c0cc/users/1e2282b381e64067a8535b3d23e6c91f/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:54.465605 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1138/2277] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:54.470401 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dfc39e-f414-44d4-860a-164db46c1cd1 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:54.470858 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dfc39e-f414-44d4-860a-164db46c1cd1 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:54.472114 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dfc39e-f414-44d4-860a-164db46c1cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:54.507391 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-a1dfc39e-f414-44d4-860a-164db46c1cd1 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:54.508706 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-a1dfc39e-f414-44d4-860a-164db46c1cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:54.631825 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1140/2278] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:54.637214 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16767c66-4481-41a8-a338-c0d090e34cb5 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:54.651916 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16767c66-4481-41a8-a338-c0d090e34cb5 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:54.657481 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8590357-51a1-4ee3-b413-3f8d73912a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:54.658590 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8590357-51a1-4ee3-b413-3f8d73912a3d admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:54.658890 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8590357-51a1-4ee3-b413-3f8d73912a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:54.659260 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8590357-51a1-4ee3-b413-3f8d73912a3d admin admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:54.660080 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8590357-51a1-4ee3-b413-3f8d73912a3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:54.660513 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8590357-51a1-4ee3-b413-3f8d73912a3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:54.662690 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8590357-51a1-4ee3-b413-3f8d73912a3d admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:54.690482 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1139/2279] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Jun 22 08:49:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:54.695398 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dfc39e-f414-44d4-860a-164db46c1cd1 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:54.712644 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dfc39e-f414-44d4-860a-164db46c1cd1 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:54.718297 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e3093a-b295-48e2-a3d3-56e80568b261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:54.719088 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3093a-b295-48e2-a3d3-56e80568b261 admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:54.719482 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3093a-b295-48e2-a3d3-56e80568b261 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:54.719770 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3093a-b295-48e2-a3d3-56e80568b261 admin admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:54.720704 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e3093a-b295-48e2-a3d3-56e80568b261 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:54.724260 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e3093a-b295-48e2-a3d3-56e80568b261 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:54.773045 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1141/2280] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 08:49:54 2022] POST /identity/v3/projects => generated 383 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 08:49:54.775259 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8590357-51a1-4ee3-b413-3f8d73912a3d admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:54.793051 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8590357-51a1-4ee3-b413-3f8d73912a3d admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:54.944926 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37361fea-4adf-40ae-b829-13ca87cecdb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:54.945653 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37361fea-4adf-40ae-b829-13ca87cecdb7 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:54.945938 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37361fea-4adf-40ae-b829-13ca87cecdb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:54.946255 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37361fea-4adf-40ae-b829-13ca87cecdb7 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:54.947006 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37361fea-4adf-40ae-b829-13ca87cecdb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:54.949541 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37361fea-4adf-40ae-b829-13ca87cecdb7 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:54.986356 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1140/2281] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 08:49:54 2022] POST /identity/v3/users => generated 292 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:49:54.991824 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e3093a-b295-48e2-a3d3-56e80568b261 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:55.013643 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e3093a-b295-48e2-a3d3-56e80568b261 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:55.020237 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d60244-bf7e-4675-94ad-e871e706f0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:55.021040 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d60244-bf7e-4675-94ad-e871e706f0b6 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:55.021525 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d60244-bf7e-4675-94ad-e871e706f0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:55.021821 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d60244-bf7e-4675-94ad-e871e706f0b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:55.022727 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d60244-bf7e-4675-94ad-e871e706f0b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:55.024934 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d60244-bf7e-4675-94ad-e871e706f0b6 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:55.038894 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1142/2282] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:49:54 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:49:55.044482 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37361fea-4adf-40ae-b829-13ca87cecdb7 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:55.059950 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37361fea-4adf-40ae-b829-13ca87cecdb7 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:55.071873 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6daf1a9-3491-4bf6-a57e-4dffc6c7bf9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:55.072771 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6daf1a9-3491-4bf6-a57e-4dffc6c7bf9c admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:55.074051 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6daf1a9-3491-4bf6-a57e-4dffc6c7bf9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:55.074051 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6daf1a9-3491-4bf6-a57e-4dffc6c7bf9c admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:55.074533 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6daf1a9-3491-4bf6-a57e-4dffc6c7bf9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:55.077487 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6daf1a9-3491-4bf6-a57e-4dffc6c7bf9c admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:55.097926 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1141/2283] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:49:55 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:49:55.099296 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d60244-bf7e-4675-94ad-e871e706f0b6 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:55.110789 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d60244-bf7e-4675-94ad-e871e706f0b6 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:55.116100 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0528d7-63bb-462c-a943-8e2ea7342b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:55.117301 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0528d7-63bb-462c-a943-8e2ea7342b47 admin admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:55.117648 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0528d7-63bb-462c-a943-8e2ea7342b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:55.117998 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0528d7-63bb-462c-a943-8e2ea7342b47 admin admin] PATH_INFO: `/v3/projects/3d361ac1d93b4f248f6d492fc5ed28cf/users/4cd6ddd3d69643cba6169f07408b8e99/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:55.128909 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:55.143644 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0528d7-63bb-462c-a943-8e2ea7342b47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d361ac1d93b4f248f6d492fc5ed28cf, user_id=4cd6ddd3d69643cba6169f07408b8e99, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:55.146950 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0528d7-63bb-462c-a943-8e2ea7342b47 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:55.178183 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1143/2284] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:49:55 2022] PUT /identity/v3/projects/3d361ac1d93b4f248f6d492fc5ed28cf/users/4cd6ddd3d69643cba6169f07408b8e99/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 08:49:55.184763 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02891937-f458-4a64-93b8-b5befbdac792 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:55.185083 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02891937-f458-4a64-93b8-b5befbdac792 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:55.185711 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02891937-f458-4a64-93b8-b5befbdac792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:55.223630 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-02891937-f458-4a64-93b8-b5befbdac792 None None] MFA Rules not processed for user `4cd6ddd3d69643cba6169f07408b8e99`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:55.225146 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-02891937-f458-4a64-93b8-b5befbdac792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:55.287219 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:55.371745 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1142/2285] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:49:55.376749 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0528d7-63bb-462c-a943-8e2ea7342b47 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:55.379817 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-5f0528d7-63bb-462c-a943-8e2ea7342b47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:55.457187 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0528d7-63bb-462c-a943-8e2ea7342b47 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:55.462494 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1452cd90-a3d9-49e9-96da-5abb1684cb42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:55.463309 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452cd90-a3d9-49e9-96da-5abb1684cb42 service cinder] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:55.463703 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452cd90-a3d9-49e9-96da-5abb1684cb42 service cinder] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:55.464088 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452cd90-a3d9-49e9-96da-5abb1684cb42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:55.478810 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1452cd90-a3d9-49e9-96da-5abb1684cb42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:55.480678 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1452cd90-a3d9-49e9-96da-5abb1684cb42 service cinder] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:55.509234 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1144/2286] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:49:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:49:58.712276 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02891937-f458-4a64-93b8-b5befbdac792 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:58.926545 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02891937-f458-4a64-93b8-b5befbdac792 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:58.939176 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214992c5-0d5e-4c81-9e1f-6cda5477c188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:58.940082 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214992c5-0d5e-4c81-9e1f-6cda5477c188 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:58.940364 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214992c5-0d5e-4c81-9e1f-6cda5477c188 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:58.941039 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214992c5-0d5e-4c81-9e1f-6cda5477c188 admin admin] PATH_INFO: `/v3/users/4cd6ddd3d69643cba6169f07408b8e99` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:58.943707 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214992c5-0d5e-4c81-9e1f-6cda5477c188 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cd6ddd3d69643cba6169f07408b8e99)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:58.945700 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214992c5-0d5e-4c81-9e1f-6cda5477c188 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:58.997186 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1452cd90-a3d9-49e9-96da-5abb1684cb42 service cinder] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:59.013774 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1452cd90-a3d9-49e9-96da-5abb1684cb42 service cinder] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:59.040754 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83005c2-aac3-4e70-a862-e44f491b42dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:59.041899 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83005c2-aac3-4e70-a862-e44f491b42dc service cinder] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:59.042370 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83005c2-aac3-4e70-a862-e44f491b42dc service cinder] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:59.042807 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83005c2-aac3-4e70-a862-e44f491b42dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:59.047426 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-c83005c2-aac3-4e70-a862-e44f491b42dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:59.118266 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-214992c5-0d5e-4c81-9e1f-6cda5477c188 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cd6ddd3d69643cba6169f07408b8e99'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:59.145048 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-214992c5-0d5e-4c81-9e1f-6cda5477c188 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cd6ddd3d69643cba6169f07408b8e99'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:59.146766 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-214992c5-0d5e-4c81-9e1f-6cda5477c188 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cd6ddd3d69643cba6169f07408b8e99'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:59.168752 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-214992c5-0d5e-4c81-9e1f-6cda5477c188 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cd6ddd3d69643cba6169f07408b8e99'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:59.170787 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-214992c5-0d5e-4c81-9e1f-6cda5477c188 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cd6ddd3d69643cba6169f07408b8e99'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:49:59.231842 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1143/2287] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 08:49:58 2022] DELETE /identity/v3/users/4cd6ddd3d69643cba6169f07408b8e99 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:59.236589 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9bee81-aadc-45b9-b59c-e29357dedbc4 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:59.236883 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9bee81-aadc-45b9-b59c-e29357dedbc4 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:59.237168 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9bee81-aadc-45b9-b59c-e29357dedbc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:59.281260 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83005c2-aac3-4e70-a862-e44f491b42dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:59.282955 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83005c2-aac3-4e70-a862-e44f491b42dc service cinder] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:59.292818 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-6e9bee81-aadc-45b9-b59c-e29357dedbc4 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:59.293474 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-6e9bee81-aadc-45b9-b59c-e29357dedbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:59.315223 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1145/2288] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:49:58 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:49:59.451721 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:59.473464 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1144/2289] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:49:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 08:49:59.508259 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83005c2-aac3-4e70-a862-e44f491b42dc service cinder] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:59.510426 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-c83005c2-aac3-4e70-a862-e44f491b42dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:59.710682 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83005c2-aac3-4e70-a862-e44f491b42dc service cinder] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:59.871627 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:59.916425 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15bd58d-26cc-4248-a033-ec196d329d8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:59.917130 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15bd58d-26cc-4248-a033-ec196d329d8d service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:59.917410 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15bd58d-26cc-4248-a033-ec196d329d8d service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:59.917688 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15bd58d-26cc-4248-a033-ec196d329d8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:59.939214 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15bd58d-26cc-4248-a033-ec196d329d8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:59.940956 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15bd58d-26cc-4248-a033-ec196d329d8d service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:59.973956 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1146/2290] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:49:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:50:01.644578 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9bee81-aadc-45b9-b59c-e29357dedbc4 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:01.648480 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-6e9bee81-aadc-45b9-b59c-e29357dedbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:01.694209 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9bee81-aadc-45b9-b59c-e29357dedbc4 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:01.726163 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e76b577-4b22-49d7-b862-286564d31f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:01.731467 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76b577-4b22-49d7-b862-286564d31f3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:01.732925 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76b577-4b22-49d7-b862-286564d31f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:01.735962 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76b577-4b22-49d7-b862-286564d31f3d admin admin] PATH_INFO: `/v3/projects/3d361ac1d93b4f248f6d492fc5ed28cf` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:01.748541 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e76b577-4b22-49d7-b862-286564d31f3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d361ac1d93b4f248f6d492fc5ed28cf)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:01.756088 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e76b577-4b22-49d7-b862-286564d31f3d admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:01.912813 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-6e76b577-4b22-49d7-b862-286564d31f3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d361ac1d93b4f248f6d492fc5ed28cf', 'request_id': 'req-6e76b577-4b22-49d7-b862-286564d31f3d'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:50:01.925773 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-6e76b577-4b22-49d7-b862-286564d31f3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d361ac1d93b4f248f6d492fc5ed28cf', 'request_id': 'req-6e76b577-4b22-49d7-b862-286564d31f3d'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:50:01.948840 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-6e76b577-4b22-49d7-b862-286564d31f3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d361ac1d93b4f248f6d492fc5ed28cf', 'request_id': 'req-6e76b577-4b22-49d7-b862-286564d31f3d'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:50:02.007036 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-6e76b577-4b22-49d7-b862-286564d31f3d admin admin] The token cache is being invalidate because project 3d361ac1d93b4f248f6d492fc5ed28cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 08:50:02.007320 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-6e76b577-4b22-49d7-b862-286564d31f3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:50:02.008245 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-6e76b577-4b22-49d7-b862-286564d31f3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:50:02.011162 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1145/2291] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 08:50:01 2022] DELETE /identity/v3/projects/3d361ac1d93b4f248f6d492fc5ed28cf => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 08:50:02.016758 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc7ebd-59b1-4042-81a7-0e22c54ccdb7 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:02.017225 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc7ebd-59b1-4042-81a7-0e22c54ccdb7 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:02.017225 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc7ebd-59b1-4042-81a7-0e22c54ccdb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:02.063835 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-c4dc7ebd-59b1-4042-81a7-0e22c54ccdb7 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:50:02.066230 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-c4dc7ebd-59b1-4042-81a7-0e22c54ccdb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:02.186133 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1147/2292] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:50:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:50:02.195938 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee4aad-16f7-4811-b523-428bdfd66d19 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:02.196302 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee4aad-16f7-4811-b523-428bdfd66d19 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:02.196489 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee4aad-16f7-4811-b523-428bdfd66d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:02.219669 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-c1ee4aad-16f7-4811-b523-428bdfd66d19 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:50:02.220928 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-c1ee4aad-16f7-4811-b523-428bdfd66d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:02.230113 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1146/2293] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:50:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 08:50:02.235156 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc7ebd-59b1-4042-81a7-0e22c54ccdb7 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:02.280020 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc7ebd-59b1-4042-81a7-0e22c54ccdb7 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:02.285352 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc92bc5a-e7b9-4f7e-b9c1-aae8ccfd11f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:02.286037 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92bc5a-e7b9-4f7e-b9c1-aae8ccfd11f7 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:02.286355 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92bc5a-e7b9-4f7e-b9c1-aae8ccfd11f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:02.286639 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92bc5a-e7b9-4f7e-b9c1-aae8ccfd11f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:02.287390 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc92bc5a-e7b9-4f7e-b9c1-aae8ccfd11f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:50:02.287883 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc92bc5a-e7b9-4f7e-b9c1-aae8ccfd11f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:02.289887 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc92bc5a-e7b9-4f7e-b9c1-aae8ccfd11f7 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:02.321455 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1148/2294] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Jun 22 08:50:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:50:02.322338 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ee4aad-16f7-4811-b523-428bdfd66d19 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:02.334290 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ee4aad-16f7-4811-b523-428bdfd66d19 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:02.343772 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ab32a-7463-4d43-bfd7-cf16aeab15af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:02.344630 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ab32a-7463-4d43-bfd7-cf16aeab15af admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:02.344993 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ab32a-7463-4d43-bfd7-cf16aeab15af admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:02.345345 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ab32a-7463-4d43-bfd7-cf16aeab15af admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:02.346182 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181ab32a-7463-4d43-bfd7-cf16aeab15af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:02.348269 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181ab32a-7463-4d43-bfd7-cf16aeab15af admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:02.408907 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1147/2295] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 08:50:02 2022] POST /identity/v3/projects => generated 383 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:50:02.410690 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc92bc5a-e7b9-4f7e-b9c1-aae8ccfd11f7 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:02.423635 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc92bc5a-e7b9-4f7e-b9c1-aae8ccfd11f7 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:02.550935 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c75b87-0664-400c-aba1-8f288ba4dc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:02.551784 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c75b87-0664-400c-aba1-8f288ba4dc73 admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:02.552369 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c75b87-0664-400c-aba1-8f288ba4dc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:02.552772 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c75b87-0664-400c-aba1-8f288ba4dc73 admin admin] PATH_INFO: `/v3/users` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:02.553654 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c75b87-0664-400c-aba1-8f288ba4dc73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:02.555907 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c75b87-0664-400c-aba1-8f288ba4dc73 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:02.607784 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1149/2296] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 08:50:02 2022] POST /identity/v3/users => generated 292 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:50:02.612414 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ab32a-7463-4d43-bfd7-cf16aeab15af admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:02.631681 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ab32a-7463-4d43-bfd7-cf16aeab15af admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:02.639243 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd20b2-ca09-43b7-b670-a2328abeb9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:02.640130 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd20b2-ca09-43b7-b670-a2328abeb9a1 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:02.640519 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd20b2-ca09-43b7-b670-a2328abeb9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:02.641391 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd20b2-ca09-43b7-b670-a2328abeb9a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:02.642531 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dd20b2-ca09-43b7-b670-a2328abeb9a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:02.645432 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dd20b2-ca09-43b7-b670-a2328abeb9a1 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:02.662766 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1148/2297] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:50:02.665994 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c75b87-0664-400c-aba1-8f288ba4dc73 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:02.682576 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c75b87-0664-400c-aba1-8f288ba4dc73 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:02.698570 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e570eb-a17f-4d5f-bbe1-983cc40240a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:02.700189 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e570eb-a17f-4d5f-bbe1-983cc40240a1 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:02.700723 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e570eb-a17f-4d5f-bbe1-983cc40240a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:02.701510 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e570eb-a17f-4d5f-bbe1-983cc40240a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:02.702715 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e570eb-a17f-4d5f-bbe1-983cc40240a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:02.704702 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e570eb-a17f-4d5f-bbe1-983cc40240a1 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:02.721910 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1150/2298] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 08:50:02.723447 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd20b2-ca09-43b7-b670-a2328abeb9a1 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:02.758093 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd20b2-ca09-43b7-b670-a2328abeb9a1 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:02.772955 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10af3648-841c-4f5c-924b-1e3a09fcdaba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:02.774271 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af3648-841c-4f5c-924b-1e3a09fcdaba admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:02.774735 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af3648-841c-4f5c-924b-1e3a09fcdaba admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:02.777268 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af3648-841c-4f5c-924b-1e3a09fcdaba admin admin] PATH_INFO: `/v3/projects/898e7193de204076abe886e6b4e4a581/users/dac980fabf4f4fef8694d1ce2d75372c/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:02.787759 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e570eb-a17f-4d5f-bbe1-983cc40240a1 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:02.789717 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-28e570eb-a17f-4d5f-bbe1-983cc40240a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:02.804491 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10af3648-841c-4f5c-924b-1e3a09fcdaba admin admin] RBAC: Authorizing `identity:create_grant(project_id=898e7193de204076abe886e6b4e4a581, user_id=dac980fabf4f4fef8694d1ce2d75372c, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:02.807675 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10af3648-841c-4f5c-924b-1e3a09fcdaba admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:02.819890 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e570eb-a17f-4d5f-bbe1-983cc40240a1 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:02.833125 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1149/2299] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:50:02 2022] PUT /identity/v3/projects/898e7193de204076abe886e6b4e4a581/users/dac980fabf4f4fef8694d1ce2d75372c/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:50:02.835463 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3784f3a5-eee3-4dad-9260-e10c7a5f53c0 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:02.838010 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3784f3a5-eee3-4dad-9260-e10c7a5f53c0 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:02.838548 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3784f3a5-eee3-4dad-9260-e10c7a5f53c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:02.883317 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-3784f3a5-eee3-4dad-9260-e10c7a5f53c0 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:50:02.886127 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-3784f3a5-eee3-4dad-9260-e10c7a5f53c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:02.927716 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:02.942218 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35311542-9455-4b78-bb44-5a734eac1247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:02.943609 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35311542-9455-4b78-bb44-5a734eac1247 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:02.944050 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35311542-9455-4b78-bb44-5a734eac1247 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:02.944506 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35311542-9455-4b78-bb44-5a734eac1247 admin admin] PATH_INFO: `/v3/users/dce801e8be544cfd93214a18c5e4299d` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:02.946056 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35311542-9455-4b78-bb44-5a734eac1247 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dce801e8be544cfd93214a18c5e4299d)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:02.948284 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35311542-9455-4b78-bb44-5a734eac1247 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:03.042842 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-35311542-9455-4b78-bb44-5a734eac1247 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dce801e8be544cfd93214a18c5e4299d'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:50:03.065320 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-35311542-9455-4b78-bb44-5a734eac1247 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dce801e8be544cfd93214a18c5e4299d'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:50:03.067993 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-35311542-9455-4b78-bb44-5a734eac1247 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dce801e8be544cfd93214a18c5e4299d'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:50:03.087808 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1150/2300] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:50:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 08:50:03.092948 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-35311542-9455-4b78-bb44-5a734eac1247 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dce801e8be544cfd93214a18c5e4299d'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:50:03.094616 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-35311542-9455-4b78-bb44-5a734eac1247 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dce801e8be544cfd93214a18c5e4299d'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:50:03.103712 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33314e0c-e0a5-4f55-b036-e2c575a65120 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:03.104160 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33314e0c-e0a5-4f55-b036-e2c575a65120 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:03.104550 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33314e0c-e0a5-4f55-b036-e2c575a65120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:03.130964 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1151/2301] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 08:50:02 2022] DELETE /identity/v3/users/dce801e8be544cfd93214a18c5e4299d => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 08:50:03.132031 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35311542-9455-4b78-bb44-5a734eac1247 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:03.137628 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-35311542-9455-4b78-bb44-5a734eac1247 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:03.164573 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-33314e0c-e0a5-4f55-b036-e2c575a65120 None None] MFA Rules not processed for user `1e2282b381e64067a8535b3d23e6c91f`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:50:03.167236 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-33314e0c-e0a5-4f55-b036-e2c575a65120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:03.178036 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:03.280196 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35311542-9455-4b78-bb44-5a734eac1247 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:03.286685 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c3984-0c0f-40e7-b187-7ea7196b9a89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:03.287279 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c3984-0c0f-40e7-b187-7ea7196b9a89 service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:03.287567 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c3984-0c0f-40e7-b187-7ea7196b9a89 service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:03.288122 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c3984-0c0f-40e7-b187-7ea7196b9a89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:03.290478 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-7f4c3984-0c0f-40e7-b187-7ea7196b9a89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:03.368499 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1151/2302] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:50:03 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 08:50:03.368499 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6ad53-5cca-42e9-8f53-cb9927ea9f2d None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:03.368499 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6ad53-5cca-42e9-8f53-cb9927ea9f2d None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:03.368499 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6ad53-5cca-42e9-8f53-cb9927ea9f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:03.401060 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-ace6ad53-5cca-42e9-8f53-cb9927ea9f2d None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:50:03.402451 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-ace6ad53-5cca-42e9-8f53-cb9927ea9f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:03.433818 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4c3984-0c0f-40e7-b187-7ea7196b9a89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:03.435724 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4c3984-0c0f-40e7-b187-7ea7196b9a89 service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:03.449610 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1152/2303] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:50:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:50:03.450559 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c3984-0c0f-40e7-b187-7ea7196b9a89 service neutron] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:03.452077 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-7f4c3984-0c0f-40e7-b187-7ea7196b9a89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:03.482404 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:03.535921 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1152/2304] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:50:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:50:03.545765 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6ad53-5cca-42e9-8f53-cb9927ea9f2d None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:03.548026 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-ace6ad53-5cca-42e9-8f53-cb9927ea9f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:03.561081 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c3984-0c0f-40e7-b187-7ea7196b9a89 service neutron] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:03.567980 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6ad53-5cca-42e9-8f53-cb9927ea9f2d None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:03.568208 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc89343c-4849-4b88-a3fd-c5a302ec8e8d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589eb8cc97714580840ac7a48ea38ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:03.568788 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc89343c-4849-4b88-a3fd-c5a302ec8e8d service glance] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:03.569080 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc89343c-4849-4b88-a3fd-c5a302ec8e8d service glance] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:03.569364 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc89343c-4849-4b88-a3fd-c5a302ec8e8d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:03.571487 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-cc89343c-4849-4b88-a3fd-c5a302ec8e8d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:03.580661 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935b533-7de5-48c0-9157-ba9ef15b4db0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:03.582356 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935b533-7de5-48c0-9157-ba9ef15b4db0 service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:03.582863 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935b533-7de5-48c0-9157-ba9ef15b4db0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:03.585151 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935b533-7de5-48c0-9157-ba9ef15b4db0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:03.597768 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a935b533-7de5-48c0-9157-ba9ef15b4db0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:03.599488 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a935b533-7de5-48c0-9157-ba9ef15b4db0 service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:03.611013 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1153/2305] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:50:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:50:03.666933 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc89343c-4849-4b88-a3fd-c5a302ec8e8d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:03.668879 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc89343c-4849-4b88-a3fd-c5a302ec8e8d service glance] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:03.680776 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1153/2306] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:50:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:50:03.845587 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd5d9e-24c3-403f-9f0b-61cb7eb95bc4 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:03.846102 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd5d9e-24c3-403f-9f0b-61cb7eb95bc4 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:03.846188 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd5d9e-24c3-403f-9f0b-61cb7eb95bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:03.869282 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-9ebd5d9e-24c3-403f-9f0b-61cb7eb95bc4 None None] MFA Rules not processed for user `2bf91272d78b4e8f854c760622465af9`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:50:03.871318 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-9ebd5d9e-24c3-403f-9f0b-61cb7eb95bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:03.993051 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1154/2307] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Jun 22 08:50:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:50:04.062118 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc89343c-4849-4b88-a3fd-c5a302ec8e8d service glance] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:04.064704 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-cc89343c-4849-4b88-a3fd-c5a302ec8e8d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:04.107814 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd5d9e-24c3-403f-9f0b-61cb7eb95bc4 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:04.111989 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-9ebd5d9e-24c3-403f-9f0b-61cb7eb95bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:04.146733 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd5d9e-24c3-403f-9f0b-61cb7eb95bc4 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:04.152004 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df2035-155d-485c-940e-be158e00f2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:04.153019 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df2035-155d-485c-940e-be158e00f2ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:04.153613 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df2035-155d-485c-940e-be158e00f2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:04.154959 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df2035-155d-485c-940e-be158e00f2ee admin admin] PATH_INFO: `/v3/projects/b89755b8ece445448699f79df102d8fe` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:04.157473 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82df2035-155d-485c-940e-be158e00f2ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=b89755b8ece445448699f79df102d8fe)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:04.163104 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82df2035-155d-485c-940e-be158e00f2ee admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:04.238686 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc89343c-4849-4b88-a3fd-c5a302ec8e8d service glance] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:04.261426 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26720f7b-2b41-4ac7-945b-b413bdd95d7f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4403cea84ff646b88cdb785975b20346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:04.264366 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26720f7b-2b41-4ac7-945b-b413bdd95d7f service swift] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:04.265043 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26720f7b-2b41-4ac7-945b-b413bdd95d7f service swift] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:04.266299 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26720f7b-2b41-4ac7-945b-b413bdd95d7f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:04.287469 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:04.307938 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26720f7b-2b41-4ac7-945b-b413bdd95d7f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:04.310066 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26720f7b-2b41-4ac7-945b-b413bdd95d7f service swift] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:04.333225 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-82df2035-155d-485c-940e-be158e00f2ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b89755b8ece445448699f79df102d8fe', 'request_id': 'req-82df2035-155d-485c-940e-be158e00f2ee'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:50:04.343603 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1154/2308] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Jun 22 08:50:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 08:50:04.344905 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-82df2035-155d-485c-940e-be158e00f2ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b89755b8ece445448699f79df102d8fe', 'request_id': 'req-82df2035-155d-485c-940e-be158e00f2ee'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:50:04.352744 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1dea3b-1bb3-4d37-bc1d-0f4346692071 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:04.353127 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1dea3b-1bb3-4d37-bc1d-0f4346692071 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:04.353326 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1dea3b-1bb3-4d37-bc1d-0f4346692071 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:04.355234 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1155/2309] 10.222.0.42 () {54 vars in 921 bytes} [Wed Jun 22 08:50:04 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:50:04.356282 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-82df2035-155d-485c-940e-be158e00f2ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b89755b8ece445448699f79df102d8fe', 'request_id': 'req-82df2035-155d-485c-940e-be158e00f2ee'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:50:04.372536 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de100da9-7a0b-4456-8641-b2edd64fb322 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:04.372536 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de100da9-7a0b-4456-8641-b2edd64fb322 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:04.372536 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de100da9-7a0b-4456-8641-b2edd64fb322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:04.396493 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-82df2035-155d-485c-940e-be158e00f2ee admin admin] The token cache is being invalidate because project b89755b8ece445448699f79df102d8fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 08:50:04.396870 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-82df2035-155d-485c-940e-be158e00f2ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:50:04.397515 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-82df2035-155d-485c-940e-be158e00f2ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:50:04.399478 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1155/2310] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 08:50:04 2022] DELETE /identity/v3/projects/b89755b8ece445448699f79df102d8fe => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:50:04.407504 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919af3ee-b3f5-408b-91aa-431cf4183c9f None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:04.407733 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919af3ee-b3f5-408b-91aa-431cf4183c9f None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:04.408478 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919af3ee-b3f5-408b-91aa-431cf4183c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:04.413460 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-de100da9-7a0b-4456-8641-b2edd64fb322 None None] MFA Rules not processed for user `ec2627e3cdc94ec38d7cc3b1bc670ef1`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:50:04.414732 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-de100da9-7a0b-4456-8641-b2edd64fb322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:04.444278 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-919af3ee-b3f5-408b-91aa-431cf4183c9f None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:50:04.449628 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-919af3ee-b3f5-408b-91aa-431cf4183c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:04.546704 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:04.570118 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1156/2311] 10.222.0.42 () {58 vars in 1018 bytes} [Wed Jun 22 08:50:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:50:04.601725 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de100da9-7a0b-4456-8641-b2edd64fb322 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:04.604585 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-de100da9-7a0b-4456-8641-b2edd64fb322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:04.659274 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1156/2312] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:50:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:50:04.664894 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919af3ee-b3f5-408b-91aa-431cf4183c9f None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:04.669725 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-919af3ee-b3f5-408b-91aa-431cf4183c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:04.705146 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919af3ee-b3f5-408b-91aa-431cf4183c9f None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:04.715667 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba11267b-63e4-4688-a2e4-ed0c4f3d0fea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec2627e3cdc94ec38d7cc3b1bc670ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:04.716919 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba11267b-63e4-4688-a2e4-ed0c4f3d0fea service placement] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:04.717829 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba11267b-63e4-4688-a2e4-ed0c4f3d0fea service placement] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:04.720863 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba11267b-63e4-4688-a2e4-ed0c4f3d0fea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:04.732674 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba11267b-63e4-4688-a2e4-ed0c4f3d0fea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:04.734771 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba11267b-63e4-4688-a2e4-ed0c4f3d0fea service placement] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:04.756631 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1157/2313] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:50:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:50:04.761880 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a4ac1-5486-44f6-a401-6b394faa07a9 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:04.762477 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a4ac1-5486-44f6-a401-6b394faa07a9 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:04.763989 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a4ac1-5486-44f6-a401-6b394faa07a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:04.769452 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de100da9-7a0b-4456-8641-b2edd64fb322 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:04.786837 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d6f58-10d9-47e2-905c-cdb8f9d2d2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:04.789032 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d6f58-10d9-47e2-905c-cdb8f9d2d2e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:04.789330 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d6f58-10d9-47e2-905c-cdb8f9d2d2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:04.789614 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d6f58-10d9-47e2-905c-cdb8f9d2d2e3 admin admin] PATH_INFO: `/v3/users/7dc678cd12ee45809813046f76faf018` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:04.796226 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6d6f58-10d9-47e2-905c-cdb8f9d2d2e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dc678cd12ee45809813046f76faf018)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:04.800295 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6d6f58-10d9-47e2-905c-cdb8f9d2d2e3 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:04.841679 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-049a4ac1-5486-44f6-a401-6b394faa07a9 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:50:04.842816 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-049a4ac1-5486-44f6-a401-6b394faa07a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:04.878017 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1158/2314] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:50:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:50:04.878908 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a4ac1-5486-44f6-a401-6b394faa07a9 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:04.912450 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a4ac1-5486-44f6-a401-6b394faa07a9 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:04.926244 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-ea6d6f58-10d9-47e2-905c-cdb8f9d2d2e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dc678cd12ee45809813046f76faf018'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:50:04.938472 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-ea6d6f58-10d9-47e2-905c-cdb8f9d2d2e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dc678cd12ee45809813046f76faf018'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:50:04.938709 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d225caaf-65fd-4786-95ab-e39fc8e58a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:04.939331 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225caaf-65fd-4786-95ab-e39fc8e58a93 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:04.939590 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225caaf-65fd-4786-95ab-e39fc8e58a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:04.940242 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225caaf-65fd-4786-95ab-e39fc8e58a93 admin admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:04.941004 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d225caaf-65fd-4786-95ab-e39fc8e58a93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:50:04.941323 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d225caaf-65fd-4786-95ab-e39fc8e58a93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:04.947570 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d225caaf-65fd-4786-95ab-e39fc8e58a93 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:04.951842 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-ea6d6f58-10d9-47e2-905c-cdb8f9d2d2e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dc678cd12ee45809813046f76faf018'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:50:04.965168 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-ea6d6f58-10d9-47e2-905c-cdb8f9d2d2e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dc678cd12ee45809813046f76faf018'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:50:04.966113 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-ea6d6f58-10d9-47e2-905c-cdb8f9d2d2e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dc678cd12ee45809813046f76faf018'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:50:04.975683 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1159/2315] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Jun 22 08:50:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:50:04.980609 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d225caaf-65fd-4786-95ab-e39fc8e58a93 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:04.984000 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-d225caaf-65fd-4786-95ab-e39fc8e58a93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:05.002975 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1157/2316] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 08:50:04 2022] DELETE /identity/v3/users/7dc678cd12ee45809813046f76faf018 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:50:05.027214 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d225caaf-65fd-4786-95ab-e39fc8e58a93 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:05.174233 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefeecba-e52b-43af-975a-1aaab04d70ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:05.174971 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefeecba-e52b-43af-975a-1aaab04d70ef admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:05.175503 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefeecba-e52b-43af-975a-1aaab04d70ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:05.175786 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefeecba-e52b-43af-975a-1aaab04d70ef admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:05.176504 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefeecba-e52b-43af-975a-1aaab04d70ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:05.179405 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefeecba-e52b-43af-975a-1aaab04d70ef admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:05.236019 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1160/2317] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 08:50:04 2022] POST /identity/v3/projects => generated 375 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:50:05.240234 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d6f58-10d9-47e2-905c-cdb8f9d2d2e3 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:05.256451 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d6f58-10d9-47e2-905c-cdb8f9d2d2e3 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:05.434528 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b684385d-19dd-4036-961f-2d2d27c6b085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:05.435852 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b684385d-19dd-4036-961f-2d2d27c6b085 admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:05.436245 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b684385d-19dd-4036-961f-2d2d27c6b085 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:05.436635 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b684385d-19dd-4036-961f-2d2d27c6b085 admin admin] PATH_INFO: `/v3/users` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:05.438114 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b684385d-19dd-4036-961f-2d2d27c6b085 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:05.443248 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b684385d-19dd-4036-961f-2d2d27c6b085 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:05.507735 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1158/2318] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 08:50:05 2022] POST /identity/v3/users => generated 288 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:50:05.508541 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefeecba-e52b-43af-975a-1aaab04d70ef admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:05.521753 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefeecba-e52b-43af-975a-1aaab04d70ef admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:05.538801 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed034bb-d638-4e05-9b3d-3c1d37fa2fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:05.541200 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed034bb-d638-4e05-9b3d-3c1d37fa2fe6 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:05.545713 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed034bb-d638-4e05-9b3d-3c1d37fa2fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:05.546429 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed034bb-d638-4e05-9b3d-3c1d37fa2fe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:05.547481 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed034bb-d638-4e05-9b3d-3c1d37fa2fe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:05.552479 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed034bb-d638-4e05-9b3d-3c1d37fa2fe6 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:05.581222 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b684385d-19dd-4036-961f-2d2d27c6b085 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:05.586386 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:05.587108 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-b684385d-19dd-4036-961f-2d2d27c6b085 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:05.603799 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1161/2319] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:50:05.606741 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed034bb-d638-4e05-9b3d-3c1d37fa2fe6 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:05.612037 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-fed034bb-d638-4e05-9b3d-3c1d37fa2fe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:05.618675 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b684385d-19dd-4036-961f-2d2d27c6b085 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:05.634826 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed034bb-d638-4e05-9b3d-3c1d37fa2fe6 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:05.635768 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a32db0-ada2-4ce7-bae7-7cbc41e64797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:05.637207 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a32db0-ada2-4ce7-bae7-7cbc41e64797 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:05.637723 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a32db0-ada2-4ce7-bae7-7cbc41e64797 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:05.641563 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d015ce0-87a2-49d3-ada1-a2a5abf8af10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:05.642505 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d015ce0-87a2-49d3-ada1-a2a5abf8af10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:05.642690 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a32db0-ada2-4ce7-bae7-7cbc41e64797 admin admin] PATH_INFO: `/v3/projects/2737e16ccd874352b9e731e7ed64ba90` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:05.642801 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d015ce0-87a2-49d3-ada1-a2a5abf8af10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:05.643050 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d015ce0-87a2-49d3-ada1-a2a5abf8af10 admin admin] PATH_INFO: `/v3/users/106473e3997a4ae3a549f269f8b243ad` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:05.647915 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d015ce0-87a2-49d3-ada1-a2a5abf8af10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=106473e3997a4ae3a549f269f8b243ad)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:05.648526 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a32db0-ada2-4ce7-bae7-7cbc41e64797 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2737e16ccd874352b9e731e7ed64ba90)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:05.650703 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a32db0-ada2-4ce7-bae7-7cbc41e64797 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:05.653430 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d015ce0-87a2-49d3-ada1-a2a5abf8af10 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:05.656154 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:05.753927 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-4d015ce0-87a2-49d3-ada1-a2a5abf8af10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '106473e3997a4ae3a549f269f8b243ad'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:50:05.769221 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-85a32db0-ada2-4ce7-bae7-7cbc41e64797 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2737e16ccd874352b9e731e7ed64ba90', 'request_id': 'req-85a32db0-ada2-4ce7-bae7-7cbc41e64797'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:50:05.770776 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-4d015ce0-87a2-49d3-ada1-a2a5abf8af10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '106473e3997a4ae3a549f269f8b243ad'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:50:05.771648 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-4d015ce0-87a2-49d3-ada1-a2a5abf8af10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '106473e3997a4ae3a549f269f8b243ad'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:50:05.784277 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-85a32db0-ada2-4ce7-bae7-7cbc41e64797 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2737e16ccd874352b9e731e7ed64ba90', 'request_id': 'req-85a32db0-ada2-4ce7-bae7-7cbc41e64797'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:50:05.792649 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-4d015ce0-87a2-49d3-ada1-a2a5abf8af10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '106473e3997a4ae3a549f269f8b243ad'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:50:05.793358 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-4d015ce0-87a2-49d3-ada1-a2a5abf8af10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '106473e3997a4ae3a549f269f8b243ad'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:50:05.801355 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-85a32db0-ada2-4ce7-bae7-7cbc41e64797 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2737e16ccd874352b9e731e7ed64ba90', 'request_id': 'req-85a32db0-ada2-4ce7-bae7-7cbc41e64797'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:50:05.827982 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-85a32db0-ada2-4ce7-bae7-7cbc41e64797 admin admin] The token cache is being invalidate because project 2737e16ccd874352b9e731e7ed64ba90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 08:50:05.828925 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-85a32db0-ada2-4ce7-bae7-7cbc41e64797 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:50:05.830046 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-85a32db0-ada2-4ce7-bae7-7cbc41e64797 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:50:05.835608 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1159/2320] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 08:50:05 2022] DELETE /identity/v3/projects/2737e16ccd874352b9e731e7ed64ba90 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:50:05.836601 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a32db0-ada2-4ce7-bae7-7cbc41e64797 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:05.837560 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1162/2321] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 08:50:05 2022] DELETE /identity/v3/users/106473e3997a4ae3a549f269f8b243ad => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:50:05.842555 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-85a32db0-ada2-4ce7-bae7-7cbc41e64797 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:05.845558 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360feb6c-8ef1-4092-a847-0feaf014e5f0 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:05.845884 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360feb6c-8ef1-4092-a847-0feaf014e5f0 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:05.846262 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360feb6c-8ef1-4092-a847-0feaf014e5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:05.897697 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-360feb6c-8ef1-4092-a847-0feaf014e5f0 None None] MFA Rules not processed for user `dac980fabf4f4fef8694d1ce2d75372c`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:50:05.902064 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-360feb6c-8ef1-4092-a847-0feaf014e5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:06.021115 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a32db0-ada2-4ce7-bae7-7cbc41e64797 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:06.048075 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1163/2322] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:50:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:50:06.051832 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8500d-4e23-4b3a-8424-5f7730043139 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:06.051832 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8500d-4e23-4b3a-8424-5f7730043139 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:06.051832 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8500d-4e23-4b3a-8424-5f7730043139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:06.091133 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-88f8500d-4e23-4b3a-8424-5f7730043139 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:50:06.093173 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-88f8500d-4e23-4b3a-8424-5f7730043139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:06.167218 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9157d4f2-cc38-4f22-b52d-71e40221edb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:06.169838 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157d4f2-cc38-4f22-b52d-71e40221edb3 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:06.170289 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157d4f2-cc38-4f22-b52d-71e40221edb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:06.173121 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157d4f2-cc38-4f22-b52d-71e40221edb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:06.175526 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9157d4f2-cc38-4f22-b52d-71e40221edb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:06.178868 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9157d4f2-cc38-4f22-b52d-71e40221edb3 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:06.183406 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1164/2323] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:50:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:50:06.185455 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406ac13-dfbf-4bfe-8183-7150123c226e None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:06.185916 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406ac13-dfbf-4bfe-8183-7150123c226e None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:06.186344 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406ac13-dfbf-4bfe-8183-7150123c226e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:06.194818 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:06.212474 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1160/2324] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:50:06.214894 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-0406ac13-dfbf-4bfe-8183-7150123c226e None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:50:06.215058 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9157d4f2-cc38-4f22-b52d-71e40221edb3 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:06.216744 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-0406ac13-dfbf-4bfe-8183-7150123c226e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:06.222345 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-9157d4f2-cc38-4f22-b52d-71e40221edb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:06.228161 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1165/2325] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:50:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:50:06.242395 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb96b1c5-f111-4fb4-8319-3c37ed35fe8f None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:06.242831 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb96b1c5-f111-4fb4-8319-3c37ed35fe8f None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:06.243257 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb96b1c5-f111-4fb4-8319-3c37ed35fe8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:06.310270 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:06.313496 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-fb96b1c5-f111-4fb4-8319-3c37ed35fe8f None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:50:06.315163 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-fb96b1c5-f111-4fb4-8319-3c37ed35fe8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:06.337933 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1166/2326] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:50:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:50:06.339122 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb96b1c5-f111-4fb4-8319-3c37ed35fe8f None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:06.371764 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb96b1c5-f111-4fb4-8319-3c37ed35fe8f None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:06.376591 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9157d4f2-cc38-4f22-b52d-71e40221edb3 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:06.383455 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be85dd6-bf70-47fd-bdee-39df4a058b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:06.385715 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be85dd6-bf70-47fd-bdee-39df4a058b8d admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:06.389000 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be85dd6-bf70-47fd-bdee-39df4a058b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:06.389944 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be85dd6-bf70-47fd-bdee-39df4a058b8d admin admin] PATH_INFO: `/v3/projects/7e1482e9981842a2a6b05779d5959710/users/641df714d7d04666a11523f457b1c65c/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:06.396213 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cf0656-a527-46be-8fca-f93d8a4e774d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:06.396894 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf0656-a527-46be-8fca-f93d8a4e774d service cinder] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:06.398092 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf0656-a527-46be-8fca-f93d8a4e774d service cinder] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:06.398092 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf0656-a527-46be-8fca-f93d8a4e774d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:06.413317 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cf0656-a527-46be-8fca-f93d8a4e774d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:06.414970 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cf0656-a527-46be-8fca-f93d8a4e774d service cinder] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:06.421066 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be85dd6-bf70-47fd-bdee-39df4a058b8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e1482e9981842a2a6b05779d5959710, user_id=641df714d7d04666a11523f457b1c65c, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:06.426302 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be85dd6-bf70-47fd-bdee-39df4a058b8d admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:06.447328 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1161/2327] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:50:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:50:06.450039 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cf0656-a527-46be-8fca-f93d8a4e774d service cinder] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:06.452685 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-f9cf0656-a527-46be-8fca-f93d8a4e774d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:06.508519 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1167/2328] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:50:06 2022] PUT /identity/v3/projects/7e1482e9981842a2a6b05779d5959710/users/641df714d7d04666a11523f457b1c65c/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:50:06.508519 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be85dd6-bf70-47fd-bdee-39df4a058b8d admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:06.599247 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cf0656-a527-46be-8fca-f93d8a4e774d service cinder] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:06.717114 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be85dd6-bf70-47fd-bdee-39df4a058b8d admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:06.733707 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc995e7-8337-459d-98d6-f7970e3f31d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:06.734458 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc995e7-8337-459d-98d6-f7970e3f31d3 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:06.734876 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc995e7-8337-459d-98d6-f7970e3f31d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:06.735493 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc995e7-8337-459d-98d6-f7970e3f31d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:06.736782 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc995e7-8337-459d-98d6-f7970e3f31d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:50:06.738504 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc995e7-8337-459d-98d6-f7970e3f31d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:06.743526 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc995e7-8337-459d-98d6-f7970e3f31d3 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:06.761346 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a13eb-c3c6-48d3-8897-58c95fb8da29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:06.763389 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a13eb-c3c6-48d3-8897-58c95fb8da29 service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:06.763681 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a13eb-c3c6-48d3-8897-58c95fb8da29 service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:06.763963 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a13eb-c3c6-48d3-8897-58c95fb8da29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:06.775099 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200a13eb-c3c6-48d3-8897-58c95fb8da29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:06.776614 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200a13eb-c3c6-48d3-8897-58c95fb8da29 service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:06.788452 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1162/2329] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:50:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:50:06.790245 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012dc424-29ea-4d52-8221-18c6f2b3b931 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:06.790743 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012dc424-29ea-4d52-8221-18c6f2b3b931 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:06.791217 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012dc424-29ea-4d52-8221-18c6f2b3b931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:06.837434 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1168/2330] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Jun 22 08:50:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:50:06.839649 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc995e7-8337-459d-98d6-f7970e3f31d3 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:06.864251 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-012dc424-29ea-4d52-8221-18c6f2b3b931 None None] MFA Rules not processed for user `641df714d7d04666a11523f457b1c65c`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:50:06.868027 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-012dc424-29ea-4d52-8221-18c6f2b3b931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:06.878354 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc995e7-8337-459d-98d6-f7970e3f31d3 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:06.907460 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14638280-5988-4830-8619-f266d7d093aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:06.909894 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14638280-5988-4830-8619-f266d7d093aa admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:06.910744 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14638280-5988-4830-8619-f266d7d093aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:06.911029 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14638280-5988-4830-8619-f266d7d093aa admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:06.911752 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14638280-5988-4830-8619-f266d7d093aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:06.913745 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14638280-5988-4830-8619-f266d7d093aa admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:07.003101 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1169/2331] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 08:50:06 2022] POST /identity/v3/projects => generated 383 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:50:07.006691 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1163/2332] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:50:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:50:07.010825 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14638280-5988-4830-8619-f266d7d093aa admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:07.011697 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012dc424-29ea-4d52-8221-18c6f2b3b931 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:07.016077 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-012dc424-29ea-4d52-8221-18c6f2b3b931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:07.115610 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:07.197826 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012dc424-29ea-4d52-8221-18c6f2b3b931 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:07.305018 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14638280-5988-4830-8619-f266d7d093aa admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:07.324055 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a23004-7aac-4be1-a136-2aea7613fb81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:07.325283 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a23004-7aac-4be1-a136-2aea7613fb81 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:07.325772 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a23004-7aac-4be1-a136-2aea7613fb81 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:07.326228 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a23004-7aac-4be1-a136-2aea7613fb81 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:07.328268 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a23004-7aac-4be1-a136-2aea7613fb81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:07.332648 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a23004-7aac-4be1-a136-2aea7613fb81 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:07.367944 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dcd44b-147b-4d42-8656-e1697dbcc150 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:07.368641 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dcd44b-147b-4d42-8656-e1697dbcc150 service cinder] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:07.369070 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dcd44b-147b-4d42-8656-e1697dbcc150 service cinder] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:07.369418 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dcd44b-147b-4d42-8656-e1697dbcc150 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:07.395200 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1170/2333] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 08:50:07 2022] POST /identity/v3/users => generated 292 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:50:07.397986 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a23004-7aac-4be1-a136-2aea7613fb81 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:07.427887 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a23004-7aac-4be1-a136-2aea7613fb81 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:07.444670 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244bd646-3697-48ba-9161-d09bccfdad34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:07.445765 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244bd646-3697-48ba-9161-d09bccfdad34 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:07.447815 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244bd646-3697-48ba-9161-d09bccfdad34 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:07.448750 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244bd646-3697-48ba-9161-d09bccfdad34 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:07.451641 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244bd646-3697-48ba-9161-d09bccfdad34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:07.455830 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244bd646-3697-48ba-9161-d09bccfdad34 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:07.495708 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1171/2334] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:50:07.497733 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244bd646-3697-48ba-9161-d09bccfdad34 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:07.519407 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244bd646-3697-48ba-9161-d09bccfdad34 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:07.527939 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc82f3c-c62a-4243-974a-33d90505a634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:07.529714 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc82f3c-c62a-4243-974a-33d90505a634 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:07.532277 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc82f3c-c62a-4243-974a-33d90505a634 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:07.532911 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc82f3c-c62a-4243-974a-33d90505a634 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:07.533160 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dcd44b-147b-4d42-8656-e1697dbcc150 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:07.534219 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc82f3c-c62a-4243-974a-33d90505a634 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:07.534804 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dcd44b-147b-4d42-8656-e1697dbcc150 service cinder] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:07.536464 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc82f3c-c62a-4243-974a-33d90505a634 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:07.551271 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1164/2335] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:50:07 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:50:07.573774 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1172/2336] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:50:07.574700 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dcd44b-147b-4d42-8656-e1697dbcc150 service cinder] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:07.606957 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dcd44b-147b-4d42-8656-e1697dbcc150 service cinder] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:07.623146 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc82f3c-c62a-4243-974a-33d90505a634 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:07.625014 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-9cc82f3c-c62a-4243-974a-33d90505a634 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:07.625556 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296d13ef-b04d-434f-bae2-bca89bb8b4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:07.627940 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d13ef-b04d-434f-bae2-bca89bb8b4a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:07.629681 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d13ef-b04d-434f-bae2-bca89bb8b4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:07.630033 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d13ef-b04d-434f-bae2-bca89bb8b4a4 admin admin] PATH_INFO: `/v3/projects/3919985a44be447a9bfafddf0a90ccf6/users/33edf144fae24c76827b885f0ed7930b/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:07.646647 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:07.658036 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc82f3c-c62a-4243-974a-33d90505a634 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:07.690426 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296d13ef-b04d-434f-bae2-bca89bb8b4a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3919985a44be447a9bfafddf0a90ccf6, user_id=33edf144fae24c76827b885f0ed7930b, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:07.694386 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296d13ef-b04d-434f-bae2-bca89bb8b4a4 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:07.698533 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e791a-c1ff-4f84-99f9-6829e06747f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:07.699418 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e791a-c1ff-4f84-99f9-6829e06747f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:07.699707 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e791a-c1ff-4f84-99f9-6829e06747f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:07.699991 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e791a-c1ff-4f84-99f9-6829e06747f8 admin admin] PATH_INFO: `/v3/projects/c8e9fb98a6794eca8499f1886a18b951` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:07.706120 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460e791a-c1ff-4f84-99f9-6829e06747f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8e9fb98a6794eca8499f1886a18b951)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:07.708091 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460e791a-c1ff-4f84-99f9-6829e06747f8 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:07.739206 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1165/2337] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:50:07 2022] PUT /identity/v3/projects/3919985a44be447a9bfafddf0a90ccf6/users/33edf144fae24c76827b885f0ed7930b/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:50:07.742094 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17148f-3403-41a1-8f6c-050126db81bb None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:07.742496 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17148f-3403-41a1-8f6c-050126db81bb None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:07.742786 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17148f-3403-41a1-8f6c-050126db81bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:07.798472 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-eb17148f-3403-41a1-8f6c-050126db81bb None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:50:07.799973 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-eb17148f-3403-41a1-8f6c-050126db81bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:07.819410 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-460e791a-c1ff-4f84-99f9-6829e06747f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8e9fb98a6794eca8499f1886a18b951', 'request_id': 'req-460e791a-c1ff-4f84-99f9-6829e06747f8'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:50:07.829669 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-460e791a-c1ff-4f84-99f9-6829e06747f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8e9fb98a6794eca8499f1886a18b951', 'request_id': 'req-460e791a-c1ff-4f84-99f9-6829e06747f8'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:50:07.845480 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-460e791a-c1ff-4f84-99f9-6829e06747f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8e9fb98a6794eca8499f1886a18b951', 'request_id': 'req-460e791a-c1ff-4f84-99f9-6829e06747f8'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:50:07.889820 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-460e791a-c1ff-4f84-99f9-6829e06747f8 admin admin] The token cache is being invalidate because project c8e9fb98a6794eca8499f1886a18b951 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 08:50:07.890258 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-460e791a-c1ff-4f84-99f9-6829e06747f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:50:07.891846 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-460e791a-c1ff-4f84-99f9-6829e06747f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:50:07.897652 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1173/2338] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 08:50:07 2022] DELETE /identity/v3/projects/c8e9fb98a6794eca8499f1886a18b951 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 08:50:07.900029 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e791a-c1ff-4f84-99f9-6829e06747f8 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:07.905598 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-460e791a-c1ff-4f84-99f9-6829e06747f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:07.963385 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1166/2339] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:50:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:50:07.973346 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb17148f-3403-41a1-8f6c-050126db81bb None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:07.976045 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-eb17148f-3403-41a1-8f6c-050126db81bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:08.019427 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:08.067903 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e791a-c1ff-4f84-99f9-6829e06747f8 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:08.075957 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da75c79b-288c-41d1-bbf9-7127416e77cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:08.076930 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75c79b-288c-41d1-bbf9-7127416e77cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:08.077146 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75c79b-288c-41d1-bbf9-7127416e77cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:08.077493 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75c79b-288c-41d1-bbf9-7127416e77cd admin admin] PATH_INFO: `/v3/users/210f857c0b5e4021ab35124fe794b755` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:08.082490 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da75c79b-288c-41d1-bbf9-7127416e77cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=210f857c0b5e4021ab35124fe794b755)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:08.084368 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da75c79b-288c-41d1-bbf9-7127416e77cd admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:08.164315 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb17148f-3403-41a1-8f6c-050126db81bb None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:08.175536 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c52c6b-bafc-46a5-88d6-da3d84655a59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:08.176430 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c52c6b-bafc-46a5-88d6-da3d84655a59 service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:08.176885 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c52c6b-bafc-46a5-88d6-da3d84655a59 service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:08.177319 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c52c6b-bafc-46a5-88d6-da3d84655a59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:08.186200 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-da75c79b-288c-41d1-bbf9-7127416e77cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '210f857c0b5e4021ab35124fe794b755'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:50:08.199138 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c52c6b-bafc-46a5-88d6-da3d84655a59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:08.202834 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c52c6b-bafc-46a5-88d6-da3d84655a59 service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:08.213268 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-da75c79b-288c-41d1-bbf9-7127416e77cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '210f857c0b5e4021ab35124fe794b755'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:50:08.219525 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-da75c79b-288c-41d1-bbf9-7127416e77cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '210f857c0b5e4021ab35124fe794b755'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:50:08.235905 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1167/2340] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:50:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:50:08.266632 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-da75c79b-288c-41d1-bbf9-7127416e77cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '210f857c0b5e4021ab35124fe794b755'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:50:08.270976 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-da75c79b-288c-41d1-bbf9-7127416e77cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '210f857c0b5e4021ab35124fe794b755'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:50:08.320624 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1174/2341] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 08:50:07 2022] DELETE /identity/v3/users/210f857c0b5e4021ab35124fe794b755 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:50:08.346010 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ec019-4dc5-406c-8ac4-44dd958b2bfc None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:08.346010 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ec019-4dc5-406c-8ac4-44dd958b2bfc None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:08.346010 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ec019-4dc5-406c-8ac4-44dd958b2bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:08.380244 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-d28ec019-4dc5-406c-8ac4-44dd958b2bfc None None] MFA Rules not processed for user `dac980fabf4f4fef8694d1ce2d75372c`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:50:08.383514 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-d28ec019-4dc5-406c-8ac4-44dd958b2bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:08.500763 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1168/2342] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:50:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:50:08.918750 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da75c79b-288c-41d1-bbf9-7127416e77cd admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:08.920315 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-da75c79b-288c-41d1-bbf9-7127416e77cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:08.939565 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:09.173987 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da75c79b-288c-41d1-bbf9-7127416e77cd admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:09.186918 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33927e5b-8860-4edb-a62d-9edb079868be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:09.188298 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33927e5b-8860-4edb-a62d-9edb079868be admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:09.188662 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33927e5b-8860-4edb-a62d-9edb079868be admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:09.189379 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33927e5b-8860-4edb-a62d-9edb079868be admin admin] PATH_INFO: `/v3/projects/9c30f31030924253b73ad6de45f391d1` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:09.190949 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33927e5b-8860-4edb-a62d-9edb079868be admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c30f31030924253b73ad6de45f391d1)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:09.193556 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33927e5b-8860-4edb-a62d-9edb079868be admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:09.307736 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-33927e5b-8860-4edb-a62d-9edb079868be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c30f31030924253b73ad6de45f391d1', 'request_id': 'req-33927e5b-8860-4edb-a62d-9edb079868be'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:50:09.323901 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-33927e5b-8860-4edb-a62d-9edb079868be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c30f31030924253b73ad6de45f391d1', 'request_id': 'req-33927e5b-8860-4edb-a62d-9edb079868be'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:50:09.338866 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-33927e5b-8860-4edb-a62d-9edb079868be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c30f31030924253b73ad6de45f391d1', 'request_id': 'req-33927e5b-8860-4edb-a62d-9edb079868be'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:50:09.365639 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-33927e5b-8860-4edb-a62d-9edb079868be admin admin] The token cache is being invalidate because project 9c30f31030924253b73ad6de45f391d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 08:50:09.366551 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-33927e5b-8860-4edb-a62d-9edb079868be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:50:09.368035 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-33927e5b-8860-4edb-a62d-9edb079868be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:50:09.371158 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1175/2343] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 08:50:08 2022] DELETE /identity/v3/projects/9c30f31030924253b73ad6de45f391d1 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:50:09.378934 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142fe193-28a1-46ba-b75a-9e556a490f0b None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:09.379591 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142fe193-28a1-46ba-b75a-9e556a490f0b None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:09.380086 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142fe193-28a1-46ba-b75a-9e556a490f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:09.445916 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-142fe193-28a1-46ba-b75a-9e556a490f0b None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:50:09.447366 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-142fe193-28a1-46ba-b75a-9e556a490f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:09.681731 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66e675-8f03-40dc-8adf-3879e902f331 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:09.681910 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66e675-8f03-40dc-8adf-3879e902f331 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:09.682481 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66e675-8f03-40dc-8adf-3879e902f331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:09.687927 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1169/2344] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:50:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:50:09.746353 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-0e66e675-8f03-40dc-8adf-3879e902f331 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:50:09.753212 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-0e66e675-8f03-40dc-8adf-3879e902f331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:09.801034 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1176/2345] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:50:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 08:50:09.803680 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142fe193-28a1-46ba-b75a-9e556a490f0b None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:09.869932 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142fe193-28a1-46ba-b75a-9e556a490f0b None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:09.913623 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179cb14-c91e-41b3-9382-9a67fa8ede6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:09.919333 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179cb14-c91e-41b3-9382-9a67fa8ede6c admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:09.920285 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179cb14-c91e-41b3-9382-9a67fa8ede6c admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:09.927408 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179cb14-c91e-41b3-9382-9a67fa8ede6c admin admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:09.928539 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0179cb14-c91e-41b3-9382-9a67fa8ede6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:50:09.933904 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0179cb14-c91e-41b3-9382-9a67fa8ede6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:09.935838 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0179cb14-c91e-41b3-9382-9a67fa8ede6c admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:10.010282 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1170/2346] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Jun 22 08:50:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:50:10.014522 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e66e675-8f03-40dc-8adf-3879e902f331 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:10.033749 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e66e675-8f03-40dc-8adf-3879e902f331 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:10.073783 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97b87a1-28be-460f-8201-840eb397b13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:10.074705 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b87a1-28be-460f-8201-840eb397b13d admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:10.075745 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b87a1-28be-460f-8201-840eb397b13d admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:10.075745 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b87a1-28be-460f-8201-840eb397b13d admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:10.076397 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97b87a1-28be-460f-8201-840eb397b13d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:10.082917 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97b87a1-28be-460f-8201-840eb397b13d admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:10.148082 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1177/2347] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 08:50:10 2022] POST /identity/v3/projects => generated 367 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:50:10.149539 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179cb14-c91e-41b3-9382-9a67fa8ede6c admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:10.170405 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179cb14-c91e-41b3-9382-9a67fa8ede6c admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:10.272116 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:10.295138 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d95ba7-3ad2-43bb-8d93-346d579b073a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:10.296171 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d95ba7-3ad2-43bb-8d93-346d579b073a admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:10.296472 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d95ba7-3ad2-43bb-8d93-346d579b073a admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:10.297423 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d95ba7-3ad2-43bb-8d93-346d579b073a admin admin] PATH_INFO: `/v3/users` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:10.298548 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d95ba7-3ad2-43bb-8d93-346d579b073a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:10.301039 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d95ba7-3ad2-43bb-8d93-346d579b073a admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:10.334630 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1171/2348] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 08:50:10 2022] POST /identity/v3/users => generated 284 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:50:10.338917 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97b87a1-28be-460f-8201-840eb397b13d admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:10.369667 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97b87a1-28be-460f-8201-840eb397b13d admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:10.377903 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b0574-3599-4c2b-a562-deea9bad438e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:10.378687 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b0574-3599-4c2b-a562-deea9bad438e admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:10.379102 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b0574-3599-4c2b-a562-deea9bad438e admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:10.379455 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b0574-3599-4c2b-a562-deea9bad438e admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:10.380737 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1b0574-3599-4c2b-a562-deea9bad438e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:10.385301 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1b0574-3599-4c2b-a562-deea9bad438e admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:10.409033 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1178/2349] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:50:10.409980 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d95ba7-3ad2-43bb-8d93-346d579b073a admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:10.423798 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d95ba7-3ad2-43bb-8d93-346d579b073a admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:10.439457 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562e1a5-e9f3-40a1-bf43-00fbf6fef011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:10.439457 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562e1a5-e9f3-40a1-bf43-00fbf6fef011 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:10.439793 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562e1a5-e9f3-40a1-bf43-00fbf6fef011 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:10.442316 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562e1a5-e9f3-40a1-bf43-00fbf6fef011 admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:10.443097 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c562e1a5-e9f3-40a1-bf43-00fbf6fef011 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:10.451323 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c562e1a5-e9f3-40a1-bf43-00fbf6fef011 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:10.485251 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1172/2350] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:50:10.487791 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b0574-3599-4c2b-a562-deea9bad438e admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:10.513044 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b0574-3599-4c2b-a562-deea9bad438e admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:10.525086 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec4204-d8a7-4069-92e7-be35ccc846c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:10.527576 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec4204-d8a7-4069-92e7-be35ccc846c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:10.529131 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec4204-d8a7-4069-92e7-be35ccc846c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:10.529655 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec4204-d8a7-4069-92e7-be35ccc846c0 admin admin] PATH_INFO: `/v3/projects/f91a2a3c53a64bc5a43b4dd985cdd0dc/users/e3a613b06f114e21aec928d718f9f9cf/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:10.582496 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcec4204-d8a7-4069-92e7-be35ccc846c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f91a2a3c53a64bc5a43b4dd985cdd0dc, user_id=e3a613b06f114e21aec928d718f9f9cf, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:10.585463 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcec4204-d8a7-4069-92e7-be35ccc846c0 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:10.619739 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1179/2351] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:50:10 2022] PUT /identity/v3/projects/f91a2a3c53a64bc5a43b4dd985cdd0dc/users/e3a613b06f114e21aec928d718f9f9cf/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:50:10.631275 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea6dce-08f6-49dc-b815-7a598a0f367a None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:10.631581 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea6dce-08f6-49dc-b815-7a598a0f367a None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:10.631864 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea6dce-08f6-49dc-b815-7a598a0f367a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:10.710359 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-5fea6dce-08f6-49dc-b815-7a598a0f367a None None] MFA Rules not processed for user `e3a613b06f114e21aec928d718f9f9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:50:10.711720 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-5fea6dce-08f6-49dc-b815-7a598a0f367a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:10.848758 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1173/2352] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:50:10 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:50:10.862430 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec4204-d8a7-4069-92e7-be35ccc846c0 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:10.864964 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-bcec4204-d8a7-4069-92e7-be35ccc846c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:10.915076 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:10.945723 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec4204-d8a7-4069-92e7-be35ccc846c0 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:10.949834 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45950cc-2d0f-4ae7-9312-39d9fced5277 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589eb8cc97714580840ac7a48ea38ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:10.950610 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45950cc-2d0f-4ae7-9312-39d9fced5277 service glance] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:10.951134 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45950cc-2d0f-4ae7-9312-39d9fced5277 service glance] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:10.951504 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45950cc-2d0f-4ae7-9312-39d9fced5277 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:10.971421 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45950cc-2d0f-4ae7-9312-39d9fced5277 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:10.974339 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45950cc-2d0f-4ae7-9312-39d9fced5277 service glance] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:10.994397 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1180/2353] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:50:10 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:50:15.629668 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db666e-98c4-49b9-aaf6-d155a077a5d3 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:15.630223 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db666e-98c4-49b9-aaf6-d155a077a5d3 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:15.630527 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db666e-98c4-49b9-aaf6-d155a077a5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:15.668526 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-a3db666e-98c4-49b9-aaf6-d155a077a5d3 None None] MFA Rules not processed for user `33edf144fae24c76827b885f0ed7930b`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:50:15.670059 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-a3db666e-98c4-49b9-aaf6-d155a077a5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:15.795393 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1174/2354] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:50:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:50:15.817951 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45950cc-2d0f-4ae7-9312-39d9fced5277 service glance] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:15.820112 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-e45950cc-2d0f-4ae7-9312-39d9fced5277 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:15.935310 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45950cc-2d0f-4ae7-9312-39d9fced5277 service glance] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:15.956959 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731fef4a-dd27-4996-aad1-98dac73ecef0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f1809a35b244c1db7a185d82859369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:15.958249 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731fef4a-dd27-4996-aad1-98dac73ecef0 service nova] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:15.958584 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731fef4a-dd27-4996-aad1-98dac73ecef0 service nova] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:15.959080 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731fef4a-dd27-4996-aad1-98dac73ecef0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:15.975716 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731fef4a-dd27-4996-aad1-98dac73ecef0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:15.979196 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731fef4a-dd27-4996-aad1-98dac73ecef0 service nova] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:16.010429 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1181/2355] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:50:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:50:18.043391 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9eeb8-630a-4014-b257-3531fa1dd070 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:18.044148 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9eeb8-630a-4014-b257-3531fa1dd070 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:18.044148 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9eeb8-630a-4014-b257-3531fa1dd070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:18.083480 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-3bc9eeb8-630a-4014-b257-3531fa1dd070 None None] MFA Rules not processed for user `33edf144fae24c76827b885f0ed7930b`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:50:18.088594 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-3bc9eeb8-630a-4014-b257-3531fa1dd070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:18.106620 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1175/2356] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:50:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:50:23.712527 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae976e-90b8-4316-a854-a530d876c4e8 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:23.714453 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae976e-90b8-4316-a854-a530d876c4e8 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:23.714738 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae976e-90b8-4316-a854-a530d876c4e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:23.734584 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-4aae976e-90b8-4316-a854-a530d876c4e8 None None] MFA Rules not processed for user `4dc5e6a433e24eebad7d495dceaadb65`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:50:23.735822 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-4aae976e-90b8-4316-a854-a530d876c4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:23.816222 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1182/2357] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:50:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:50:28.071237 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=80,keystone:INSERT=3 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:28.247082 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7408f63-b7f7-47a7-be95-03e291aeeac5 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:28.247369 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7408f63-b7f7-47a7-be95-03e291aeeac5 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:28.247656 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7408f63-b7f7-47a7-be95-03e291aeeac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:28.275964 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-c7408f63-b7f7-47a7-be95-03e291aeeac5 None None] MFA Rules not processed for user `2bf91272d78b4e8f854c760622465af9`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:50:28.277497 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-c7408f63-b7f7-47a7-be95-03e291aeeac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:28.363046 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1176/2358] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Jun 22 08:50:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 08:50:28.377438 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae976e-90b8-4316-a854-a530d876c4e8 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:28.379831 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-4aae976e-90b8-4316-a854-a530d876c4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:28.481710 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae976e-90b8-4316-a854-a530d876c4e8 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:28.489568 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4273d4-54ff-4b11-a563-5a6d060c1c25 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4403cea84ff646b88cdb785975b20346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:28.492449 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4273d4-54ff-4b11-a563-5a6d060c1c25 service swift] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:28.492928 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4273d4-54ff-4b11-a563-5a6d060c1c25 service swift] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:28.493585 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4273d4-54ff-4b11-a563-5a6d060c1c25 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:28.503596 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:28.507432 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4273d4-54ff-4b11-a563-5a6d060c1c25 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:28.509543 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4273d4-54ff-4b11-a563-5a6d060c1c25 service swift] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:28.523899 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1183/2359] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Jun 22 08:50:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 22 08:50:30.297367 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7408f63-b7f7-47a7-be95-03e291aeeac5 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:30.299067 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-c7408f63-b7f7-47a7-be95-03e291aeeac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:30.490897 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7408f63-b7f7-47a7-be95-03e291aeeac5 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:30.498653 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ab7c5d-8db7-431b-9375-084e9f5e1334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:30.500182 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab7c5d-8db7-431b-9375-084e9f5e1334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:30.500766 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab7c5d-8db7-431b-9375-084e9f5e1334 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:30.501334 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab7c5d-8db7-431b-9375-084e9f5e1334 admin admin] PATH_INFO: `/v3/users/641df714d7d04666a11523f457b1c65c` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:30.503126 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ab7c5d-8db7-431b-9375-084e9f5e1334 admin admin] RBAC: Authorizing `identity:delete_user(user_id=641df714d7d04666a11523f457b1c65c)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:30.507063 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ab7c5d-8db7-431b-9375-084e9f5e1334 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:30.611045 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-b4ab7c5d-8db7-431b-9375-084e9f5e1334 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '641df714d7d04666a11523f457b1c65c'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:50:30.630608 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-b4ab7c5d-8db7-431b-9375-084e9f5e1334 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '641df714d7d04666a11523f457b1c65c'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:50:30.631781 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-b4ab7c5d-8db7-431b-9375-084e9f5e1334 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '641df714d7d04666a11523f457b1c65c'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:50:30.650213 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-b4ab7c5d-8db7-431b-9375-084e9f5e1334 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '641df714d7d04666a11523f457b1c65c'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:50:30.651259 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-b4ab7c5d-8db7-431b-9375-084e9f5e1334 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '641df714d7d04666a11523f457b1c65c'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:50:30.686498 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91e791-1955-4f04-a94f-999303c2a65f None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:30.687049 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91e791-1955-4f04-a94f-999303c2a65f None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:30.687049 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91e791-1955-4f04-a94f-999303c2a65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:30.693827 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1177/2360] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 08:50:30 2022] DELETE /identity/v3/users/641df714d7d04666a11523f457b1c65c => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:50:30.716618 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-5f91e791-1955-4f04-a94f-999303c2a65f None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:50:30.719197 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-5f91e791-1955-4f04-a94f-999303c2a65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:30.796707 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1184/2361] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:50:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:50:30.803991 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ab7c5d-8db7-431b-9375-084e9f5e1334 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:30.805749 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-b4ab7c5d-8db7-431b-9375-084e9f5e1334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:30.852794 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:30.913827 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ab7c5d-8db7-431b-9375-084e9f5e1334 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:30.917516 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef0dc0f-9d48-453d-9741-15e0b6d032ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:30.918938 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0dc0f-9d48-453d-9741-15e0b6d032ba service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:30.918938 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0dc0f-9d48-453d-9741-15e0b6d032ba service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:30.918938 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0dc0f-9d48-453d-9741-15e0b6d032ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:30.929352 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef0dc0f-9d48-453d-9741-15e0b6d032ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:30.930874 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef0dc0f-9d48-453d-9741-15e0b6d032ba service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:30.944177 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1178/2362] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:50:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:50:31.310399 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f91e791-1955-4f04-a94f-999303c2a65f None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:31.312366 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-5f91e791-1955-4f04-a94f-999303c2a65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:31.359505 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f91e791-1955-4f04-a94f-999303c2a65f None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:31.383972 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fae16b-bbf9-4e75-aa78-45f353a4501f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:31.385137 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fae16b-bbf9-4e75-aa78-45f353a4501f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:31.388937 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fae16b-bbf9-4e75-aa78-45f353a4501f admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:31.390011 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fae16b-bbf9-4e75-aa78-45f353a4501f admin admin] PATH_INFO: `/v3/projects/7e1482e9981842a2a6b05779d5959710` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:31.396326 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fae16b-bbf9-4e75-aa78-45f353a4501f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e1482e9981842a2a6b05779d5959710)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:31.399373 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fae16b-bbf9-4e75-aa78-45f353a4501f admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:31.527215 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-e1fae16b-bbf9-4e75-aa78-45f353a4501f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e1482e9981842a2a6b05779d5959710', 'request_id': 'req-e1fae16b-bbf9-4e75-aa78-45f353a4501f'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:50:31.541952 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-e1fae16b-bbf9-4e75-aa78-45f353a4501f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e1482e9981842a2a6b05779d5959710', 'request_id': 'req-e1fae16b-bbf9-4e75-aa78-45f353a4501f'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:50:31.552530 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-e1fae16b-bbf9-4e75-aa78-45f353a4501f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e1482e9981842a2a6b05779d5959710', 'request_id': 'req-e1fae16b-bbf9-4e75-aa78-45f353a4501f'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:50:31.589522 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-e1fae16b-bbf9-4e75-aa78-45f353a4501f admin admin] The token cache is being invalidate because project 7e1482e9981842a2a6b05779d5959710 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 08:50:31.590153 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-e1fae16b-bbf9-4e75-aa78-45f353a4501f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:50:31.590750 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-e1fae16b-bbf9-4e75-aa78-45f353a4501f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:50:31.593117 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1185/2363] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 08:50:31 2022] DELETE /identity/v3/projects/7e1482e9981842a2a6b05779d5959710 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:50:31.599755 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61399921-50a9-403f-b2ab-cf520dd5ad2c None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:31.600771 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61399921-50a9-403f-b2ab-cf520dd5ad2c None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:31.601695 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61399921-50a9-403f-b2ab-cf520dd5ad2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:31.647864 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-61399921-50a9-403f-b2ab-cf520dd5ad2c None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:50:31.649340 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-61399921-50a9-403f-b2ab-cf520dd5ad2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:31.845590 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1179/2364] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:50:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:50:31.847848 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ec49c-974a-4769-a8e5-40851b0aec31 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:31.848384 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ec49c-974a-4769-a8e5-40851b0aec31 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:31.848478 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ec49c-974a-4769-a8e5-40851b0aec31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:31.887930 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-425ec49c-974a-4769-a8e5-40851b0aec31 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:50:31.890984 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-425ec49c-974a-4769-a8e5-40851b0aec31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:31.940488 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1186/2365] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:50:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:50:31.941860 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61399921-50a9-403f-b2ab-cf520dd5ad2c None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:31.956243 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61399921-50a9-403f-b2ab-cf520dd5ad2c None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:31.972130 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f3c96-9567-4387-b270-8bbcaa742b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:31.975629 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f3c96-9567-4387-b270-8bbcaa742b30 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:31.976422 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f3c96-9567-4387-b270-8bbcaa742b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:31.977981 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f3c96-9567-4387-b270-8bbcaa742b30 admin admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:31.982262 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8f3c96-9567-4387-b270-8bbcaa742b30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:50:31.982700 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8f3c96-9567-4387-b270-8bbcaa742b30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:32.003470 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8f3c96-9567-4387-b270-8bbcaa742b30 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:32.040620 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1180/2366] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Jun 22 08:50:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:50:32.041436 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ec49c-974a-4769-a8e5-40851b0aec31 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:32.066441 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ec49c-974a-4769-a8e5-40851b0aec31 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:32.077932 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc3a2c5-e475-46c8-b9e2-b700c503d49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:32.078699 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3a2c5-e475-46c8-b9e2-b700c503d49f admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:32.079035 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3a2c5-e475-46c8-b9e2-b700c503d49f admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:32.079320 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3a2c5-e475-46c8-b9e2-b700c503d49f admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:32.080154 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc3a2c5-e475-46c8-b9e2-b700c503d49f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:32.082173 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc3a2c5-e475-46c8-b9e2-b700c503d49f admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:32.142890 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1187/2367] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 08:50:32 2022] POST /identity/v3/projects => generated 369 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:50:32.144352 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f3c96-9567-4387-b270-8bbcaa742b30 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:32.160524 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f3c96-9567-4387-b270-8bbcaa742b30 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:32.283982 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0fdcc9-668a-4b70-84fa-64e4693b77a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:32.285619 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0fdcc9-668a-4b70-84fa-64e4693b77a8 admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:32.286167 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0fdcc9-668a-4b70-84fa-64e4693b77a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:32.286803 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0fdcc9-668a-4b70-84fa-64e4693b77a8 admin admin] PATH_INFO: `/v3/users` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:32.287868 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0fdcc9-668a-4b70-84fa-64e4693b77a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:32.290176 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0fdcc9-668a-4b70-84fa-64e4693b77a8 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:32.333703 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1181/2368] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 08:50:32 2022] POST /identity/v3/users => generated 285 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:50:32.338875 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc3a2c5-e475-46c8-b9e2-b700c503d49f admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:32.355617 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc3a2c5-e475-46c8-b9e2-b700c503d49f admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:32.361724 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ad568-13cb-4a56-9304-d7e6340cd2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:32.363380 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ad568-13cb-4a56-9304-d7e6340cd2f7 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:32.363784 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ad568-13cb-4a56-9304-d7e6340cd2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:32.364890 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ad568-13cb-4a56-9304-d7e6340cd2f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:32.366723 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1ad568-13cb-4a56-9304-d7e6340cd2f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:32.368400 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1ad568-13cb-4a56-9304-d7e6340cd2f7 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:32.413737 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1188/2369] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:50:32.415341 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0fdcc9-668a-4b70-84fa-64e4693b77a8 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:32.428978 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0fdcc9-668a-4b70-84fa-64e4693b77a8 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:32.448487 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c03a62-4707-4091-b004-df159011ee02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:32.449172 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c03a62-4707-4091-b004-df159011ee02 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:32.449457 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c03a62-4707-4091-b004-df159011ee02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:32.449734 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c03a62-4707-4091-b004-df159011ee02 admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:32.450587 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c03a62-4707-4091-b004-df159011ee02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:32.452803 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c03a62-4707-4091-b004-df159011ee02 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:32.470014 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1182/2370] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:50:32.473913 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ad568-13cb-4a56-9304-d7e6340cd2f7 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:32.489996 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ad568-13cb-4a56-9304-d7e6340cd2f7 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:32.499292 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288148f8-15d5-474e-ba45-e3ab49a6340e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:32.505460 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288148f8-15d5-474e-ba45-e3ab49a6340e admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:32.506135 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288148f8-15d5-474e-ba45-e3ab49a6340e admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:32.506662 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288148f8-15d5-474e-ba45-e3ab49a6340e admin admin] PATH_INFO: `/v3/projects/6fb0c2ee6649406b9146a1a6a46fc1ad/users/3c452d678eb346e8be751a9666dda1c0/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:32.531585 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288148f8-15d5-474e-ba45-e3ab49a6340e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fb0c2ee6649406b9146a1a6a46fc1ad, user_id=3c452d678eb346e8be751a9666dda1c0, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:32.537479 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288148f8-15d5-474e-ba45-e3ab49a6340e admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:32.557156 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1189/2371] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:50:32 2022] PUT /identity/v3/projects/6fb0c2ee6649406b9146a1a6a46fc1ad/users/3c452d678eb346e8be751a9666dda1c0/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:50:32.568650 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17c5e3-4803-417f-b4d0-3b98f8b906f0 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:32.568945 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17c5e3-4803-417f-b4d0-3b98f8b906f0 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:32.569237 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17c5e3-4803-417f-b4d0-3b98f8b906f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:32.600898 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-5e17c5e3-4803-417f-b4d0-3b98f8b906f0 None None] MFA Rules not processed for user `3c452d678eb346e8be751a9666dda1c0`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:50:32.602170 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-5e17c5e3-4803-417f-b4d0-3b98f8b906f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:32.625310 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:32.675317 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1183/2372] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:50:32 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:50:32.687205 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288148f8-15d5-474e-ba45-e3ab49a6340e admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:32.688959 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-288148f8-15d5-474e-ba45-e3ab49a6340e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:32.715695 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:32.757771 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288148f8-15d5-474e-ba45-e3ab49a6340e admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:32.761744 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef34274-8299-487e-9573-4b9af14ad4d5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589eb8cc97714580840ac7a48ea38ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:32.762424 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef34274-8299-487e-9573-4b9af14ad4d5 service glance] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:32.762710 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef34274-8299-487e-9573-4b9af14ad4d5 service glance] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:32.762989 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef34274-8299-487e-9573-4b9af14ad4d5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:32.772146 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef34274-8299-487e-9573-4b9af14ad4d5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:32.773587 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef34274-8299-487e-9573-4b9af14ad4d5 service glance] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:32.782764 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1190/2373] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:50:32 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:50:42.672219 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=17 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:42.778532 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=19 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:46.838315 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17c5e3-4803-417f-b4d0-3b98f8b906f0 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:46.839910 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-5e17c5e3-4803-417f-b4d0-3b98f8b906f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:47.092686 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17c5e3-4803-417f-b4d0-3b98f8b906f0 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:47.099786 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3457340c-9148-4cba-af31-7fd1c511fe44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:47.101370 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457340c-9148-4cba-af31-7fd1c511fe44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:47.101861 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457340c-9148-4cba-af31-7fd1c511fe44 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:47.102299 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457340c-9148-4cba-af31-7fd1c511fe44 admin admin] PATH_INFO: `/v3/users/e3a613b06f114e21aec928d718f9f9cf` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:47.104040 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3457340c-9148-4cba-af31-7fd1c511fe44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3a613b06f114e21aec928d718f9f9cf)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:47.107105 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3457340c-9148-4cba-af31-7fd1c511fe44 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:47.218476 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-3457340c-9148-4cba-af31-7fd1c511fe44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3a613b06f114e21aec928d718f9f9cf'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:50:47.237451 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-3457340c-9148-4cba-af31-7fd1c511fe44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3a613b06f114e21aec928d718f9f9cf'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:50:47.238464 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-3457340c-9148-4cba-af31-7fd1c511fe44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3a613b06f114e21aec928d718f9f9cf'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:50:47.254190 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-3457340c-9148-4cba-af31-7fd1c511fe44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3a613b06f114e21aec928d718f9f9cf'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:50:47.255697 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-3457340c-9148-4cba-af31-7fd1c511fe44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3a613b06f114e21aec928d718f9f9cf'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:50:47.298481 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1184/2374] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 08:50:46 2022] DELETE /identity/v3/users/e3a613b06f114e21aec928d718f9f9cf => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 08:50:47.304450 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf777787-8733-4ce9-aa1d-e6c01a161f6d None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:47.305073 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf777787-8733-4ce9-aa1d-e6c01a161f6d None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:47.306571 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf777787-8733-4ce9-aa1d-e6c01a161f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:47.358262 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-bf777787-8733-4ce9-aa1d-e6c01a161f6d None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:50:47.361023 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-bf777787-8733-4ce9-aa1d-e6c01a161f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:47.449818 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1191/2375] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:50:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:50:47.466474 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3457340c-9148-4cba-af31-7fd1c511fe44 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:47.468146 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-3457340c-9148-4cba-af31-7fd1c511fe44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:47.512937 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:47.651040 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3457340c-9148-4cba-af31-7fd1c511fe44 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:47.660418 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb0ff4a-15f0-4122-a921-0fc3411172b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:47.661976 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0ff4a-15f0-4122-a921-0fc3411172b0 service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:47.662789 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0ff4a-15f0-4122-a921-0fc3411172b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:47.663856 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0ff4a-15f0-4122-a921-0fc3411172b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:47.679091 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb0ff4a-15f0-4122-a921-0fc3411172b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:47.680993 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb0ff4a-15f0-4122-a921-0fc3411172b0 service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:47.695557 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1185/2376] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:50:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:50:48.194256 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf777787-8733-4ce9-aa1d-e6c01a161f6d None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:48.196031 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-bf777787-8733-4ce9-aa1d-e6c01a161f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:48.211929 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf777787-8733-4ce9-aa1d-e6c01a161f6d None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:48.219694 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde83582-adb4-46bc-b762-a4ada83c06af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:48.221033 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde83582-adb4-46bc-b762-a4ada83c06af admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:48.221332 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde83582-adb4-46bc-b762-a4ada83c06af admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:48.221630 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde83582-adb4-46bc-b762-a4ada83c06af admin admin] PATH_INFO: `/v3/projects/f91a2a3c53a64bc5a43b4dd985cdd0dc` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:48.223176 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde83582-adb4-46bc-b762-a4ada83c06af admin admin] RBAC: Authorizing `identity:delete_project(project_id=f91a2a3c53a64bc5a43b4dd985cdd0dc)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:48.227912 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde83582-adb4-46bc-b762-a4ada83c06af admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:48.309074 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-dde83582-adb4-46bc-b762-a4ada83c06af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f91a2a3c53a64bc5a43b4dd985cdd0dc', 'request_id': 'req-dde83582-adb4-46bc-b762-a4ada83c06af'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:50:48.318003 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-dde83582-adb4-46bc-b762-a4ada83c06af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f91a2a3c53a64bc5a43b4dd985cdd0dc', 'request_id': 'req-dde83582-adb4-46bc-b762-a4ada83c06af'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:50:48.325870 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-dde83582-adb4-46bc-b762-a4ada83c06af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f91a2a3c53a64bc5a43b4dd985cdd0dc', 'request_id': 'req-dde83582-adb4-46bc-b762-a4ada83c06af'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:50:48.349934 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-dde83582-adb4-46bc-b762-a4ada83c06af admin admin] The token cache is being invalidate because project f91a2a3c53a64bc5a43b4dd985cdd0dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 08:50:48.350271 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-dde83582-adb4-46bc-b762-a4ada83c06af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:50:48.350957 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-dde83582-adb4-46bc-b762-a4ada83c06af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:50:48.352549 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1192/2377] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 08:50:48 2022] DELETE /identity/v3/projects/f91a2a3c53a64bc5a43b4dd985cdd0dc => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:50:48.358471 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36f8fa-915b-49d9-9733-3803f066a073 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:48.359032 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36f8fa-915b-49d9-9733-3803f066a073 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:48.359297 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36f8fa-915b-49d9-9733-3803f066a073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:48.404821 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-1d36f8fa-915b-49d9-9733-3803f066a073 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:50:48.406633 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-1d36f8fa-915b-49d9-9733-3803f066a073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:48.616748 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1186/2378] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:50:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:50:48.619489 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070f994-8c7c-4f3d-9fc0-508eac869551 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:48.620163 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070f994-8c7c-4f3d-9fc0-508eac869551 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:48.620660 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070f994-8c7c-4f3d-9fc0-508eac869551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:48.662512 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-c070f994-8c7c-4f3d-9fc0-508eac869551 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:50:48.666338 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-c070f994-8c7c-4f3d-9fc0-508eac869551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:48.691072 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1193/2379] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:50:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 08:50:48.693581 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d36f8fa-915b-49d9-9733-3803f066a073 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:48.736274 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d36f8fa-915b-49d9-9733-3803f066a073 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:48.752604 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3687fb27-5937-4cdd-ad3b-5f582a8c39c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:48.754343 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687fb27-5937-4cdd-ad3b-5f582a8c39c9 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:48.755773 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687fb27-5937-4cdd-ad3b-5f582a8c39c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:48.760041 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687fb27-5937-4cdd-ad3b-5f582a8c39c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:48.761508 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3687fb27-5937-4cdd-ad3b-5f582a8c39c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:50:48.762007 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3687fb27-5937-4cdd-ad3b-5f582a8c39c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:48.764467 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3687fb27-5937-4cdd-ad3b-5f582a8c39c9 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:48.807774 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1187/2380] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Jun 22 08:50:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:50:48.808958 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c070f994-8c7c-4f3d-9fc0-508eac869551 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:48.821551 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c070f994-8c7c-4f3d-9fc0-508eac869551 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:48.828433 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42c938-8a5d-4588-9aa6-1be91ad5e6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:48.830500 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42c938-8a5d-4588-9aa6-1be91ad5e6f1 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:48.831170 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42c938-8a5d-4588-9aa6-1be91ad5e6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:48.847101 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42c938-8a5d-4588-9aa6-1be91ad5e6f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:48.849258 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b42c938-8a5d-4588-9aa6-1be91ad5e6f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:48.854572 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b42c938-8a5d-4588-9aa6-1be91ad5e6f1 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:48.928493 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1194/2381] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 08:50:48 2022] POST /identity/v3/projects => generated 363 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:50:48.932639 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3687fb27-5937-4cdd-ad3b-5f582a8c39c9 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:48.946383 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3687fb27-5937-4cdd-ad3b-5f582a8c39c9 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:49.076553 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:49.093698 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a6b42-7084-46a9-803e-848535fc0c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:49.095646 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a6b42-7084-46a9-803e-848535fc0c77 admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:49.097509 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a6b42-7084-46a9-803e-848535fc0c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:49.098104 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a6b42-7084-46a9-803e-848535fc0c77 admin admin] PATH_INFO: `/v3/users` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:49.099117 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633a6b42-7084-46a9-803e-848535fc0c77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:49.110945 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633a6b42-7084-46a9-803e-848535fc0c77 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:49.135515 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba71eff-2dc9-4924-bf71-321c86fd8992 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:49.135818 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba71eff-2dc9-4924-bf71-321c86fd8992 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:49.136091 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba71eff-2dc9-4924-bf71-321c86fd8992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:49.163889 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1188/2382] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 08:50:48 2022] POST /identity/v3/users => generated 282 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 08:50:49.169454 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a6b42-7084-46a9-803e-848535fc0c77 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:49.180452 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-cba71eff-2dc9-4924-bf71-321c86fd8992 None None] MFA Rules not processed for user `2bf91272d78b4e8f854c760622465af9`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:50:49.182150 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-cba71eff-2dc9-4924-bf71-321c86fd8992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:49.187028 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a6b42-7084-46a9-803e-848535fc0c77 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:49.203309 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b44bbdc-c0c3-4cc9-9eae-f9eb7feec203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:49.204948 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44bbdc-c0c3-4cc9-9eae-f9eb7feec203 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:49.205513 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44bbdc-c0c3-4cc9-9eae-f9eb7feec203 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:49.205994 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44bbdc-c0c3-4cc9-9eae-f9eb7feec203 admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:49.207472 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b44bbdc-c0c3-4cc9-9eae-f9eb7feec203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:49.212487 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b44bbdc-c0c3-4cc9-9eae-f9eb7feec203 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:49.242150 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1189/2383] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:50:49 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:50:49.250242 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b44bbdc-c0c3-4cc9-9eae-f9eb7feec203 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:49.273654 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b44bbdc-c0c3-4cc9-9eae-f9eb7feec203 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:49.277882 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:49.288735 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3caac9-5e4b-45b1-b5e2-c1d03e963297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:49.289905 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3caac9-5e4b-45b1-b5e2-c1d03e963297 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:49.290793 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3caac9-5e4b-45b1-b5e2-c1d03e963297 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:49.291007 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3caac9-5e4b-45b1-b5e2-c1d03e963297 admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:49.293027 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3caac9-5e4b-45b1-b5e2-c1d03e963297 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:49.296862 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3caac9-5e4b-45b1-b5e2-c1d03e963297 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:49.304205 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1195/2384] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Jun 22 08:50:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:50:49.323855 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba71eff-2dc9-4924-bf71-321c86fd8992 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:49.325530 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-cba71eff-2dc9-4924-bf71-321c86fd8992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:49.325688 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1190/2385] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:50:49 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:50:49.330372 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3caac9-5e4b-45b1-b5e2-c1d03e963297 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:49.358522 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3caac9-5e4b-45b1-b5e2-c1d03e963297 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:49.367013 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a1e50-ded1-46a5-bb2f-04085f5f2e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:49.369237 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a1e50-ded1-46a5-bb2f-04085f5f2e0a admin admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:49.369842 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a1e50-ded1-46a5-bb2f-04085f5f2e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:49.370473 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a1e50-ded1-46a5-bb2f-04085f5f2e0a admin admin] PATH_INFO: `/v3/projects/a66fa21fe9894cc0833c10ba15418e93/users/8bec30b2f39a46fbb26266d3dd9cc78a/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:49.400729 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4a1e50-ded1-46a5-bb2f-04085f5f2e0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a66fa21fe9894cc0833c10ba15418e93, user_id=8bec30b2f39a46fbb26266d3dd9cc78a, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:49.404521 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4a1e50-ded1-46a5-bb2f-04085f5f2e0a admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:49.445524 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1191/2386] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:50:49 2022] PUT /identity/v3/projects/a66fa21fe9894cc0833c10ba15418e93/users/8bec30b2f39a46fbb26266d3dd9cc78a/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:50:49.450139 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4cae6e-de9a-43ba-befd-7157798e6c40 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:49.450997 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4cae6e-de9a-43ba-befd-7157798e6c40 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:49.452599 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4cae6e-de9a-43ba-befd-7157798e6c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:49.494537 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba71eff-2dc9-4924-bf71-321c86fd8992 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:49.519598 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-8e4cae6e-de9a-43ba-befd-7157798e6c40 None None] MFA Rules not processed for user `8bec30b2f39a46fbb26266d3dd9cc78a`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:50:49.521890 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-8e4cae6e-de9a-43ba-befd-7157798e6c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:49.614949 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225c92d8-099e-4889-b7c0-1c59bfdcf950 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4403cea84ff646b88cdb785975b20346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:49.616033 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c92d8-099e-4889-b7c0-1c59bfdcf950 service swift] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:49.616335 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c92d8-099e-4889-b7c0-1c59bfdcf950 service swift] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:49.616618 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c92d8-099e-4889-b7c0-1c59bfdcf950 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:49.658137 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1192/2387] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:50:49 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 08:50:49.672288 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4cae6e-de9a-43ba-befd-7157798e6c40 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:49.675817 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-8e4cae6e-de9a-43ba-befd-7157798e6c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:49.706467 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225c92d8-099e-4889-b7c0-1c59bfdcf950 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:49.709867 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225c92d8-099e-4889-b7c0-1c59bfdcf950 service swift] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:49.728876 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1196/2388] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Jun 22 08:50:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 22 08:50:49.803565 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4cae6e-de9a-43ba-befd-7157798e6c40 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:49.812961 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f687280-d4c0-41c1-94e3-96b7b8b63012 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:49.813954 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f687280-d4c0-41c1-94e3-96b7b8b63012 service cinder] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:49.818020 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f687280-d4c0-41c1-94e3-96b7b8b63012 service cinder] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:49.818713 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f687280-d4c0-41c1-94e3-96b7b8b63012 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:49.845953 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f687280-d4c0-41c1-94e3-96b7b8b63012 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:49.847702 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f687280-d4c0-41c1-94e3-96b7b8b63012 service cinder] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:49.870232 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1193/2389] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:50:49 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 08:50:59.488521 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf3902-68bf-488f-b2c5-f0fbaaf6c278 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:59.489442 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf3902-68bf-488f-b2c5-f0fbaaf6c278 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:59.489442 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf3902-68bf-488f-b2c5-f0fbaaf6c278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:59.539007 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-2ddf3902-68bf-488f-b2c5-f0fbaaf6c278 None None] MFA Rules not processed for user `b5a4250771db454a88bbb1c88ed17b66`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:50:59.542044 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-2ddf3902-68bf-488f-b2c5-f0fbaaf6c278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:59.663090 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:59.722971 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1197/2390] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:50:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 08:50:59.855008 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=81,keystone:INSERT=4 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:51:05.380816 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f687280-d4c0-41c1-94e3-96b7b8b63012 service cinder] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:51:05.382586 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-1f687280-d4c0-41c1-94e3-96b7b8b63012 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:51:05.534576 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f687280-d4c0-41c1-94e3-96b7b8b63012 service cinder] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:51:05.539990 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a88bc4c-4fa8-4919-96d8-ae13eb065861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:51:05.540934 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a88bc4c-4fa8-4919-96d8-ae13eb065861 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:51:05.541411 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a88bc4c-4fa8-4919-96d8-ae13eb065861 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:51:05.541712 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a88bc4c-4fa8-4919-96d8-ae13eb065861 admin admin] PATH_INFO: `/v3/users/3c452d678eb346e8be751a9666dda1c0` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:51:05.543393 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a88bc4c-4fa8-4919-96d8-ae13eb065861 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c452d678eb346e8be751a9666dda1c0)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:51:05.545687 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a88bc4c-4fa8-4919-96d8-ae13eb065861 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:51:05.632944 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-8a88bc4c-4fa8-4919-96d8-ae13eb065861 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c452d678eb346e8be751a9666dda1c0'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:51:05.642823 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-8a88bc4c-4fa8-4919-96d8-ae13eb065861 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c452d678eb346e8be751a9666dda1c0'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:51:05.643956 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-8a88bc4c-4fa8-4919-96d8-ae13eb065861 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c452d678eb346e8be751a9666dda1c0'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:51:05.659575 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-8a88bc4c-4fa8-4919-96d8-ae13eb065861 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c452d678eb346e8be751a9666dda1c0'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:51:05.660309 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-8a88bc4c-4fa8-4919-96d8-ae13eb065861 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c452d678eb346e8be751a9666dda1c0'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:51:05.685914 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1194/2391] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 08:51:05 2022] DELETE /identity/v3/users/3c452d678eb346e8be751a9666dda1c0 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:51:05.688091 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c0a1f2-5bba-404a-aaa8-1a0617adeff1 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:51:05.688687 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c0a1f2-5bba-404a-aaa8-1a0617adeff1 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:51:05.688687 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c0a1f2-5bba-404a-aaa8-1a0617adeff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:51:05.712362 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-23c0a1f2-5bba-404a-aaa8-1a0617adeff1 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:51:05.714033 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-23c0a1f2-5bba-404a-aaa8-1a0617adeff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:51:05.833020 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1198/2392] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:51:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:51:05.840037 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a88bc4c-4fa8-4919-96d8-ae13eb065861 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:51:05.841782 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-8a88bc4c-4fa8-4919-96d8-ae13eb065861 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:51:05.987868 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a88bc4c-4fa8-4919-96d8-ae13eb065861 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:51:06.005086 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ffe013-50dc-43b0-b5ba-96d2251c218d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:51:06.006181 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ffe013-50dc-43b0-b5ba-96d2251c218d service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:51:06.006624 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ffe013-50dc-43b0-b5ba-96d2251c218d service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:51:06.007098 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ffe013-50dc-43b0-b5ba-96d2251c218d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:51:06.019843 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ffe013-50dc-43b0-b5ba-96d2251c218d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:51:06.022266 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ffe013-50dc-43b0-b5ba-96d2251c218d service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:51:06.035504 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1195/2393] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:51:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:51:06.806529 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c0a1f2-5bba-404a-aaa8-1a0617adeff1 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:51:06.810950 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-23c0a1f2-5bba-404a-aaa8-1a0617adeff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:51:06.836091 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c0a1f2-5bba-404a-aaa8-1a0617adeff1 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:51:06.843853 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ea3b5-9735-48a1-95b5-8b9373951292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:51:06.845083 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ea3b5-9735-48a1-95b5-8b9373951292 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:51:06.845719 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ea3b5-9735-48a1-95b5-8b9373951292 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:51:06.846364 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ea3b5-9735-48a1-95b5-8b9373951292 admin admin] PATH_INFO: `/v3/projects/6fb0c2ee6649406b9146a1a6a46fc1ad` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:51:06.850300 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97ea3b5-9735-48a1-95b5-8b9373951292 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fb0c2ee6649406b9146a1a6a46fc1ad)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:51:06.854410 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97ea3b5-9735-48a1-95b5-8b9373951292 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:51:06.949071 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-f97ea3b5-9735-48a1-95b5-8b9373951292 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fb0c2ee6649406b9146a1a6a46fc1ad', 'request_id': 'req-f97ea3b5-9735-48a1-95b5-8b9373951292'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:51:06.957352 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-f97ea3b5-9735-48a1-95b5-8b9373951292 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fb0c2ee6649406b9146a1a6a46fc1ad', 'request_id': 'req-f97ea3b5-9735-48a1-95b5-8b9373951292'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:51:06.967414 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-f97ea3b5-9735-48a1-95b5-8b9373951292 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fb0c2ee6649406b9146a1a6a46fc1ad', 'request_id': 'req-f97ea3b5-9735-48a1-95b5-8b9373951292'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:51:07.000324 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-f97ea3b5-9735-48a1-95b5-8b9373951292 admin admin] The token cache is being invalidate because project 6fb0c2ee6649406b9146a1a6a46fc1ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 08:51:07.000958 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-f97ea3b5-9735-48a1-95b5-8b9373951292 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:51:07.001709 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-f97ea3b5-9735-48a1-95b5-8b9373951292 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:51:07.003653 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1199/2394] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 08:51:06 2022] DELETE /identity/v3/projects/6fb0c2ee6649406b9146a1a6a46fc1ad => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:51:07.009091 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db2ac6-35a3-47d8-a547-beb9d0db6fee None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:51:07.009654 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db2ac6-35a3-47d8-a547-beb9d0db6fee None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:51:07.009654 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db2ac6-35a3-47d8-a547-beb9d0db6fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:51:07.083200 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-c1db2ac6-35a3-47d8-a547-beb9d0db6fee None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:51:07.091862 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-c1db2ac6-35a3-47d8-a547-beb9d0db6fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:51:07.116136 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:51:07.227366 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1196/2395] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:51:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 08:51:07.240309 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed3349-a2e8-4639-b054-56a626f393ca None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:51:07.240792 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed3349-a2e8-4639-b054-56a626f393ca None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:51:07.241293 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed3349-a2e8-4639-b054-56a626f393ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:51:07.293418 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-ceed3349-a2e8-4639-b054-56a626f393ca None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:51:07.296459 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-ceed3349-a2e8-4639-b054-56a626f393ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:51:07.317276 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1200/2396] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:51:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:51:07.322514 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db2ac6-35a3-47d8-a547-beb9d0db6fee None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:51:07.345123 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db2ac6-35a3-47d8-a547-beb9d0db6fee None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:51:07.354116 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048290d-ee71-4b36-bbf1-c4aef9279565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:51:07.355490 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048290d-ee71-4b36-bbf1-c4aef9279565 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:51:07.356652 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048290d-ee71-4b36-bbf1-c4aef9279565 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:51:07.357228 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048290d-ee71-4b36-bbf1-c4aef9279565 admin admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:51:07.360348 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1048290d-ee71-4b36-bbf1-c4aef9279565 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:51:07.360348 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1048290d-ee71-4b36-bbf1-c4aef9279565 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:51:07.364881 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1048290d-ee71-4b36-bbf1-c4aef9279565 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:51:07.394377 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1197/2397] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Jun 22 08:51:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:51:07.399283 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed3349-a2e8-4639-b054-56a626f393ca None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:51:07.422421 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed3349-a2e8-4639-b054-56a626f393ca None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:51:07.443600 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0561f0c-476e-49c9-a701-d205bb6d70a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:51:07.444705 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0561f0c-476e-49c9-a701-d205bb6d70a5 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:51:07.445122 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0561f0c-476e-49c9-a701-d205bb6d70a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:51:07.445628 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0561f0c-476e-49c9-a701-d205bb6d70a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:51:07.446844 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0561f0c-476e-49c9-a701-d205bb6d70a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:51:07.450776 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0561f0c-476e-49c9-a701-d205bb6d70a5 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:51:07.513633 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1201/2398] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 08:51:07 2022] POST /identity/v3/projects => generated 375 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 08:51:07.515865 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048290d-ee71-4b36-bbf1-c4aef9279565 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:51:07.543218 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048290d-ee71-4b36-bbf1-c4aef9279565 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:51:07.757347 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b5869-2cef-4355-a060-6593e0c85a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:51:07.758819 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b5869-2cef-4355-a060-6593e0c85a31 admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:51:07.759373 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b5869-2cef-4355-a060-6593e0c85a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:51:07.759952 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b5869-2cef-4355-a060-6593e0c85a31 admin admin] PATH_INFO: `/v3/users` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:51:07.760959 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b5869-2cef-4355-a060-6593e0c85a31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:51:07.764346 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b5869-2cef-4355-a060-6593e0c85a31 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:51:07.794857 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1198/2399] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 08:51:07 2022] POST /identity/v3/users => generated 288 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:51:07.799680 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0561f0c-476e-49c9-a701-d205bb6d70a5 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:51:07.827418 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0561f0c-476e-49c9-a701-d205bb6d70a5 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:51:07.848153 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3845b5-dfcf-44b5-abea-b195ba035bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:51:07.849282 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3845b5-dfcf-44b5-abea-b195ba035bba admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:51:07.849742 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3845b5-dfcf-44b5-abea-b195ba035bba admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:51:07.850170 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3845b5-dfcf-44b5-abea-b195ba035bba admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:51:07.851343 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3845b5-dfcf-44b5-abea-b195ba035bba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:51:07.854193 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3845b5-dfcf-44b5-abea-b195ba035bba admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:51:07.891574 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1202/2400] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:51:07 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 08:51:07.892897 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b5869-2cef-4355-a060-6593e0c85a31 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:51:07.906880 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b5869-2cef-4355-a060-6593e0c85a31 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:51:07.913366 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c14e1c-5687-4c50-9a38-e013c7ac7bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:51:07.914530 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c14e1c-5687-4c50-9a38-e013c7ac7bb3 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:51:07.914988 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c14e1c-5687-4c50-9a38-e013c7ac7bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:51:07.915374 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c14e1c-5687-4c50-9a38-e013c7ac7bb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:51:07.916447 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c14e1c-5687-4c50-9a38-e013c7ac7bb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:51:07.927172 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c14e1c-5687-4c50-9a38-e013c7ac7bb3 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:51:07.961703 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1199/2401] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 08:51:07 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:51:07.968546 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3845b5-dfcf-44b5-abea-b195ba035bba admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:51:08.004321 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3845b5-dfcf-44b5-abea-b195ba035bba admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:51:08.024226 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a386eff-6f6d-419e-922e-313450fc483e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:51:08.029602 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a386eff-6f6d-419e-922e-313450fc483e admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:51:08.030633 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a386eff-6f6d-419e-922e-313450fc483e admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:51:08.032600 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a386eff-6f6d-419e-922e-313450fc483e admin admin] PATH_INFO: `/v3/projects/1f997ffaf2ad4ee49c1aa461579a3327/users/b8299a39a0854f268d87a3f09033d63f/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:51:08.104599 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a386eff-6f6d-419e-922e-313450fc483e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f997ffaf2ad4ee49c1aa461579a3327, user_id=b8299a39a0854f268d87a3f09033d63f, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:51:08.110028 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a386eff-6f6d-419e-922e-313450fc483e admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:51:08.214113 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1203/2402] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 08:51:07 2022] PUT /identity/v3/projects/1f997ffaf2ad4ee49c1aa461579a3327/users/b8299a39a0854f268d87a3f09033d63f/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:51:08.223211 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3710cf-12c6-410e-9e26-0efd132e26e3 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:51:08.224060 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3710cf-12c6-410e-9e26-0efd132e26e3 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:51:08.224060 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3710cf-12c6-410e-9e26-0efd132e26e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:51:08.283527 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-5e3710cf-12c6-410e-9e26-0efd132e26e3 None None] MFA Rules not processed for user `b8299a39a0854f268d87a3f09033d63f`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:51:08.285004 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-5e3710cf-12c6-410e-9e26-0efd132e26e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:51:08.431921 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1200/2403] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:51:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:51:08.444084 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a386eff-6f6d-419e-922e-313450fc483e admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:51:08.446981 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-7a386eff-6f6d-419e-922e-313450fc483e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:51:08.459583 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:51:08.588866 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a386eff-6f6d-419e-922e-313450fc483e admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:51:08.596897 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f69a9fa-bd84-40c7-8007-3654ed96557f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:51:08.598253 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69a9fa-bd84-40c7-8007-3654ed96557f service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:51:08.599313 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69a9fa-bd84-40c7-8007-3654ed96557f service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:51:08.599313 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69a9fa-bd84-40c7-8007-3654ed96557f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:51:08.626245 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f69a9fa-bd84-40c7-8007-3654ed96557f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:51:08.630225 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f69a9fa-bd84-40c7-8007-3654ed96557f service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:51:08.668134 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1204/2404] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:51:08 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:51:15.809862 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a2f73-a1fe-46a2-a37b-6a2fe06de7d6 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:51:15.811211 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a2f73-a1fe-46a2-a37b-6a2fe06de7d6 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:51:15.811779 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a2f73-a1fe-46a2-a37b-6a2fe06de7d6 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:51:15.813879 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1201/2405] 10.222.0.42 () {54 vars in 921 bytes} [Wed Jun 22 08:51:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:51:15.827557 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48189117-6a25-4913-abcd-5b7545b6bd36 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:51:15.828812 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48189117-6a25-4913-abcd-5b7545b6bd36 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:51:15.829301 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48189117-6a25-4913-abcd-5b7545b6bd36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:51:15.983068 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-48189117-6a25-4913-abcd-5b7545b6bd36 None None] MFA Rules not processed for user `4f1809a35b244c1db7a185d82859369e`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:51:15.988834 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-48189117-6a25-4913-abcd-5b7545b6bd36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:51:16.218615 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1205/2406] 10.222.0.42 () {58 vars in 1018 bytes} [Wed Jun 22 08:51:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:51:16.227760 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a2f73-a1fe-46a2-a37b-6a2fe06de7d6 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:51:16.230019 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-060a2f73-a1fe-46a2-a37b-6a2fe06de7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:51:16.251110 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:51:16.336681 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a2f73-a1fe-46a2-a37b-6a2fe06de7d6 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:51:16.345445 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b1ee9-53f0-4c90-b989-7258def6a760 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589eb8cc97714580840ac7a48ea38ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:51:16.346178 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b1ee9-53f0-4c90-b989-7258def6a760 service glance] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:51:16.346454 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b1ee9-53f0-4c90-b989-7258def6a760 service glance] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:51:16.346977 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b1ee9-53f0-4c90-b989-7258def6a760 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:51:16.360226 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31b1ee9-53f0-4c90-b989-7258def6a760 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:51:16.362496 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31b1ee9-53f0-4c90-b989-7258def6a760 service glance] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:51:16.381946 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1202/2407] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:51:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 08:51:16.475753 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81978c-f4ba-4829-85e6-0a63d31deacc None None] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:51:16.476415 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81978c-f4ba-4829-85e6-0a63d31deacc None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:51:16.477016 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81978c-f4ba-4829-85e6-0a63d31deacc None None] PATH_INFO: `/` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:51:16.480285 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1206/2408] 10.222.0.42 () {54 vars in 921 bytes} [Wed Jun 22 08:51:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:51:16.486685 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5a0b3-115f-4cf6-a80c-49ae275e97ec None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:51:16.487200 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5a0b3-115f-4cf6-a80c-49ae275e97ec None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:51:16.487579 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5a0b3-115f-4cf6-a80c-49ae275e97ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:51:16.520794 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-22d5a0b3-115f-4cf6-a80c-49ae275e97ec None None] MFA Rules not processed for user `751f037ff70d4eb8acb4e8d4c5c487ad`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:51:16.523631 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-22d5a0b3-115f-4cf6-a80c-49ae275e97ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:51:16.626430 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1203/2409] 10.222.0.42 () {58 vars in 1018 bytes} [Wed Jun 22 08:51:16 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:51:16.638953 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de81978c-f4ba-4829-85e6-0a63d31deacc None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:51:16.641011 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-de81978c-f4ba-4829-85e6-0a63d31deacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:51:16.663639 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de81978c-f4ba-4829-85e6-0a63d31deacc None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:51:16.668760 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a32e46-788f-436b-8dfa-57269b881152 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:51:16.669767 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a32e46-788f-436b-8dfa-57269b881152 service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:51:16.670300 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a32e46-788f-436b-8dfa-57269b881152 service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:51:16.670710 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a32e46-788f-436b-8dfa-57269b881152 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:51:16.684012 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a32e46-788f-436b-8dfa-57269b881152 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:51:16.694294 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a32e46-788f-436b-8dfa-57269b881152 service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:51:16.702525 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1207/2410] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:51:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:51:16.806004 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7174e1-4175-4df5-bade-a582477a2e23 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:51:16.806731 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7174e1-4175-4df5-bade-a582477a2e23 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:51:16.807355 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7174e1-4175-4df5-bade-a582477a2e23 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:51:16.811254 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1204/2411] 10.222.0.42 () {54 vars in 921 bytes} [Wed Jun 22 08:51:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:51:16.821043 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6438690-d0e0-4ef8-80a8-736d3b0319d0 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:51:16.821561 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6438690-d0e0-4ef8-80a8-736d3b0319d0 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:51:16.822064 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6438690-d0e0-4ef8-80a8-736d3b0319d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:51:16.860107 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-a6438690-d0e0-4ef8-80a8-736d3b0319d0 None None] MFA Rules not processed for user `4f1809a35b244c1db7a185d82859369e`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:51:16.862443 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-a6438690-d0e0-4ef8-80a8-736d3b0319d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:51:16.885517 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1208/2412] 10.222.0.42 () {58 vars in 1018 bytes} [Wed Jun 22 08:51:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 08:51:16.901376 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7174e1-4175-4df5-bade-a582477a2e23 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:51:16.923818 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7174e1-4175-4df5-bade-a582477a2e23 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:51:16.928890 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5e70e2-3fd5-4eca-b256-eef3f8d8e957 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:51:16.929814 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5e70e2-3fd5-4eca-b256-eef3f8d8e957 service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:51:16.930297 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5e70e2-3fd5-4eca-b256-eef3f8d8e957 service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:51:16.931029 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5e70e2-3fd5-4eca-b256-eef3f8d8e957 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:51:16.946818 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5e70e2-3fd5-4eca-b256-eef3f8d8e957 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:51:16.948572 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5e70e2-3fd5-4eca-b256-eef3f8d8e957 service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:51:16.968755 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1205/2413] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:51:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 08:51:26.851512 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=87 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:51:26.962060 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=51 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:10.655255 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6438690-d0e0-4ef8-80a8-736d3b0319d0 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:10.657503 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-a6438690-d0e0-4ef8-80a8-736d3b0319d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:52:10.870658 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6438690-d0e0-4ef8-80a8-736d3b0319d0 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:10.879436 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3a583-1013-49d3-a45c-01b1ba529582 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec2627e3cdc94ec38d7cc3b1bc670ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:10.880450 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3a583-1013-49d3-a45c-01b1ba529582 service placement] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:10.880890 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3a583-1013-49d3-a45c-01b1ba529582 service placement] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:10.882404 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3a583-1013-49d3-a45c-01b1ba529582 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:10.885505 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-f9e3a583-1013-49d3-a45c-01b1ba529582 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:52:10.900435 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e3a583-1013-49d3-a45c-01b1ba529582 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:10.902191 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e3a583-1013-49d3-a45c-01b1ba529582 service placement] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:10.914885 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1209/2414] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:52:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:52:11.974376 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5e70e2-3fd5-4eca-b256-eef3f8d8e957 service neutron] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:11.984966 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5e70e2-3fd5-4eca-b256-eef3f8d8e957 service neutron] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:11.989177 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b8a2d-20e5-4cbf-90e5-5cd62b1d9618 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:11.989842 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b8a2d-20e5-4cbf-90e5-5cd62b1d9618 service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:11.990158 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b8a2d-20e5-4cbf-90e5-5cd62b1d9618 service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:11.990442 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b8a2d-20e5-4cbf-90e5-5cd62b1d9618 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:11.992400 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-3d6b8a2d-20e5-4cbf-90e5-5cd62b1d9618 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:52:12.066438 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6b8a2d-20e5-4cbf-90e5-5cd62b1d9618 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:12.067896 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6b8a2d-20e5-4cbf-90e5-5cd62b1d9618 service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:12.079948 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1206/2415] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:52:11 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:52:20.909320 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=41 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:22.074484 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=30 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:53:20.254868 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3a583-1013-49d3-a45c-01b1ba529582 service placement] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:53:20.266242 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3a583-1013-49d3-a45c-01b1ba529582 service placement] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:53:20.270245 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa83072-00f0-4adf-ad96-2a6de77fc378 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:53:20.270906 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa83072-00f0-4adf-ad96-2a6de77fc378 service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:53:20.271192 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa83072-00f0-4adf-ad96-2a6de77fc378 service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:53:20.271478 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa83072-00f0-4adf-ad96-2a6de77fc378 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:53:20.273342 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-1fa83072-00f0-4adf-ad96-2a6de77fc378 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:53:20.289497 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa83072-00f0-4adf-ad96-2a6de77fc378 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:53:20.291812 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa83072-00f0-4adf-ad96-2a6de77fc378 service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:53:20.308846 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1210/2416] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:53:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 08:53:30.301729 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=6 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:53:32.523020 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b8a2d-20e5-4cbf-90e5-5cd62b1d9618 service neutron] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:53:32.524513 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-3d6b8a2d-20e5-4cbf-90e5-5cd62b1d9618 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:53:32.559256 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b8a2d-20e5-4cbf-90e5-5cd62b1d9618 service neutron] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:53:32.565208 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5ce94c-7e0c-400c-9843-03929e891793 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:53:32.566211 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ce94c-7e0c-400c-9843-03929e891793 service cinder] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:53:32.566743 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ce94c-7e0c-400c-9843-03929e891793 service cinder] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:53:32.567079 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ce94c-7e0c-400c-9843-03929e891793 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:53:32.571129 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-4d5ce94c-7e0c-400c-9843-03929e891793 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:53:32.646314 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5ce94c-7e0c-400c-9843-03929e891793 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:53:32.648119 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5ce94c-7e0c-400c-9843-03929e891793 service cinder] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:53:32.658473 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1207/2417] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:53:32 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:53:36.989962 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa83072-00f0-4adf-ad96-2a6de77fc378 service neutron] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:53:36.989962 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-1fa83072-00f0-4adf-ad96-2a6de77fc378 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:53:37.004107 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa83072-00f0-4adf-ad96-2a6de77fc378 service neutron] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:53:37.010757 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6644001c-14ad-42de-a938-cd3f6dc13a6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f1809a35b244c1db7a185d82859369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:53:37.011404 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644001c-14ad-42de-a938-cd3f6dc13a6e service nova] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:53:37.011685 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644001c-14ad-42de-a938-cd3f6dc13a6e service nova] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:53:37.011958 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644001c-14ad-42de-a938-cd3f6dc13a6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:53:37.013753 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-6644001c-14ad-42de-a938-cd3f6dc13a6e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:53:37.076516 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6644001c-14ad-42de-a938-cd3f6dc13a6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:53:37.078208 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6644001c-14ad-42de-a938-cd3f6dc13a6e service nova] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:53:37.088257 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1211/2418] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:53:36 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:53:42.653553 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=37 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:53:47.083512 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=28 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:54:30.182368 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5ce94c-7e0c-400c-9843-03929e891793 service cinder] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:54:30.183886 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-4d5ce94c-7e0c-400c-9843-03929e891793 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:54:30.196069 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5ce94c-7e0c-400c-9843-03929e891793 service cinder] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:54:30.199504 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa07493e-f1b4-4cca-b3c4-0c57d74c760e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:54:30.200135 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07493e-f1b4-4cca-b3c4-0c57d74c760e service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:30.200415 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07493e-f1b4-4cca-b3c4-0c57d74c760e service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:30.200687 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07493e-f1b4-4cca-b3c4-0c57d74c760e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:30.202397 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-fa07493e-f1b4-4cca-b3c4-0c57d74c760e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:54:30.212207 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa07493e-f1b4-4cca-b3c4-0c57d74c760e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:54:30.213617 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa07493e-f1b4-4cca-b3c4-0c57d74c760e service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:54:30.221623 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1208/2419] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:54:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:54:40.218192 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=6 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:55:04.134825 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6644001c-14ad-42de-a938-cd3f6dc13a6e service nova] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:55:04.136528 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-6644001c-14ad-42de-a938-cd3f6dc13a6e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:55:04.151109 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6644001c-14ad-42de-a938-cd3f6dc13a6e service nova] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:55:04.156580 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0657950e-e3be-4c98-b640-1d50a4d4d869 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f1809a35b244c1db7a185d82859369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:55:04.157268 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657950e-e3be-4c98-b640-1d50a4d4d869 service nova] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:55:04.157537 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657950e-e3be-4c98-b640-1d50a4d4d869 service nova] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:55:04.157816 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657950e-e3be-4c98-b640-1d50a4d4d869 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:55:04.159608 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-0657950e-e3be-4c98-b640-1d50a4d4d869 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:55:04.222300 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0657950e-e3be-4c98-b640-1d50a4d4d869 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:55:04.223839 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0657950e-e3be-4c98-b640-1d50a4d4d869 service nova] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:55:04.233405 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1212/2420] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:55:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:55:06.818355 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa07493e-f1b4-4cca-b3c4-0c57d74c760e service neutron] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:55:06.828507 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa07493e-f1b4-4cca-b3c4-0c57d74c760e service neutron] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:55:06.832075 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee96b02-cdb2-4548-bfc4-d41cd8ae3b99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:55:06.832715 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee96b02-cdb2-4548-bfc4-d41cd8ae3b99 service cinder] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:55:06.832998 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee96b02-cdb2-4548-bfc4-d41cd8ae3b99 service cinder] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:55:06.833277 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee96b02-cdb2-4548-bfc4-d41cd8ae3b99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:55:06.835134 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-5ee96b02-cdb2-4548-bfc4-d41cd8ae3b99 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:55:06.905775 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee96b02-cdb2-4548-bfc4-d41cd8ae3b99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:55:06.907254 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee96b02-cdb2-4548-bfc4-d41cd8ae3b99 service cinder] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:55:06.917569 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1209/2421] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:55:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:55:14.233623 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=28 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:55:16.447440 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0657950e-e3be-4c98-b640-1d50a4d4d869 service nova] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:55:16.457111 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0657950e-e3be-4c98-b640-1d50a4d4d869 service nova] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:55:16.460730 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b100e5-6077-4539-b88f-3f223cad89aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:55:16.461990 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b100e5-6077-4539-b88f-3f223cad89aa service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:55:16.462302 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b100e5-6077-4539-b88f-3f223cad89aa service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:55:16.462580 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b100e5-6077-4539-b88f-3f223cad89aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:55:16.464381 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-18b100e5-6077-4539-b88f-3f223cad89aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:55:16.524435 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b100e5-6077-4539-b88f-3f223cad89aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:55:16.525837 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b100e5-6077-4539-b88f-3f223cad89aa service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:55:16.535457 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1213/2422] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:55:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:55:16.912513 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=28 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:55:26.531021 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=28 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:55:50.016739 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee96b02-cdb2-4548-bfc4-d41cd8ae3b99 service cinder] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:55:50.025254 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee96b02-cdb2-4548-bfc4-d41cd8ae3b99 service cinder] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:55:50.028904 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a3adc-b3bf-417e-b01a-ea023605604e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:55:50.029529 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a3adc-b3bf-417e-b01a-ea023605604e service cinder] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:55:50.029812 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a3adc-b3bf-417e-b01a-ea023605604e service cinder] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:55:50.030110 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a3adc-b3bf-417e-b01a-ea023605604e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:55:50.031898 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-154a3adc-b3bf-417e-b01a-ea023605604e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:55:50.089611 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154a3adc-b3bf-417e-b01a-ea023605604e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:55:50.091083 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154a3adc-b3bf-417e-b01a-ea023605604e service cinder] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:55:50.100008 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1210/2423] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:55:50 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:55:57.971905 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b100e5-6077-4539-b88f-3f223cad89aa service cinder] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:55:57.984614 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b100e5-6077-4539-b88f-3f223cad89aa service cinder] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:55:57.988340 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66131172-e429-4e67-965d-82c6a34943f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:55:57.988988 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66131172-e429-4e67-965d-82c6a34943f1 service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:55:57.989271 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66131172-e429-4e67-965d-82c6a34943f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:55:57.989548 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66131172-e429-4e67-965d-82c6a34943f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:55:57.991717 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-66131172-e429-4e67-965d-82c6a34943f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:55:58.005873 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66131172-e429-4e67-965d-82c6a34943f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:55:58.007349 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66131172-e429-4e67-965d-82c6a34943f1 service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:55:58.018814 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1214/2424] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:55:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:56:00.095900 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=28 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:56:08.013636 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=6 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:56:09.042447 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a3adc-b3bf-417e-b01a-ea023605604e service cinder] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:56:09.051080 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a3adc-b3bf-417e-b01a-ea023605604e service cinder] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:56:09.054955 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cdb279-a3b7-4cfe-ac99-2f38d9ab620e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:56:09.055597 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cdb279-a3b7-4cfe-ac99-2f38d9ab620e service cinder] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:56:09.055880 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cdb279-a3b7-4cfe-ac99-2f38d9ab620e service cinder] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:56:09.056201 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cdb279-a3b7-4cfe-ac99-2f38d9ab620e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:56:09.064813 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cdb279-a3b7-4cfe-ac99-2f38d9ab620e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:56:09.066246 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cdb279-a3b7-4cfe-ac99-2f38d9ab620e service cinder] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:56:09.075494 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1211/2425] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:56:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:56:19.071531 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=6 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:57:17.533929 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef5b8d-7931-4ab5-90b5-9f1778c9e208 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:57:17.534671 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef5b8d-7931-4ab5-90b5-9f1778c9e208 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:57:17.534671 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef5b8d-7931-4ab5-90b5-9f1778c9e208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:57:17.583497 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-dcef5b8d-7931-4ab5-90b5-9f1778c9e208 None None] MFA Rules not processed for user `2bf91272d78b4e8f854c760622465af9`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:57:17.584717 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-dcef5b8d-7931-4ab5-90b5-9f1778c9e208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:57:17.649789 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1215/2426] 10.222.0.42 () {58 vars in 967 bytes} [Wed Jun 22 08:57:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:57:17.695834 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cdb279-a3b7-4cfe-ac99-2f38d9ab620e service cinder] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:57:17.697266 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-85cdb279-a3b7-4cfe-ac99-2f38d9ab620e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:57:17.795239 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cdb279-a3b7-4cfe-ac99-2f38d9ab620e service cinder] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:57:17.800411 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73b7224-f8cd-488a-bf70-1fa4eb1463e1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4403cea84ff646b88cdb785975b20346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:57:17.801061 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b7224-f8cd-488a-bf70-1fa4eb1463e1 service swift] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:57:17.801342 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b7224-f8cd-488a-bf70-1fa4eb1463e1 service swift] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:57:17.801673 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b7224-f8cd-488a-bf70-1fa4eb1463e1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:57:17.810273 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73b7224-f8cd-488a-bf70-1fa4eb1463e1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:57:17.811768 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73b7224-f8cd-488a-bf70-1fa4eb1463e1 service swift] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:57:17.821000 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1212/2427] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Jun 22 08:57:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 08:57:19.188204 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef5b8d-7931-4ab5-90b5-9f1778c9e208 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:57:19.203381 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef5b8d-7931-4ab5-90b5-9f1778c9e208 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:57:19.210736 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa14c07-f61a-4168-b023-bbae963a7844 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f1809a35b244c1db7a185d82859369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:57:19.211413 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa14c07-f61a-4168-b023-bbae963a7844 service nova] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:57:19.211697 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa14c07-f61a-4168-b023-bbae963a7844 service nova] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:57:19.211980 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa14c07-f61a-4168-b023-bbae963a7844 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:57:19.214310 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-faa14c07-f61a-4168-b023-bbae963a7844 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:57:19.230542 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa14c07-f61a-4168-b023-bbae963a7844 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:57:19.232684 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa14c07-f61a-4168-b023-bbae963a7844 service nova] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:57:19.245947 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1216/2428] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:57:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:57:19.273753 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95f412-284f-4c1c-9f8e-696b2ec08b40 None None] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:57:19.275415 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95f412-284f-4c1c-9f8e-696b2ec08b40 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:57:19.277740 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95f412-284f-4c1c-9f8e-696b2ec08b40 None None] PATH_INFO: `/` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:57:19.281536 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1213/2429] 10.222.0.42 () {54 vars in 912 bytes} [Wed Jun 22 08:57:19 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:57:19.288487 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02ec3d-09ae-453d-9e59-563c53a2861a None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:57:19.289338 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02ec3d-09ae-453d-9e59-563c53a2861a None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:57:19.289630 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02ec3d-09ae-453d-9e59-563c53a2861a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:57:19.340932 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-fd02ec3d-09ae-453d-9e59-563c53a2861a None None] MFA Rules not processed for user `ec2627e3cdc94ec38d7cc3b1bc670ef1`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:57:19.342474 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-fd02ec3d-09ae-453d-9e59-563c53a2861a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:57:19.352220 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1217/2430] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Jun 22 08:57:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 08:57:19.384826 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95f412-284f-4c1c-9f8e-696b2ec08b40 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:57:19.386493 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-af95f412-284f-4c1c-9f8e-696b2ec08b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:57:19.404079 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95f412-284f-4c1c-9f8e-696b2ec08b40 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:57:19.410032 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d595b7d-7f42-4ba3-88c0-ba390ca0180d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec2627e3cdc94ec38d7cc3b1bc670ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:57:19.410787 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d595b7d-7f42-4ba3-88c0-ba390ca0180d service placement] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:57:19.411601 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d595b7d-7f42-4ba3-88c0-ba390ca0180d service placement] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:57:19.411869 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d595b7d-7f42-4ba3-88c0-ba390ca0180d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:57:19.420878 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d595b7d-7f42-4ba3-88c0-ba390ca0180d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:57:19.422497 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d595b7d-7f42-4ba3-88c0-ba390ca0180d service placement] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:57:19.434052 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1214/2431] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:57:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:57:21.147318 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd02ec3d-09ae-453d-9e59-563c53a2861a None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:57:21.261415 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd02ec3d-09ae-453d-9e59-563c53a2861a None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:57:21.268061 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3c58c1-5caa-44ba-aaf9-09d9de876727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:57:21.269209 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c58c1-5caa-44ba-aaf9-09d9de876727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:57:21.269653 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c58c1-5caa-44ba-aaf9-09d9de876727 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:57:21.270636 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c58c1-5caa-44ba-aaf9-09d9de876727 admin admin] PATH_INFO: `/v3/users/b8299a39a0854f268d87a3f09033d63f` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:57:21.272795 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3c58c1-5caa-44ba-aaf9-09d9de876727 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8299a39a0854f268d87a3f09033d63f)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:57:21.276022 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3c58c1-5caa-44ba-aaf9-09d9de876727 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:57:21.350655 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:57:21.368908 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-5e3c58c1-5caa-44ba-aaf9-09d9de876727 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8299a39a0854f268d87a3f09033d63f'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:57:21.381835 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-5e3c58c1-5caa-44ba-aaf9-09d9de876727 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8299a39a0854f268d87a3f09033d63f'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:57:21.382864 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-5e3c58c1-5caa-44ba-aaf9-09d9de876727 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8299a39a0854f268d87a3f09033d63f'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:57:21.399325 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-5e3c58c1-5caa-44ba-aaf9-09d9de876727 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8299a39a0854f268d87a3f09033d63f'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:57:21.400477 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-5e3c58c1-5caa-44ba-aaf9-09d9de876727 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8299a39a0854f268d87a3f09033d63f'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:57:21.429951 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1218/2432] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 08:57:21 2022] DELETE /identity/v3/users/b8299a39a0854f268d87a3f09033d63f => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 08:57:21.435914 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec808ca-1c66-406b-8672-b63bcd9dd86d None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:57:21.436368 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec808ca-1c66-406b-8672-b63bcd9dd86d None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:57:21.436368 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec808ca-1c66-406b-8672-b63bcd9dd86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:57:21.460826 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-dec808ca-1c66-406b-8672-b63bcd9dd86d None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:57:21.463021 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-dec808ca-1c66-406b-8672-b63bcd9dd86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:57:21.553612 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1215/2433] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:57:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 08:57:21.563844 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3c58c1-5caa-44ba-aaf9-09d9de876727 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:57:21.565545 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-5e3c58c1-5caa-44ba-aaf9-09d9de876727 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:57:21.649589 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3c58c1-5caa-44ba-aaf9-09d9de876727 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:57:21.654674 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eee267-540e-48c2-9f2b-891093056c86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:57:21.655746 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eee267-540e-48c2-9f2b-891093056c86 service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:57:21.656224 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eee267-540e-48c2-9f2b-891093056c86 service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:57:21.656543 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eee267-540e-48c2-9f2b-891093056c86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:57:21.668108 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eee267-540e-48c2-9f2b-891093056c86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:57:21.669486 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eee267-540e-48c2-9f2b-891093056c86 service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:57:21.689598 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1219/2434] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:57:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:57:22.095740 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec808ca-1c66-406b-8672-b63bcd9dd86d None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:57:22.097520 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-dec808ca-1c66-406b-8672-b63bcd9dd86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:57:22.120655 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec808ca-1c66-406b-8672-b63bcd9dd86d None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:57:22.126929 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f5df55-cbe5-4760-aac4-5550b495be1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:57:22.127830 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5df55-cbe5-4760-aac4-5550b495be1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:57:22.128540 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5df55-cbe5-4760-aac4-5550b495be1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:57:22.128828 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5df55-cbe5-4760-aac4-5550b495be1c admin admin] PATH_INFO: `/v3/projects/1f997ffaf2ad4ee49c1aa461579a3327` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:57:22.138722 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f5df55-cbe5-4760-aac4-5550b495be1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f997ffaf2ad4ee49c1aa461579a3327)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:57:22.140776 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f5df55-cbe5-4760-aac4-5550b495be1c admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:57:22.193942 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b146d97-1e86-4ee6-974f-ddb96b84c389 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:57:22.195340 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b146d97-1e86-4ee6-974f-ddb96b84c389 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:57:22.195818 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b146d97-1e86-4ee6-974f-ddb96b84c389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:57:22.227506 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-2b146d97-1e86-4ee6-974f-ddb96b84c389 None None] MFA Rules not processed for user `0a2c3b8979a84abf933ab3228cdff26c`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:57:22.229474 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-2b146d97-1e86-4ee6-974f-ddb96b84c389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:57:22.232075 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-28f5df55-cbe5-4760-aac4-5550b495be1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f997ffaf2ad4ee49c1aa461579a3327', 'request_id': 'req-28f5df55-cbe5-4760-aac4-5550b495be1c'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:57:22.239506 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:57:22.255389 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-28f5df55-cbe5-4760-aac4-5550b495be1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f997ffaf2ad4ee49c1aa461579a3327', 'request_id': 'req-28f5df55-cbe5-4760-aac4-5550b495be1c'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:57:22.268868 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-28f5df55-cbe5-4760-aac4-5550b495be1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f997ffaf2ad4ee49c1aa461579a3327', 'request_id': 'req-28f5df55-cbe5-4760-aac4-5550b495be1c'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:57:22.293232 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-28f5df55-cbe5-4760-aac4-5550b495be1c admin admin] The token cache is being invalidate because project 1f997ffaf2ad4ee49c1aa461579a3327 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 08:57:22.293528 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-28f5df55-cbe5-4760-aac4-5550b495be1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:57:22.294270 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-28f5df55-cbe5-4760-aac4-5550b495be1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:57:22.296144 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1216/2435] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 08:57:22 2022] DELETE /identity/v3/projects/1f997ffaf2ad4ee49c1aa461579a3327 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:57:22.339576 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1220/2436] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:57:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:57:22.727988 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f5df55-cbe5-4760-aac4-5550b495be1c admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:57:22.729513 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-28f5df55-cbe5-4760-aac4-5550b495be1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:57:22.796616 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f5df55-cbe5-4760-aac4-5550b495be1c admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:57:22.800261 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20298918-a85d-424c-9eb7-b8432ac66785 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:57:22.801065 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20298918-a85d-424c-9eb7-b8432ac66785 service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:57:22.801425 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20298918-a85d-424c-9eb7-b8432ac66785 service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:57:22.801707 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20298918-a85d-424c-9eb7-b8432ac66785 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:57:22.803596 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-20298918-a85d-424c-9eb7-b8432ac66785 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:57:22.814528 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20298918-a85d-424c-9eb7-b8432ac66785 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:57:22.815975 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20298918-a85d-424c-9eb7-b8432ac66785 service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:57:22.824996 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1217/2437] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:57:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:57:23.166507 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b146d97-1e86-4ee6-974f-ddb96b84c389 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:57:23.172025 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-2b146d97-1e86-4ee6-974f-ddb96b84c389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:57:23.276792 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b146d97-1e86-4ee6-974f-ddb96b84c389 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:57:23.281884 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743cdc64-02c2-4cc2-a979-2c160d593943 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec2627e3cdc94ec38d7cc3b1bc670ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:57:23.282608 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743cdc64-02c2-4cc2-a979-2c160d593943 service placement] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:57:23.282894 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743cdc64-02c2-4cc2-a979-2c160d593943 service placement] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:57:23.283179 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743cdc64-02c2-4cc2-a979-2c160d593943 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:57:23.285003 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-743cdc64-02c2-4cc2-a979-2c160d593943 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:57:23.296011 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:57:23.299693 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743cdc64-02c2-4cc2-a979-2c160d593943 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:57:23.304098 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743cdc64-02c2-4cc2-a979-2c160d593943 service placement] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:57:23.325606 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1221/2438] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:57:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:57:23.932300 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20298918-a85d-424c-9eb7-b8432ac66785 service neutron] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:57:23.933840 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-20298918-a85d-424c-9eb7-b8432ac66785 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:57:23.950684 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20298918-a85d-424c-9eb7-b8432ac66785 service neutron] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:57:23.955855 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d942e23f-7bc6-4c85-8f29-82de25fe216c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec2627e3cdc94ec38d7cc3b1bc670ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:57:23.956521 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d942e23f-7bc6-4c85-8f29-82de25fe216c service placement] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:57:23.956809 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d942e23f-7bc6-4c85-8f29-82de25fe216c service placement] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:57:23.957089 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d942e23f-7bc6-4c85-8f29-82de25fe216c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:57:23.959852 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-d942e23f-7bc6-4c85-8f29-82de25fe216c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:57:23.973683 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d942e23f-7bc6-4c85-8f29-82de25fe216c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:57:23.975379 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d942e23f-7bc6-4c85-8f29-82de25fe216c service placement] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:57:23.986736 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1218/2439] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:57:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:57:31.683241 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743cdc64-02c2-4cc2-a979-2c160d593943 service placement] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:57:31.686369 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-743cdc64-02c2-4cc2-a979-2c160d593943 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:57:31.831714 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743cdc64-02c2-4cc2-a979-2c160d593943 service placement] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:57:31.838565 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e157dcb3-4b5e-46cc-896e-1c263b9f8edd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f1809a35b244c1db7a185d82859369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:57:31.839270 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157dcb3-4b5e-46cc-896e-1c263b9f8edd service nova] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:57:31.839552 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157dcb3-4b5e-46cc-896e-1c263b9f8edd service nova] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:57:31.839830 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157dcb3-4b5e-46cc-896e-1c263b9f8edd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:57:31.841817 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-e157dcb3-4b5e-46cc-896e-1c263b9f8edd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:57:31.855507 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e157dcb3-4b5e-46cc-896e-1c263b9f8edd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:57:31.857116 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e157dcb3-4b5e-46cc-896e-1c263b9f8edd service nova] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:57:31.874804 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1222/2440] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:57:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:57:33.981948 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=38,keystone:DELETE=2,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:57:36.672637 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d942e23f-7bc6-4c85-8f29-82de25fe216c service placement] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:57:36.686560 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d942e23f-7bc6-4c85-8f29-82de25fe216c service placement] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:57:36.692361 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd412a-8753-492d-ad29-de7b39985383 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f1809a35b244c1db7a185d82859369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:57:36.693009 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd412a-8753-492d-ad29-de7b39985383 service nova] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:57:36.693296 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd412a-8753-492d-ad29-de7b39985383 service nova] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:57:36.693581 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd412a-8753-492d-ad29-de7b39985383 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:57:36.695419 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-66cd412a-8753-492d-ad29-de7b39985383 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:57:36.708556 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cd412a-8753-492d-ad29-de7b39985383 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:57:36.710114 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cd412a-8753-492d-ad29-de7b39985383 service nova] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:57:36.724882 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1219/2441] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:57:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:57:41.864508 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=36 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:57:46.717213 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=6 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:57:49.764214 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f414d8-73fc-4623-95b0-dae367d4a499 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:57:49.764848 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f414d8-73fc-4623-95b0-dae367d4a499 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:57:49.764848 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f414d8-73fc-4623-95b0-dae367d4a499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:57:49.783222 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-19f414d8-73fc-4623-95b0-dae367d4a499 None None] MFA Rules not processed for user `33edf144fae24c76827b885f0ed7930b`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:57:49.784448 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-19f414d8-73fc-4623-95b0-dae367d4a499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:57:49.848374 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1223/2442] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 08:57:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:57:59.837144 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=25 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:58:33.028546 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd412a-8753-492d-ad29-de7b39985383 service nova] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:58:33.030042 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-66cd412a-8753-492d-ad29-de7b39985383 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:58:33.098396 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd412a-8753-492d-ad29-de7b39985383 service nova] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:58:33.101954 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc8452-66a0-4bb9-8ed6-3049f6438144 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:58:33.102658 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc8452-66a0-4bb9-8ed6-3049f6438144 service cinder] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:58:33.102941 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc8452-66a0-4bb9-8ed6-3049f6438144 service cinder] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:58:33.103221 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc8452-66a0-4bb9-8ed6-3049f6438144 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:58:33.105058 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-e5fc8452-66a0-4bb9-8ed6-3049f6438144 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:58:33.200161 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fc8452-66a0-4bb9-8ed6-3049f6438144 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:58:33.201776 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fc8452-66a0-4bb9-8ed6-3049f6438144 service cinder] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:58:33.224413 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1220/2443] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:58:33 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:58:36.417111 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f414d8-73fc-4623-95b0-dae367d4a499 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:58:36.426928 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f414d8-73fc-4623-95b0-dae367d4a499 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:58:36.430649 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35b1ebe-183a-40a4-9173-a7e3dde32a56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:58:36.431284 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b1ebe-183a-40a4-9173-a7e3dde32a56 service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:58:36.431569 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b1ebe-183a-40a4-9173-a7e3dde32a56 service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:58:36.431851 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b1ebe-183a-40a4-9173-a7e3dde32a56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:58:36.433608 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-d35b1ebe-183a-40a4-9173-a7e3dde32a56 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:58:36.471418 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35b1ebe-183a-40a4-9173-a7e3dde32a56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:58:36.472929 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35b1ebe-183a-40a4-9173-a7e3dde32a56 service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:58:36.497082 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1224/2444] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:58:36 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:58:43.220774 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=61 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:58:46.494416 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=19 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:58:49.270851 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc8452-66a0-4bb9-8ed6-3049f6438144 service cinder] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:58:49.280250 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc8452-66a0-4bb9-8ed6-3049f6438144 service cinder] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:58:49.283943 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f5b5b1-b092-4b66-87ca-a4421ec923a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:58:49.284614 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5b5b1-b092-4b66-87ca-a4421ec923a1 service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:58:49.284893 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5b5b1-b092-4b66-87ca-a4421ec923a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:58:49.285173 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5b5b1-b092-4b66-87ca-a4421ec923a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:58:49.286965 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-92f5b5b1-b092-4b66-87ca-a4421ec923a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:58:49.301063 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f5b5b1-b092-4b66-87ca-a4421ec923a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:58:49.302506 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f5b5b1-b092-4b66-87ca-a4421ec923a1 service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:58:49.313649 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1221/2445] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:58:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:58:59.308748 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=6 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:59:32.190254 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35b1ebe-183a-40a4-9173-a7e3dde32a56 service cinder] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:59:32.191852 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-d35b1ebe-183a-40a4-9173-a7e3dde32a56 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:59:32.204026 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35b1ebe-183a-40a4-9173-a7e3dde32a56 service cinder] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:59:32.207988 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9659b123-24a8-4a91-b12c-6f8cf31b6ce3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:59:32.209196 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659b123-24a8-4a91-b12c-6f8cf31b6ce3 service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:59:32.209600 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659b123-24a8-4a91-b12c-6f8cf31b6ce3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:59:32.209893 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659b123-24a8-4a91-b12c-6f8cf31b6ce3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:59:32.212069 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-9659b123-24a8-4a91-b12c-6f8cf31b6ce3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:59:32.222266 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9659b123-24a8-4a91-b12c-6f8cf31b6ce3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:59:32.223734 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9659b123-24a8-4a91-b12c-6f8cf31b6ce3 service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:59:32.232851 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1225/2446] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 08:59:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:59:42.229103 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=6 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:00:04.076353 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f5b5b1-b092-4b66-87ca-a4421ec923a1 service neutron] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:04.085846 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f5b5b1-b092-4b66-87ca-a4421ec923a1 service neutron] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:04.089801 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b469d0c5-f11a-4f93-bdc4-4b811528cbaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:04.090376 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469d0c5-f11a-4f93-bdc4-4b811528cbaf service cinder] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:04.090720 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469d0c5-f11a-4f93-bdc4-4b811528cbaf service cinder] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:04.091031 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469d0c5-f11a-4f93-bdc4-4b811528cbaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:04.093153 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-b469d0c5-f11a-4f93-bdc4-4b811528cbaf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:04.189473 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b469d0c5-f11a-4f93-bdc4-4b811528cbaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:04.190849 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b469d0c5-f11a-4f93-bdc4-4b811528cbaf service cinder] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:04.213117 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1222/2447] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:00:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:00:07.056711 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9659b123-24a8-4a91-b12c-6f8cf31b6ce3 service neutron] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:07.066263 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9659b123-24a8-4a91-b12c-6f8cf31b6ce3 service neutron] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:07.069806 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c762afa-9199-417a-8ee2-4f5a26498dc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:07.070489 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c762afa-9199-417a-8ee2-4f5a26498dc4 service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:07.071284 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c762afa-9199-417a-8ee2-4f5a26498dc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:07.071564 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c762afa-9199-417a-8ee2-4f5a26498dc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:07.073364 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-7c762afa-9199-417a-8ee2-4f5a26498dc4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:07.159244 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c762afa-9199-417a-8ee2-4f5a26498dc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:07.160736 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c762afa-9199-417a-8ee2-4f5a26498dc4 service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:07.179461 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1226/2448] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:00:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:00:14.209371 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=41 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:00:16.004898 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b469d0c5-f11a-4f93-bdc4-4b811528cbaf service cinder] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:16.013687 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b469d0c5-f11a-4f93-bdc4-4b811528cbaf service cinder] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:16.017315 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba734c6e-74fc-4279-bd60-ed77d6668939 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:16.017956 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba734c6e-74fc-4279-bd60-ed77d6668939 service cinder] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:16.018276 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba734c6e-74fc-4279-bd60-ed77d6668939 service cinder] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:16.018552 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba734c6e-74fc-4279-bd60-ed77d6668939 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:16.020329 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-ba734c6e-74fc-4279-bd60-ed77d6668939 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:16.056223 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba734c6e-74fc-4279-bd60-ed77d6668939 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:16.057665 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba734c6e-74fc-4279-bd60-ed77d6668939 service cinder] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:16.081846 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1223/2449] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:00:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:00:17.176865 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=41 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:00:26.079003 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=19 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:00:49.668504 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c762afa-9199-417a-8ee2-4f5a26498dc4 service cinder] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:49.688409 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c762afa-9199-417a-8ee2-4f5a26498dc4 service cinder] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:49.692075 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcae74c-b3de-49c9-bfe7-6a0cda6df884 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:49.692716 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcae74c-b3de-49c9-bfe7-6a0cda6df884 service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:49.692994 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcae74c-b3de-49c9-bfe7-6a0cda6df884 service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:49.693265 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcae74c-b3de-49c9-bfe7-6a0cda6df884 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:49.695079 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-1bcae74c-b3de-49c9-bfe7-6a0cda6df884 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:49.802547 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcae74c-b3de-49c9-bfe7-6a0cda6df884 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:49.804010 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcae74c-b3de-49c9-bfe7-6a0cda6df884 service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:49.823622 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1227/2450] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:00:49 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:00:59.819773 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=56 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:36.493692 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba734c6e-74fc-4279-bd60-ed77d6668939 service cinder] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:36.565501 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba734c6e-74fc-4279-bd60-ed77d6668939 service cinder] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:36.570626 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596cf05-08d3-4711-aa99-bd33b84d17cc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec2627e3cdc94ec38d7cc3b1bc670ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:36.571253 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596cf05-08d3-4711-aa99-bd33b84d17cc service placement] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:36.571536 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596cf05-08d3-4711-aa99-bd33b84d17cc service placement] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:36.571811 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596cf05-08d3-4711-aa99-bd33b84d17cc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:36.581259 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d596cf05-08d3-4711-aa99-bd33b84d17cc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:36.583014 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d596cf05-08d3-4711-aa99-bd33b84d17cc service placement] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:36.593097 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1224/2451] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:02:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:02:46.588884 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=27 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:14.205922 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcae74c-b3de-49c9-bfe7-6a0cda6df884 service cinder] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:03:14.207387 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-1bcae74c-b3de-49c9-bfe7-6a0cda6df884 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:03:14.308244 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcae74c-b3de-49c9-bfe7-6a0cda6df884 service cinder] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:03:14.313623 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9dcbed-0135-42ef-a121-36692a10144a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:03:14.314509 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9dcbed-0135-42ef-a121-36692a10144a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:14.314793 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9dcbed-0135-42ef-a121-36692a10144a admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:14.315067 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9dcbed-0135-42ef-a121-36692a10144a admin admin] PATH_INFO: `/v3/users/8bec30b2f39a46fbb26266d3dd9cc78a` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:14.316254 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9dcbed-0135-42ef-a121-36692a10144a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bec30b2f39a46fbb26266d3dd9cc78a)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:03:14.318269 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9dcbed-0135-42ef-a121-36692a10144a admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:03:14.364657 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-8c9dcbed-0135-42ef-a121-36692a10144a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bec30b2f39a46fbb26266d3dd9cc78a'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:14.371584 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-8c9dcbed-0135-42ef-a121-36692a10144a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bec30b2f39a46fbb26266d3dd9cc78a'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:14.372249 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-8c9dcbed-0135-42ef-a121-36692a10144a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bec30b2f39a46fbb26266d3dd9cc78a'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:14.379514 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-8c9dcbed-0135-42ef-a121-36692a10144a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bec30b2f39a46fbb26266d3dd9cc78a'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:14.380140 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-8c9dcbed-0135-42ef-a121-36692a10144a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bec30b2f39a46fbb26266d3dd9cc78a'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:14.397862 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1228/2452] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 09:03:14 2022] DELETE /identity/v3/users/8bec30b2f39a46fbb26266d3dd9cc78a => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:03:14.402591 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48255b9e-5e72-40f8-bcd0-e2a799eb16bb None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:14.403099 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48255b9e-5e72-40f8-bcd0-e2a799eb16bb None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:14.403209 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48255b9e-5e72-40f8-bcd0-e2a799eb16bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:14.429556 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-48255b9e-5e72-40f8-bcd0-e2a799eb16bb None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:03:14.430803 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-48255b9e-5e72-40f8-bcd0-e2a799eb16bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:03:14.489478 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1225/2453] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:03:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:03:14.499286 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9dcbed-0135-42ef-a121-36692a10144a admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:03:14.500680 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-8c9dcbed-0135-42ef-a121-36692a10144a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:03:14.556812 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:14.582406 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9dcbed-0135-42ef-a121-36692a10144a admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:03:14.586096 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89aff8c-57be-4efc-9a10-260090593a25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:03:14.586753 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89aff8c-57be-4efc-9a10-260090593a25 service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:14.587038 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89aff8c-57be-4efc-9a10-260090593a25 service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:14.587315 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89aff8c-57be-4efc-9a10-260090593a25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:14.596916 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89aff8c-57be-4efc-9a10-260090593a25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:03:14.598371 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89aff8c-57be-4efc-9a10-260090593a25 service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:03:14.607703 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1229/2454] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:03:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:03:14.880651 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48255b9e-5e72-40f8-bcd0-e2a799eb16bb None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:03:14.882133 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-48255b9e-5e72-40f8-bcd0-e2a799eb16bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:03:14.895952 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48255b9e-5e72-40f8-bcd0-e2a799eb16bb None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:03:14.900699 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c2f255-ec47-4ce3-9f96-d6a3152ac56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:03:14.901554 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c2f255-ec47-4ce3-9f96-d6a3152ac56b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:14.901844 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c2f255-ec47-4ce3-9f96-d6a3152ac56b admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:14.902163 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c2f255-ec47-4ce3-9f96-d6a3152ac56b admin admin] PATH_INFO: `/v3/projects/a66fa21fe9894cc0833c10ba15418e93` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:14.903376 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c2f255-ec47-4ce3-9f96-d6a3152ac56b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a66fa21fe9894cc0833c10ba15418e93)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:03:14.905292 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c2f255-ec47-4ce3-9f96-d6a3152ac56b admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:03:14.953750 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-f1c2f255-ec47-4ce3-9f96-d6a3152ac56b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a66fa21fe9894cc0833c10ba15418e93', 'request_id': 'req-f1c2f255-ec47-4ce3-9f96-d6a3152ac56b'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:14.959193 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-f1c2f255-ec47-4ce3-9f96-d6a3152ac56b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a66fa21fe9894cc0833c10ba15418e93', 'request_id': 'req-f1c2f255-ec47-4ce3-9f96-d6a3152ac56b'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:14.965255 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-f1c2f255-ec47-4ce3-9f96-d6a3152ac56b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a66fa21fe9894cc0833c10ba15418e93', 'request_id': 'req-f1c2f255-ec47-4ce3-9f96-d6a3152ac56b'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:14.977763 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-f1c2f255-ec47-4ce3-9f96-d6a3152ac56b admin admin] The token cache is being invalidate because project a66fa21fe9894cc0833c10ba15418e93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:03:14.978227 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-f1c2f255-ec47-4ce3-9f96-d6a3152ac56b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:14.979208 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-f1c2f255-ec47-4ce3-9f96-d6a3152ac56b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:14.980996 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1226/2455] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 09:03:14 2022] DELETE /identity/v3/projects/a66fa21fe9894cc0833c10ba15418e93 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:03:21.673575 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89aff8c-57be-4efc-9a10-260090593a25 service neutron] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:03:21.682782 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89aff8c-57be-4efc-9a10-260090593a25 service neutron] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:03:21.729904 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a7d0d-cc4c-42da-b88e-bc87d7778dfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:03:21.730573 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a7d0d-cc4c-42da-b88e-bc87d7778dfd service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:21.730946 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a7d0d-cc4c-42da-b88e-bc87d7778dfd service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:21.731129 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a7d0d-cc4c-42da-b88e-bc87d7778dfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:21.732908 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-fe1a7d0d-cc4c-42da-b88e-bc87d7778dfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:03:21.819780 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1a7d0d-cc4c-42da-b88e-bc87d7778dfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:03:21.821149 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1a7d0d-cc4c-42da-b88e-bc87d7778dfd service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:03:21.841234 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1230/2456] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:03:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:03:24.974903 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:31.838585 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=78 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:32.092228 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c2f255-ec47-4ce3-9f96-d6a3152ac56b admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:03:32.093619 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-f1c2f255-ec47-4ce3-9f96-d6a3152ac56b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:03:32.151514 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c2f255-ec47-4ce3-9f96-d6a3152ac56b admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:03:32.155181 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41330658-6c92-4dad-a991-5696b95e5566 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:03:32.155831 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41330658-6c92-4dad-a991-5696b95e5566 service cinder] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:32.156117 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41330658-6c92-4dad-a991-5696b95e5566 service cinder] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:32.156397 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41330658-6c92-4dad-a991-5696b95e5566 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:32.158213 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-41330658-6c92-4dad-a991-5696b95e5566 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:03:32.218031 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41330658-6c92-4dad-a991-5696b95e5566 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:03:32.219497 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41330658-6c92-4dad-a991-5696b95e5566 service cinder] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:03:32.228696 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1227/2457] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:03:32 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:03:36.269181 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a7d0d-cc4c-42da-b88e-bc87d7778dfd service neutron] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:03:36.288685 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a7d0d-cc4c-42da-b88e-bc87d7778dfd service neutron] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:03:36.292275 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ecd7bc-8409-4137-bbef-2c2ca51bb79e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:03:36.292909 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ecd7bc-8409-4137-bbef-2c2ca51bb79e service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:36.293191 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ecd7bc-8409-4137-bbef-2c2ca51bb79e service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:36.293465 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ecd7bc-8409-4137-bbef-2c2ca51bb79e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:36.295259 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-29ecd7bc-8409-4137-bbef-2c2ca51bb79e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:03:36.353866 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ecd7bc-8409-4137-bbef-2c2ca51bb79e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:03:36.355357 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ecd7bc-8409-4137-bbef-2c2ca51bb79e service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:03:36.365022 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1231/2458] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:03:36 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:03:42.224373 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=48 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:46.360290 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=32 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:51.087482 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41330658-6c92-4dad-a991-5696b95e5566 service cinder] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:03:51.088893 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-41330658-6c92-4dad-a991-5696b95e5566 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:03:51.101422 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41330658-6c92-4dad-a991-5696b95e5566 service cinder] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:03:51.106173 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b47935b-b027-438d-82e0-6795967b022c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:03:51.106823 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47935b-b027-438d-82e0-6795967b022c service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:51.107245 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47935b-b027-438d-82e0-6795967b022c service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:51.107522 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47935b-b027-438d-82e0-6795967b022c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:51.109496 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-2b47935b-b027-438d-82e0-6795967b022c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:03:51.127774 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b47935b-b027-438d-82e0-6795967b022c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:03:51.129225 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b47935b-b027-438d-82e0-6795967b022c service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:03:51.142050 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1228/2459] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:03:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:04:01.135736 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=6 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:04:14.568722 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ecd7bc-8409-4137-bbef-2c2ca51bb79e service cinder] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:04:14.571397 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-29ecd7bc-8409-4137-bbef-2c2ca51bb79e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:04:14.588581 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ecd7bc-8409-4137-bbef-2c2ca51bb79e service cinder] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:04:14.596776 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e5a186-c5c0-47aa-8581-65d9b5b914ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f1809a35b244c1db7a185d82859369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:04:14.597441 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5a186-c5c0-47aa-8581-65d9b5b914ef service nova] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:04:14.597729 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5a186-c5c0-47aa-8581-65d9b5b914ef service nova] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:04:14.598009 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5a186-c5c0-47aa-8581-65d9b5b914ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:04:14.600480 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-73e5a186-c5c0-47aa-8581-65d9b5b914ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:04:14.618269 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e5a186-c5c0-47aa-8581-65d9b5b914ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:04:14.619928 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e5a186-c5c0-47aa-8581-65d9b5b914ef service nova] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:04:14.632691 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1232/2460] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:04:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:04:24.628170 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=6 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:04:39.251210 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b47935b-b027-438d-82e0-6795967b022c service neutron] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:04:39.253044 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-2b47935b-b027-438d-82e0-6795967b022c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:04:39.269382 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b47935b-b027-438d-82e0-6795967b022c service neutron] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:04:39.278636 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa0b9cf-4ab8-402e-80e6-8c844b20de86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:04:39.279649 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa0b9cf-4ab8-402e-80e6-8c844b20de86 service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:04:39.280087 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa0b9cf-4ab8-402e-80e6-8c844b20de86 service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:04:39.280571 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa0b9cf-4ab8-402e-80e6-8c844b20de86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:04:39.283224 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-6fa0b9cf-4ab8-402e-80e6-8c844b20de86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:04:39.296858 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa0b9cf-4ab8-402e-80e6-8c844b20de86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:04:39.299974 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa0b9cf-4ab8-402e-80e6-8c844b20de86 service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:04:39.310980 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1229/2461] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:04:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:04:41.803201 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0990feab-5da5-4974-a500-aa1bafe96815 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:04:41.803792 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0990feab-5da5-4974-a500-aa1bafe96815 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:04:41.803909 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0990feab-5da5-4974-a500-aa1bafe96815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:04:41.831729 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-0990feab-5da5-4974-a500-aa1bafe96815 None None] MFA Rules not processed for user `33edf144fae24c76827b885f0ed7930b`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:04:41.833485 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-0990feab-5da5-4974-a500-aa1bafe96815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:04:41.888079 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1233/2462] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:04:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:04:42.183204 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa0b9cf-4ab8-402e-80e6-8c844b20de86 service neutron] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:04:42.192063 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa0b9cf-4ab8-402e-80e6-8c844b20de86 service neutron] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:04:42.196382 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d393df-f105-46ab-bc36-0994ea0861d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:04:42.197036 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d393df-f105-46ab-bc36-0994ea0861d7 service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:04:42.197319 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d393df-f105-46ab-bc36-0994ea0861d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:04:42.197597 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d393df-f105-46ab-bc36-0994ea0861d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:04:42.199408 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-d9d393df-f105-46ab-bc36-0994ea0861d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:04:42.208831 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d393df-f105-46ab-bc36-0994ea0861d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:04:42.210272 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d393df-f105-46ab-bc36-0994ea0861d7 service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:04:42.218123 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1230/2463] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:04:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:04:42.547731 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0990feab-5da5-4974-a500-aa1bafe96815 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:04:42.549178 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-0990feab-5da5-4974-a500-aa1bafe96815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:04:42.638383 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0990feab-5da5-4974-a500-aa1bafe96815 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:04:42.643229 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ee1bc-38e3-4330-b60b-40553e6827c1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec2627e3cdc94ec38d7cc3b1bc670ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:04:42.643905 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ee1bc-38e3-4330-b60b-40553e6827c1 service placement] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:04:42.644190 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ee1bc-38e3-4330-b60b-40553e6827c1 service placement] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:04:42.644493 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ee1bc-38e3-4330-b60b-40553e6827c1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:04:42.646411 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-c51ee1bc-38e3-4330-b60b-40553e6827c1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:04:42.658437 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51ee1bc-38e3-4330-b60b-40553e6827c1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:04:42.660057 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51ee1bc-38e3-4330-b60b-40553e6827c1 service placement] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:04:42.670651 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1234/2464] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:04:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:04:49.971010 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d393df-f105-46ab-bc36-0994ea0861d7 service neutron] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:04:49.989120 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d393df-f105-46ab-bc36-0994ea0861d7 service neutron] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:04:49.995805 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2037f7fc-7f08-4591-8751-30ae707797f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f1809a35b244c1db7a185d82859369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:04:49.996214 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037f7fc-7f08-4591-8751-30ae707797f9 service nova] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:04:49.996581 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037f7fc-7f08-4591-8751-30ae707797f9 service nova] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:04:49.996935 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037f7fc-7f08-4591-8751-30ae707797f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:04:49.998905 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-2037f7fc-7f08-4591-8751-30ae707797f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:04:50.014191 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2037f7fc-7f08-4591-8751-30ae707797f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:04:50.016272 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2037f7fc-7f08-4591-8751-30ae707797f9 service nova] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:04:50.041140 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1231/2465] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:04:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:04:52.666405 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=65 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:05:00.027362 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=18 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:05:03.696066 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ee1bc-38e3-4330-b60b-40553e6827c1 service placement] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:05:03.697488 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-c51ee1bc-38e3-4330-b60b-40553e6827c1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:05:03.723595 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ee1bc-38e3-4330-b60b-40553e6827c1 service placement] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:05:03.729842 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04878642-ab2f-44ef-9647-9261fe48fea9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:05:03.730529 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04878642-ab2f-44ef-9647-9261fe48fea9 service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:05:03.730816 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04878642-ab2f-44ef-9647-9261fe48fea9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:05:03.731099 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04878642-ab2f-44ef-9647-9261fe48fea9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:05:03.733131 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-04878642-ab2f-44ef-9647-9261fe48fea9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:05:03.792896 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04878642-ab2f-44ef-9647-9261fe48fea9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:05:03.794433 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04878642-ab2f-44ef-9647-9261fe48fea9 service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:05:03.804321 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1235/2466] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:05:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:05:07.409558 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2037f7fc-7f08-4591-8751-30ae707797f9 service nova] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:05:07.411084 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-2037f7fc-7f08-4591-8751-30ae707797f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:05:07.425322 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2037f7fc-7f08-4591-8751-30ae707797f9 service nova] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:05:07.430897 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d274e92-9331-42ff-8cc1-a76cb772bb87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f1809a35b244c1db7a185d82859369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:05:07.431530 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d274e92-9331-42ff-8cc1-a76cb772bb87 service nova] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:05:07.431816 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d274e92-9331-42ff-8cc1-a76cb772bb87 service nova] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:05:07.432094 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d274e92-9331-42ff-8cc1-a76cb772bb87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:05:07.433808 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-6d274e92-9331-42ff-8cc1-a76cb772bb87 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:05:07.492346 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d274e92-9331-42ff-8cc1-a76cb772bb87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:05:07.493929 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d274e92-9331-42ff-8cc1-a76cb772bb87 service nova] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:05:07.503824 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1232/2467] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:05:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:05:13.799636 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=33 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:05:17.498893 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=28 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:05:31.432497 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04878642-ab2f-44ef-9647-9261fe48fea9 service cinder] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:05:31.444817 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04878642-ab2f-44ef-9647-9261fe48fea9 service cinder] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:05:31.450185 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42937069-ffd2-4ccf-86ad-4e98f61ad31f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f1809a35b244c1db7a185d82859369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:05:31.450869 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42937069-ffd2-4ccf-86ad-4e98f61ad31f service nova] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:05:31.451111 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42937069-ffd2-4ccf-86ad-4e98f61ad31f service nova] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:05:31.451451 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42937069-ffd2-4ccf-86ad-4e98f61ad31f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:05:31.453167 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-42937069-ffd2-4ccf-86ad-4e98f61ad31f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:05:31.464261 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42937069-ffd2-4ccf-86ad-4e98f61ad31f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:05:31.465844 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42937069-ffd2-4ccf-86ad-4e98f61ad31f service nova] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:05:31.475301 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1236/2468] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:05:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:05:41.470681 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=6 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:42.521212 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d274e92-9331-42ff-8cc1-a76cb772bb87 service nova] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:42.532534 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d274e92-9331-42ff-8cc1-a76cb772bb87 service nova] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:42.537449 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2fbf43-bdf7-4e39-86e7-d8daac1ffaf9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec2627e3cdc94ec38d7cc3b1bc670ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:42.538112 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2fbf43-bdf7-4e39-86e7-d8daac1ffaf9 service placement] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:42.538402 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2fbf43-bdf7-4e39-86e7-d8daac1ffaf9 service placement] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:42.538682 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2fbf43-bdf7-4e39-86e7-d8daac1ffaf9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:42.540500 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-dd2fbf43-bdf7-4e39-86e7-d8daac1ffaf9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:42.553959 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2fbf43-bdf7-4e39-86e7-d8daac1ffaf9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:42.555571 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2fbf43-bdf7-4e39-86e7-d8daac1ffaf9 service placement] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:42.566850 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1233/2469] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:07:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:07:52.562018 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=6 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:22.086585 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42937069-ffd2-4ccf-86ad-4e98f61ad31f service nova] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:22.095970 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42937069-ffd2-4ccf-86ad-4e98f61ad31f service nova] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:22.099572 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3148f1e-f5a3-4ced-9810-ec4f071e89b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:22.100217 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3148f1e-f5a3-4ced-9810-ec4f071e89b2 service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:22.100489 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3148f1e-f5a3-4ced-9810-ec4f071e89b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:22.100768 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3148f1e-f5a3-4ced-9810-ec4f071e89b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:22.111517 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3148f1e-f5a3-4ced-9810-ec4f071e89b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:22.112949 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3148f1e-f5a3-4ced-9810-ec4f071e89b2 service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:22.124459 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1237/2470] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:08:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:08:32.118966 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=6 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:52.136814 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2fbf43-bdf7-4e39-86e7-d8daac1ffaf9 service placement] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:52.146013 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2fbf43-bdf7-4e39-86e7-d8daac1ffaf9 service placement] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:52.149564 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca802ab-919b-4a6e-8e26-9be9c3e3e1de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:52.150228 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca802ab-919b-4a6e-8e26-9be9c3e3e1de service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:52.150511 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca802ab-919b-4a6e-8e26-9be9c3e3e1de service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:52.150788 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca802ab-919b-4a6e-8e26-9be9c3e3e1de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:52.160759 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca802ab-919b-4a6e-8e26-9be9c3e3e1de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:52.162204 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca802ab-919b-4a6e-8e26-9be9c3e3e1de service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:52.173378 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1234/2471] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:08:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:09:02.168147 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=6 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:09:43.166367 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3148f1e-f5a3-4ced-9810-ec4f071e89b2 service neutron] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:09:43.174927 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3148f1e-f5a3-4ced-9810-ec4f071e89b2 service neutron] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:09:43.178509 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c59cbb-c53f-4d5a-9e4d-dbdb740e31a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:09:43.179137 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c59cbb-c53f-4d5a-9e4d-dbdb740e31a4 service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:09:43.179422 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c59cbb-c53f-4d5a-9e4d-dbdb740e31a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:09:43.179696 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c59cbb-c53f-4d5a-9e4d-dbdb740e31a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:09:43.187968 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c59cbb-c53f-4d5a-9e4d-dbdb740e31a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:09:43.188895 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c59cbb-c53f-4d5a-9e4d-dbdb740e31a4 service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:09:43.197236 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1238/2472] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:09:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:09:53.193475 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=6 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:10:04.010186 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca802ab-919b-4a6e-8e26-9be9c3e3e1de service neutron] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:10:04.021570 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca802ab-919b-4a6e-8e26-9be9c3e3e1de service neutron] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:10:04.026934 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d43a50c-72f6-472c-b8b2-fb7ce4d8e21c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f1809a35b244c1db7a185d82859369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:10:04.027554 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43a50c-72f6-472c-b8b2-fb7ce4d8e21c service nova] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:10:04.028480 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43a50c-72f6-472c-b8b2-fb7ce4d8e21c service nova] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:10:04.028758 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43a50c-72f6-472c-b8b2-fb7ce4d8e21c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:10:04.036375 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d43a50c-72f6-472c-b8b2-fb7ce4d8e21c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:10:04.037923 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d43a50c-72f6-472c-b8b2-fb7ce4d8e21c service nova] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:10:04.048086 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1235/2473] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:10:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:10:12.973011 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c59cbb-c53f-4d5a-9e4d-dbdb740e31a4 service neutron] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:10:12.982799 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c59cbb-c53f-4d5a-9e4d-dbdb740e31a4 service neutron] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:10:12.986399 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ead3a3-7a66-4045-a086-36fa40229b24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:10:12.987029 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ead3a3-7a66-4045-a086-36fa40229b24 service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:10:12.987314 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ead3a3-7a66-4045-a086-36fa40229b24 service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:10:12.987592 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ead3a3-7a66-4045-a086-36fa40229b24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:10:12.996009 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ead3a3-7a66-4045-a086-36fa40229b24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:10:12.997993 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ead3a3-7a66-4045-a086-36fa40229b24 service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:10:13.024785 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1239/2474] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:10:12 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:10:13.066547 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d43a50c-72f6-472c-b8b2-fb7ce4d8e21c service nova] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:10:13.075777 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d43a50c-72f6-472c-b8b2-fb7ce4d8e21c service nova] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:10:13.079386 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea15eb6-66c9-4d87-b6fc-c3f9c74f20b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:10:13.080019 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea15eb6-66c9-4d87-b6fc-c3f9c74f20b5 service cinder] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:10:13.080304 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea15eb6-66c9-4d87-b6fc-c3f9c74f20b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:10:13.080585 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea15eb6-66c9-4d87-b6fc-c3f9c74f20b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:10:13.089003 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea15eb6-66c9-4d87-b6fc-c3f9c74f20b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:10:13.090886 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea15eb6-66c9-4d87-b6fc-c3f9c74f20b5 service cinder] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:10:13.121801 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1236/2475] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:10:13 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:10:13.267809 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ead3a3-7a66-4045-a086-36fa40229b24 service cinder] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:10:13.276373 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ead3a3-7a66-4045-a086-36fa40229b24 service cinder] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:10:13.280580 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4902fbb-3c0a-4ecf-a623-497b82465d4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:10:13.281215 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4902fbb-3c0a-4ecf-a623-497b82465d4a service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:10:13.281503 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4902fbb-3c0a-4ecf-a623-497b82465d4a service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:10:13.281781 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4902fbb-3c0a-4ecf-a623-497b82465d4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:10:13.290063 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4902fbb-3c0a-4ecf-a623-497b82465d4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:10:13.291517 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4902fbb-3c0a-4ecf-a623-497b82465d4a service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:10:13.318739 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1240/2476] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:10:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:10:23.118709 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=19 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:10:23.316075 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=26 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:11:18.640265 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c0ccf-7bc0-4f62-b7ce-2fb69b389708 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:11:18.640778 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c0ccf-7bc0-4f62-b7ce-2fb69b389708 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:11:18.640888 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c0ccf-7bc0-4f62-b7ce-2fb69b389708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:11:18.705643 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-054c0ccf-7bc0-4f62-b7ce-2fb69b389708 None None] MFA Rules not processed for user `2bf91272d78b4e8f854c760622465af9`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:11:18.706866 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-054c0ccf-7bc0-4f62-b7ce-2fb69b389708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:11:18.768859 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1237/2477] 10.222.0.42 () {58 vars in 967 bytes} [Wed Jun 22 09:11:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:11:18.814730 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4902fbb-3c0a-4ecf-a623-497b82465d4a service cinder] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:11:18.816500 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-b4902fbb-3c0a-4ecf-a623-497b82465d4a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:11:18.905722 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4902fbb-3c0a-4ecf-a623-497b82465d4a service cinder] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:11:18.910916 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf20116-afb8-41cb-87f8-3068f5143fec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4403cea84ff646b88cdb785975b20346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:11:18.911627 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf20116-afb8-41cb-87f8-3068f5143fec service swift] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:11:18.911910 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf20116-afb8-41cb-87f8-3068f5143fec service swift] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:11:18.912334 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf20116-afb8-41cb-87f8-3068f5143fec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:11:18.921884 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf20116-afb8-41cb-87f8-3068f5143fec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:11:18.923530 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf20116-afb8-41cb-87f8-3068f5143fec service swift] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:11:18.931676 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1241/2478] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Jun 22 09:11:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 09:11:19.467610 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c0ccf-7bc0-4f62-b7ce-2fb69b389708 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:11:19.477370 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c0ccf-7bc0-4f62-b7ce-2fb69b389708 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:11:19.480952 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ea061-ca0d-465c-8d8e-a3b393a203a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:11:19.481595 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ea061-ca0d-465c-8d8e-a3b393a203a8 service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:11:19.481881 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ea061-ca0d-465c-8d8e-a3b393a203a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:11:19.482200 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ea061-ca0d-465c-8d8e-a3b393a203a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:11:19.484010 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-683ea061-ca0d-465c-8d8e-a3b393a203a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:11:19.547013 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683ea061-ca0d-465c-8d8e-a3b393a203a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:11:19.548435 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683ea061-ca0d-465c-8d8e-a3b393a203a8 service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:11:19.557865 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1238/2479] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:11:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:11:22.663016 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf20116-afb8-41cb-87f8-3068f5143fec service swift] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:11:22.675524 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf20116-afb8-41cb-87f8-3068f5143fec service swift] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:11:22.680802 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e1b1e1-c224-47bf-b0f9-a192e0432f90 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec2627e3cdc94ec38d7cc3b1bc670ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:11:22.681469 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1b1e1-c224-47bf-b0f9-a192e0432f90 service placement] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:11:22.681745 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1b1e1-c224-47bf-b0f9-a192e0432f90 service placement] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:11:22.682020 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1b1e1-c224-47bf-b0f9-a192e0432f90 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:11:22.684212 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-91e1b1e1-c224-47bf-b0f9-a192e0432f90 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:11:22.696500 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e1b1e1-c224-47bf-b0f9-a192e0432f90 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:11:22.698173 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e1b1e1-c224-47bf-b0f9-a192e0432f90 service placement] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:11:22.709285 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1242/2480] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:11:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:11:25.738959 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ea061-ca0d-465c-8d8e-a3b393a203a8 service neutron] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:11:25.750335 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ea061-ca0d-465c-8d8e-a3b393a203a8 service neutron] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:11:25.755339 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a7814-b813-455e-a1ec-0c30801309b1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec2627e3cdc94ec38d7cc3b1bc670ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:11:25.755991 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a7814-b813-455e-a1ec-0c30801309b1 service placement] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:11:25.756276 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a7814-b813-455e-a1ec-0c30801309b1 service placement] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:11:25.756557 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a7814-b813-455e-a1ec-0c30801309b1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:11:25.758366 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-5e5a7814-b813-455e-a1ec-0c30801309b1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:11:25.770029 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5a7814-b813-455e-a1ec-0c30801309b1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:11:25.771740 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5a7814-b813-455e-a1ec-0c30801309b1 service placement] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:11:25.785576 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1239/2481] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:11:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:11:25.796678 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e1b1e1-c224-47bf-b0f9-a192e0432f90 service placement] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:11:25.798285 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-91e1b1e1-c224-47bf-b0f9-a192e0432f90 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:11:25.817734 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e1b1e1-c224-47bf-b0f9-a192e0432f90 service placement] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:11:25.823696 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf3404-e4eb-4db4-b65a-92bbb41fad6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:11:25.824564 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf3404-e4eb-4db4-b65a-92bbb41fad6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:11:25.824846 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf3404-e4eb-4db4-b65a-92bbb41fad6b admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:11:25.825119 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf3404-e4eb-4db4-b65a-92bbb41fad6b admin admin] PATH_INFO: `/v3/users/4dc5e6a433e24eebad7d495dceaadb65` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:11:25.839792 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cf3404-e4eb-4db4-b65a-92bbb41fad6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dc5e6a433e24eebad7d495dceaadb65)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:11:25.841735 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cf3404-e4eb-4db4-b65a-92bbb41fad6b admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:11:25.886585 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-50cf3404-e4eb-4db4-b65a-92bbb41fad6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dc5e6a433e24eebad7d495dceaadb65'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:11:25.893955 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-50cf3404-e4eb-4db4-b65a-92bbb41fad6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dc5e6a433e24eebad7d495dceaadb65'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:11:25.894635 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-50cf3404-e4eb-4db4-b65a-92bbb41fad6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dc5e6a433e24eebad7d495dceaadb65'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:11:25.901912 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-50cf3404-e4eb-4db4-b65a-92bbb41fad6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dc5e6a433e24eebad7d495dceaadb65'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:11:25.902578 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-50cf3404-e4eb-4db4-b65a-92bbb41fad6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dc5e6a433e24eebad7d495dceaadb65'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:11:25.920244 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1243/2482] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 09:11:25 2022] DELETE /identity/v3/users/4dc5e6a433e24eebad7d495dceaadb65 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:11:26.091902 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a7814-b813-455e-a1ec-0c30801309b1 service placement] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:11:26.103160 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a7814-b813-455e-a1ec-0c30801309b1 service placement] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:11:26.139918 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:11:26.165154 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1959f86-a83f-4d40-9481-7b1836a3624c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:11:26.166015 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1959f86-a83f-4d40-9481-7b1836a3624c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:11:26.166339 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1959f86-a83f-4d40-9481-7b1836a3624c admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:11:26.166619 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1959f86-a83f-4d40-9481-7b1836a3624c admin admin] PATH_INFO: `/v3/projects/183ea9acdf344573b52a733477ced208` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:11:26.177519 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1959f86-a83f-4d40-9481-7b1836a3624c admin admin] RBAC: Authorizing `identity:delete_project(project_id=183ea9acdf344573b52a733477ced208)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:11:26.179464 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1959f86-a83f-4d40-9481-7b1836a3624c admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:11:26.224679 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-b1959f86-a83f-4d40-9481-7b1836a3624c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '183ea9acdf344573b52a733477ced208', 'request_id': 'req-b1959f86-a83f-4d40-9481-7b1836a3624c'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:11:26.230060 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-b1959f86-a83f-4d40-9481-7b1836a3624c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '183ea9acdf344573b52a733477ced208', 'request_id': 'req-b1959f86-a83f-4d40-9481-7b1836a3624c'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:11:26.236536 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-b1959f86-a83f-4d40-9481-7b1836a3624c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '183ea9acdf344573b52a733477ced208', 'request_id': 'req-b1959f86-a83f-4d40-9481-7b1836a3624c'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:11:26.249087 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-b1959f86-a83f-4d40-9481-7b1836a3624c admin admin] The token cache is being invalidate because project 183ea9acdf344573b52a733477ced208 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:11:26.249376 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-b1959f86-a83f-4d40-9481-7b1836a3624c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:11:26.250003 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-b1959f86-a83f-4d40-9481-7b1836a3624c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:11:26.252325 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1240/2483] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 09:11:26 2022] DELETE /identity/v3/projects/183ea9acdf344573b52a733477ced208 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:11:26.256052 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf3404-e4eb-4db4-b65a-92bbb41fad6b admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:11:26.257481 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-50cf3404-e4eb-4db4-b65a-92bbb41fad6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:11:26.271437 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf3404-e4eb-4db4-b65a-92bbb41fad6b admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:11:26.283411 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:11:26.328579 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d5fe7-4e62-4dfc-b7e3-6e14eacb4d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:11:26.329445 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d5fe7-4e62-4dfc-b7e3-6e14eacb4d51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:11:26.329753 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d5fe7-4e62-4dfc-b7e3-6e14eacb4d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:11:26.330029 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d5fe7-4e62-4dfc-b7e3-6e14eacb4d51 admin admin] PATH_INFO: `/v3/users/1e2282b381e64067a8535b3d23e6c91f` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:11:26.343376 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190d5fe7-4e62-4dfc-b7e3-6e14eacb4d51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e2282b381e64067a8535b3d23e6c91f)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:11:26.345245 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190d5fe7-4e62-4dfc-b7e3-6e14eacb4d51 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:11:26.389772 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-190d5fe7-4e62-4dfc-b7e3-6e14eacb4d51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e2282b381e64067a8535b3d23e6c91f'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:11:26.396613 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-190d5fe7-4e62-4dfc-b7e3-6e14eacb4d51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e2282b381e64067a8535b3d23e6c91f'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:11:26.397265 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-190d5fe7-4e62-4dfc-b7e3-6e14eacb4d51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e2282b381e64067a8535b3d23e6c91f'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:11:26.404289 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-190d5fe7-4e62-4dfc-b7e3-6e14eacb4d51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e2282b381e64067a8535b3d23e6c91f'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:11:26.405271 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-190d5fe7-4e62-4dfc-b7e3-6e14eacb4d51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e2282b381e64067a8535b3d23e6c91f'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:11:26.422435 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1244/2484] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 09:11:26 2022] DELETE /identity/v3/users/1e2282b381e64067a8535b3d23e6c91f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:11:26.597258 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1959f86-a83f-4d40-9481-7b1836a3624c admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:11:26.599249 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-b1959f86-a83f-4d40-9481-7b1836a3624c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:11:26.613621 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1959f86-a83f-4d40-9481-7b1836a3624c admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:11:26.672828 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe874b-cbd1-40fb-89d7-ba0d7f64eb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:11:26.673715 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe874b-cbd1-40fb-89d7-ba0d7f64eb61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:11:26.673998 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe874b-cbd1-40fb-89d7-ba0d7f64eb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:11:26.674310 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe874b-cbd1-40fb-89d7-ba0d7f64eb61 admin admin] PATH_INFO: `/v3/projects/98916dd74e484b86a4ebed934138c0cc` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:11:26.684515 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe874b-cbd1-40fb-89d7-ba0d7f64eb61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98916dd74e484b86a4ebed934138c0cc)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:11:26.687022 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe874b-cbd1-40fb-89d7-ba0d7f64eb61 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:11:26.730357 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-29fe874b-cbd1-40fb-89d7-ba0d7f64eb61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98916dd74e484b86a4ebed934138c0cc', 'request_id': 'req-29fe874b-cbd1-40fb-89d7-ba0d7f64eb61'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:11:26.731520 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:11:26.737716 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-29fe874b-cbd1-40fb-89d7-ba0d7f64eb61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98916dd74e484b86a4ebed934138c0cc', 'request_id': 'req-29fe874b-cbd1-40fb-89d7-ba0d7f64eb61'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:11:26.745687 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-29fe874b-cbd1-40fb-89d7-ba0d7f64eb61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98916dd74e484b86a4ebed934138c0cc', 'request_id': 'req-29fe874b-cbd1-40fb-89d7-ba0d7f64eb61'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:11:26.758196 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-29fe874b-cbd1-40fb-89d7-ba0d7f64eb61 admin admin] The token cache is being invalidate because project 98916dd74e484b86a4ebed934138c0cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:11:26.758467 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-29fe874b-cbd1-40fb-89d7-ba0d7f64eb61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:11:26.759076 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-29fe874b-cbd1-40fb-89d7-ba0d7f64eb61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:11:26.760855 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1241/2485] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 09:11:26 2022] DELETE /identity/v3/projects/98916dd74e484b86a4ebed934138c0cc => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:11:26.765931 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec564e-38be-41d5-bb77-41af29c51b38 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:11:26.766257 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec564e-38be-41d5-bb77-41af29c51b38 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:11:26.766535 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec564e-38be-41d5-bb77-41af29c51b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:11:26.813210 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-f4ec564e-38be-41d5-bb77-41af29c51b38 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:11:26.814480 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-f4ec564e-38be-41d5-bb77-41af29c51b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:11:26.874262 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1245/2486] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:11:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:11:26.882919 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5997c9b1-2319-4845-990a-2c83d221c776 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:11:26.883314 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5997c9b1-2319-4845-990a-2c83d221c776 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:11:26.884061 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5997c9b1-2319-4845-990a-2c83d221c776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:11:26.904732 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-5997c9b1-2319-4845-990a-2c83d221c776 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:11:26.906085 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-5997c9b1-2319-4845-990a-2c83d221c776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:11:26.913956 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1242/2487] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:11:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:11:26.923788 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec564e-38be-41d5-bb77-41af29c51b38 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:11:26.928778 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:11:26.935606 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec564e-38be-41d5-bb77-41af29c51b38 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:11:26.941989 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e994ca85-53b4-49ab-90a8-3315be8b3dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:11:26.942669 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e994ca85-53b4-49ab-90a8-3315be8b3dca admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:11:26.942959 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e994ca85-53b4-49ab-90a8-3315be8b3dca admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:11:26.943241 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e994ca85-53b4-49ab-90a8-3315be8b3dca admin admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:11:26.943970 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e994ca85-53b4-49ab-90a8-3315be8b3dca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:11:26.944287 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e994ca85-53b4-49ab-90a8-3315be8b3dca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:11:26.945903 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e994ca85-53b4-49ab-90a8-3315be8b3dca admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:11:26.958527 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1246/2488] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Jun 22 09:11:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:11:26.968539 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5997c9b1-2319-4845-990a-2c83d221c776 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:11:26.977857 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5997c9b1-2319-4845-990a-2c83d221c776 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:11:26.982535 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d2037-a2a2-4ebc-a518-43eb8aabe196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:11:26.983801 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d2037-a2a2-4ebc-a518-43eb8aabe196 admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:11:26.984075 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d2037-a2a2-4ebc-a518-43eb8aabe196 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:11:26.984353 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d2037-a2a2-4ebc-a518-43eb8aabe196 admin admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:11:26.985038 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265d2037-a2a2-4ebc-a518-43eb8aabe196 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:11:26.986976 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265d2037-a2a2-4ebc-a518-43eb8aabe196 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:11:27.021553 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1243/2489] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 09:11:26 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:11:27.025866 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e994ca85-53b4-49ab-90a8-3315be8b3dca admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:11:27.036620 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e994ca85-53b4-49ab-90a8-3315be8b3dca admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:11:27.090608 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84f7c2-27ab-4a9c-85d9-4109d30199fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:11:27.091295 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84f7c2-27ab-4a9c-85d9-4109d30199fe admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:11:27.091586 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84f7c2-27ab-4a9c-85d9-4109d30199fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:11:27.091866 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84f7c2-27ab-4a9c-85d9-4109d30199fe admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:11:27.093077 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad84f7c2-27ab-4a9c-85d9-4109d30199fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:11:27.095110 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad84f7c2-27ab-4a9c-85d9-4109d30199fe admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:11:27.114416 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1247/2490] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 09:11:27 2022] POST /identity/v3/users => generated 287 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:11:27.118379 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d2037-a2a2-4ebc-a518-43eb8aabe196 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:11:27.128543 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d2037-a2a2-4ebc-a518-43eb8aabe196 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:11:27.133090 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d7011a-b62c-4950-aa38-344b8c5336bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:11:27.133738 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7011a-b62c-4950-aa38-344b8c5336bd admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:11:27.134023 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7011a-b62c-4950-aa38-344b8c5336bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:11:27.134332 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7011a-b62c-4950-aa38-344b8c5336bd admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:11:27.135337 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d7011a-b62c-4950-aa38-344b8c5336bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:11:27.136919 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d7011a-b62c-4950-aa38-344b8c5336bd admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:11:27.146744 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1244/2491] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 09:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:11:27.150636 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84f7c2-27ab-4a9c-85d9-4109d30199fe admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:11:27.161040 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84f7c2-27ab-4a9c-85d9-4109d30199fe admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:11:27.165674 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9600b34b-2169-47cf-a38f-f2bad69b8723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:11:27.166354 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600b34b-2169-47cf-a38f-f2bad69b8723 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:11:27.166635 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600b34b-2169-47cf-a38f-f2bad69b8723 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:11:27.166911 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600b34b-2169-47cf-a38f-f2bad69b8723 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:11:27.167637 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9600b34b-2169-47cf-a38f-f2bad69b8723 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:11:27.169210 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9600b34b-2169-47cf-a38f-f2bad69b8723 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:11:27.179407 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1248/2492] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 09:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:11:27.183207 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d7011a-b62c-4950-aa38-344b8c5336bd admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:11:27.193793 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d7011a-b62c-4950-aa38-344b8c5336bd admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:11:27.198585 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e5821-8975-4008-b7d3-de333123949e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:11:27.199458 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e5821-8975-4008-b7d3-de333123949e admin admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:11:27.199747 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e5821-8975-4008-b7d3-de333123949e admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:11:27.200031 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e5821-8975-4008-b7d3-de333123949e admin admin] PATH_INFO: `/v3/projects/f85f3f82b3ad4a1c81dd2c39bcbe9f71/users/c9c9ad4b291147e2bc7c935e8e940e88/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:11:27.214502 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82e5821-8975-4008-b7d3-de333123949e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f85f3f82b3ad4a1c81dd2c39bcbe9f71, user_id=c9c9ad4b291147e2bc7c935e8e940e88, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:11:27.217643 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82e5821-8975-4008-b7d3-de333123949e admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:11:27.230094 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1245/2493] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 09:11:27 2022] PUT /identity/v3/projects/f85f3f82b3ad4a1c81dd2c39bcbe9f71/users/c9c9ad4b291147e2bc7c935e8e940e88/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:11:27.235540 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7c585-609f-4b6c-94ce-f961e22a1366 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:11:27.235844 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7c585-609f-4b6c-94ce-f961e22a1366 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:11:27.236125 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7c585-609f-4b6c-94ce-f961e22a1366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:11:27.253776 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-75d7c585-609f-4b6c-94ce-f961e22a1366 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:11:27.255097 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-75d7c585-609f-4b6c-94ce-f961e22a1366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:11:27.314369 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1249/2494] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:11:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:11:27.323835 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e5821-8975-4008-b7d3-de333123949e admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:11:27.325532 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-a82e5821-8975-4008-b7d3-de333123949e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:11:27.388689 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e5821-8975-4008-b7d3-de333123949e admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:11:27.392796 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea0cfdb-1458-4dd7-a735-b9ce9da4e2e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:11:27.393438 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea0cfdb-1458-4dd7-a735-b9ce9da4e2e6 service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:11:27.393721 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea0cfdb-1458-4dd7-a735-b9ce9da4e2e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:11:27.393995 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea0cfdb-1458-4dd7-a735-b9ce9da4e2e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:11:27.403204 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea0cfdb-1458-4dd7-a735-b9ce9da4e2e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:11:27.405281 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea0cfdb-1458-4dd7-a735-b9ce9da4e2e6 service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:11:27.414630 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1246/2495] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:11:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:11:30.970747 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6658c-c4ac-46b7-93ec-85d10d5eb83c None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:11:30.971251 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6658c-c4ac-46b7-93ec-85d10d5eb83c None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:11:30.971360 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6658c-c4ac-46b7-93ec-85d10d5eb83c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:11:30.997290 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-ddb6658c-c4ac-46b7-93ec-85d10d5eb83c None None] MFA Rules not processed for user `c9c9ad4b291147e2bc7c935e8e940e88`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:11:30.999114 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-ddb6658c-c4ac-46b7-93ec-85d10d5eb83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:11:31.063935 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:11:31.071019 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1250/2496] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:11:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:11:31.075096 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea0cfdb-1458-4dd7-a735-b9ce9da4e2e6 service neutron] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:11:31.084881 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea0cfdb-1458-4dd7-a735-b9ce9da4e2e6 service neutron] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:11:31.089408 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b49ae-bc43-486f-8af2-2ae2be67ede6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:11:31.090057 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b49ae-bc43-486f-8af2-2ae2be67ede6 admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:11:31.090374 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b49ae-bc43-486f-8af2-2ae2be67ede6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:11:31.090657 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b49ae-bc43-486f-8af2-2ae2be67ede6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:11:31.091356 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b49ae-bc43-486f-8af2-2ae2be67ede6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:11:31.093287 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b49ae-bc43-486f-8af2-2ae2be67ede6 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:11:31.120376 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1247/2497] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 09:11:31 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:11:31.125058 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb6658c-c4ac-46b7-93ec-85d10d5eb83c None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:11:31.136206 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb6658c-c4ac-46b7-93ec-85d10d5eb83c None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:11:31.201034 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07404be5-f917-4406-a508-f271de24e9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:11:31.201706 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07404be5-f917-4406-a508-f271de24e9e2 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:11:31.201986 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07404be5-f917-4406-a508-f271de24e9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:11:31.202351 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07404be5-f917-4406-a508-f271de24e9e2 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:11:31.203063 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07404be5-f917-4406-a508-f271de24e9e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:11:31.204989 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07404be5-f917-4406-a508-f271de24e9e2 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:11:31.225355 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1251/2498] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 09:11:31 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:11:31.229431 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b49ae-bc43-486f-8af2-2ae2be67ede6 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:11:31.240363 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b49ae-bc43-486f-8af2-2ae2be67ede6 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:11:31.245849 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a978e16b-c242-42f6-94ce-3086e6073469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:11:31.246662 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a978e16b-c242-42f6-94ce-3086e6073469 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:11:31.246960 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a978e16b-c242-42f6-94ce-3086e6073469 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:11:31.247245 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a978e16b-c242-42f6-94ce-3086e6073469 admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:11:31.247991 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a978e16b-c242-42f6-94ce-3086e6073469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:11:31.250278 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a978e16b-c242-42f6-94ce-3086e6073469 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:11:31.262770 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1248/2499] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 09:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:11:31.266746 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07404be5-f917-4406-a508-f271de24e9e2 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:11:31.277281 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07404be5-f917-4406-a508-f271de24e9e2 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:11:31.282094 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a031d1ab-22c4-41f5-be13-ea1f0eff4013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:11:31.282968 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a031d1ab-22c4-41f5-be13-ea1f0eff4013 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:11:31.283249 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a031d1ab-22c4-41f5-be13-ea1f0eff4013 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:11:31.283575 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a031d1ab-22c4-41f5-be13-ea1f0eff4013 admin admin] PATH_INFO: `/v3/projects/20d954a44fd7438b8396b0875bf604e5/users/3a5a5dd4019e48d6a0abff35921e2d48/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:11:31.300469 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a031d1ab-22c4-41f5-be13-ea1f0eff4013 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20d954a44fd7438b8396b0875bf604e5, user_id=3a5a5dd4019e48d6a0abff35921e2d48, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:11:31.303248 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a031d1ab-22c4-41f5-be13-ea1f0eff4013 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:11:31.317670 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1252/2500] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 09:11:31 2022] PUT /identity/v3/projects/20d954a44fd7438b8396b0875bf604e5/users/3a5a5dd4019e48d6a0abff35921e2d48/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:11:31.321607 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a978e16b-c242-42f6-94ce-3086e6073469 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:11:31.332449 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a978e16b-c242-42f6-94ce-3086e6073469 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:11:31.386058 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:11:31.422147 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b2e2c-fb78-423f-8fba-24e3449f4e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:11:31.422829 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b2e2c-fb78-423f-8fba-24e3449f4e32 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:11:31.423113 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b2e2c-fb78-423f-8fba-24e3449f4e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:11:31.423391 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b2e2c-fb78-423f-8fba-24e3449f4e32 admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:11:31.424120 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57b2e2c-fb78-423f-8fba-24e3449f4e32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:11:31.425714 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57b2e2c-fb78-423f-8fba-24e3449f4e32 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:11:31.440207 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1249/2501] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 09:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:11:31.445068 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a031d1ab-22c4-41f5-be13-ea1f0eff4013 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:11:31.456081 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a031d1ab-22c4-41f5-be13-ea1f0eff4013 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:11:31.460897 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e235845-e827-4db5-90b4-b2eff7016cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:11:31.461829 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e235845-e827-4db5-90b4-b2eff7016cd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:11:31.462151 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e235845-e827-4db5-90b4-b2eff7016cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:11:31.462433 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e235845-e827-4db5-90b4-b2eff7016cd8 admin admin] PATH_INFO: `/v3/projects/20d954a44fd7438b8396b0875bf604e5/users/3a5a5dd4019e48d6a0abff35921e2d48/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:11:31.464441 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e235845-e827-4db5-90b4-b2eff7016cd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20d954a44fd7438b8396b0875bf604e5, user_id=3a5a5dd4019e48d6a0abff35921e2d48, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:11:31.467938 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e235845-e827-4db5-90b4-b2eff7016cd8 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:11:31.479370 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1253/2502] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 09:11:31 2022] PUT /identity/v3/projects/20d954a44fd7438b8396b0875bf604e5/users/3a5a5dd4019e48d6a0abff35921e2d48/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:11:35.791079 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ce574-2af6-445e-9839-70d913c25eb5 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:11:35.791578 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ce574-2af6-445e-9839-70d913c25eb5 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:11:35.791785 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ce574-2af6-445e-9839-70d913c25eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:11:35.824519 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-f61ce574-2af6-445e-9839-70d913c25eb5 None None] MFA Rules not processed for user `3a5a5dd4019e48d6a0abff35921e2d48`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:11:35.825742 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-f61ce574-2af6-445e-9839-70d913c25eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:11:35.894683 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1250/2503] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:11:35 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:11:35.910360 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e235845-e827-4db5-90b4-b2eff7016cd8 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:11:35.912650 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-2e235845-e827-4db5-90b4-b2eff7016cd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:11:35.986982 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e235845-e827-4db5-90b4-b2eff7016cd8 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:11:35.992764 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9dab2-a80e-408c-bfd3-d00d6b81db59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f1809a35b244c1db7a185d82859369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:11:35.993411 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9dab2-a80e-408c-bfd3-d00d6b81db59 service nova] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:11:35.993692 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9dab2-a80e-408c-bfd3-d00d6b81db59 service nova] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:11:35.993982 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9dab2-a80e-408c-bfd3-d00d6b81db59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:11:36.041327 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:11:36.055511 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b9dab2-a80e-408c-bfd3-d00d6b81db59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:11:36.057151 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b9dab2-a80e-408c-bfd3-d00d6b81db59 service nova] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:11:36.067374 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1254/2504] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:11:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:11:37.127027 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8968126-b822-4116-8b83-1f2c26293cbf None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:11:37.127503 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8968126-b822-4116-8b83-1f2c26293cbf None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:11:37.127623 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8968126-b822-4116-8b83-1f2c26293cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:11:37.146295 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-a8968126-b822-4116-8b83-1f2c26293cbf None None] MFA Rules not processed for user `c9c9ad4b291147e2bc7c935e8e940e88`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:11:37.147499 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-a8968126-b822-4116-8b83-1f2c26293cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:11:37.155096 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1251/2505] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:11:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:11:46.062531 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=6 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:11:47.141092 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=50 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:12:13.476443 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9dab2-a80e-408c-bfd3-d00d6b81db59 service nova] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:12:13.477845 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-c6b9dab2-a80e-408c-bfd3-d00d6b81db59 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:12:13.533641 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9dab2-a80e-408c-bfd3-d00d6b81db59 service nova] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:12:13.537104 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353d2186-532e-48f5-b423-e7ea0c3263bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:12:13.537733 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d2186-532e-48f5-b423-e7ea0c3263bd service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:12:13.538012 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d2186-532e-48f5-b423-e7ea0c3263bd service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:12:13.538315 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d2186-532e-48f5-b423-e7ea0c3263bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:12:13.540022 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-353d2186-532e-48f5-b423-e7ea0c3263bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:12:13.617806 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353d2186-532e-48f5-b423-e7ea0c3263bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:12:13.619294 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353d2186-532e-48f5-b423-e7ea0c3263bd service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:12:13.637439 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1255/2506] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:12:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:12:15.109992 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8968126-b822-4116-8b83-1f2c26293cbf None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:12:15.112944 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-a8968126-b822-4116-8b83-1f2c26293cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:12:15.140603 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8968126-b822-4116-8b83-1f2c26293cbf None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:12:15.147953 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f72727a-e010-427f-9c1a-e20f08b1beaa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f1809a35b244c1db7a185d82859369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:12:15.149099 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72727a-e010-427f-9c1a-e20f08b1beaa service nova] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:12:15.149560 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72727a-e010-427f-9c1a-e20f08b1beaa service nova] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:12:15.150007 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72727a-e010-427f-9c1a-e20f08b1beaa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:12:15.152469 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-5f72727a-e010-427f-9c1a-e20f08b1beaa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:12:15.182211 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f72727a-e010-427f-9c1a-e20f08b1beaa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:12:15.184943 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f72727a-e010-427f-9c1a-e20f08b1beaa service nova] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:12:15.203101 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1252/2507] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:12:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:12:15.465050 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353d2186-532e-48f5-b423-e7ea0c3263bd service cinder] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:12:15.480166 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353d2186-532e-48f5-b423-e7ea0c3263bd service cinder] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:12:15.489873 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cb4ba8-00a8-4d10-8ca6-42353c787916 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f1809a35b244c1db7a185d82859369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:12:15.490587 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb4ba8-00a8-4d10-8ca6-42353c787916 service nova] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:12:15.490879 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb4ba8-00a8-4d10-8ca6-42353c787916 service nova] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:12:15.491158 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb4ba8-00a8-4d10-8ca6-42353c787916 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:12:15.493023 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-15cb4ba8-00a8-4d10-8ca6-42353c787916 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:12:15.529531 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cb4ba8-00a8-4d10-8ca6-42353c787916 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:12:15.531815 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cb4ba8-00a8-4d10-8ca6-42353c787916 service nova] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:12:15.549614 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1256/2508] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:12:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:12:18.915933 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f72727a-e010-427f-9c1a-e20f08b1beaa service nova] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:12:18.971609 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f72727a-e010-427f-9c1a-e20f08b1beaa service nova] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:12:18.975208 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fda212-d56a-4d1a-a19d-0277c24de5d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:12:18.975844 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fda212-d56a-4d1a-a19d-0277c24de5d8 service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:12:18.976128 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fda212-d56a-4d1a-a19d-0277c24de5d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:12:18.976409 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fda212-d56a-4d1a-a19d-0277c24de5d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:12:18.978223 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-08fda212-d56a-4d1a-a19d-0277c24de5d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:12:19.041834 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fda212-d56a-4d1a-a19d-0277c24de5d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:12:19.043868 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fda212-d56a-4d1a-a19d-0277c24de5d8 service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:12:19.053825 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1253/2509] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:12:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:12:22.198473 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cb4ba8-00a8-4d10-8ca6-42353c787916 service nova] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:12:22.199705 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-15cb4ba8-00a8-4d10-8ca6-42353c787916 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:12:22.215135 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cb4ba8-00a8-4d10-8ca6-42353c787916 service nova] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:12:22.220285 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb0918-0861-4c0b-94a6-f8720a263dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:12:22.221151 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb0918-0861-4c0b-94a6-f8720a263dd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:12:22.221440 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb0918-0861-4c0b-94a6-f8720a263dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:12:22.221720 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb0918-0861-4c0b-94a6-f8720a263dd8 admin admin] PATH_INFO: `/v3/users/b5a4250771db454a88bbb1c88ed17b66` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:12:22.235680 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffb0918-0861-4c0b-94a6-f8720a263dd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5a4250771db454a88bbb1c88ed17b66)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:12:22.237635 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffb0918-0861-4c0b-94a6-f8720a263dd8 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:12:22.287720 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-5ffb0918-0861-4c0b-94a6-f8720a263dd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5a4250771db454a88bbb1c88ed17b66'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:12:22.294517 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-5ffb0918-0861-4c0b-94a6-f8720a263dd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5a4250771db454a88bbb1c88ed17b66'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:12:22.295180 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-5ffb0918-0861-4c0b-94a6-f8720a263dd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5a4250771db454a88bbb1c88ed17b66'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:12:22.296830 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:12:22.303207 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-5ffb0918-0861-4c0b-94a6-f8720a263dd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5a4250771db454a88bbb1c88ed17b66'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:12:22.304083 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-5ffb0918-0861-4c0b-94a6-f8720a263dd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5a4250771db454a88bbb1c88ed17b66'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:12:22.321144 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1257/2510] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 09:12:22 2022] DELETE /identity/v3/users/b5a4250771db454a88bbb1c88ed17b66 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:12:22.502189 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fda212-d56a-4d1a-a19d-0277c24de5d8 service neutron] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:12:22.515157 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fda212-d56a-4d1a-a19d-0277c24de5d8 service neutron] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:12:22.582854 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c795075-9295-40a7-a393-7c160396f1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:12:22.583725 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c795075-9295-40a7-a393-7c160396f1f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:12:22.584004 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c795075-9295-40a7-a393-7c160396f1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:12:22.584280 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c795075-9295-40a7-a393-7c160396f1f7 admin admin] PATH_INFO: `/v3/projects/3a4ab81e1a914c618f9856c1758eb700` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:12:22.585491 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c795075-9295-40a7-a393-7c160396f1f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a4ab81e1a914c618f9856c1758eb700)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:12:22.587470 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c795075-9295-40a7-a393-7c160396f1f7 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:12:22.629273 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:12:22.638272 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-7c795075-9295-40a7-a393-7c160396f1f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a4ab81e1a914c618f9856c1758eb700', 'request_id': 'req-7c795075-9295-40a7-a393-7c160396f1f7'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:12:22.644707 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-7c795075-9295-40a7-a393-7c160396f1f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a4ab81e1a914c618f9856c1758eb700', 'request_id': 'req-7c795075-9295-40a7-a393-7c160396f1f7'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:12:22.651112 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-7c795075-9295-40a7-a393-7c160396f1f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a4ab81e1a914c618f9856c1758eb700', 'request_id': 'req-7c795075-9295-40a7-a393-7c160396f1f7'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:12:22.664768 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-7c795075-9295-40a7-a393-7c160396f1f7 admin admin] The token cache is being invalidate because project 3a4ab81e1a914c618f9856c1758eb700 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:12:22.665153 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-7c795075-9295-40a7-a393-7c160396f1f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:12:22.665875 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-7c795075-9295-40a7-a393-7c160396f1f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:12:22.667449 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1254/2511] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 09:12:22 2022] DELETE /identity/v3/projects/3a4ab81e1a914c618f9856c1758eb700 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:12:22.673351 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defdc307-6aaa-46a8-8717-1b454832dd51 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:12:22.673581 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defdc307-6aaa-46a8-8717-1b454832dd51 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:12:22.673882 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defdc307-6aaa-46a8-8717-1b454832dd51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:12:22.691722 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-defdc307-6aaa-46a8-8717-1b454832dd51 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:12:22.692908 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-defdc307-6aaa-46a8-8717-1b454832dd51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:12:22.751706 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1258/2512] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:12:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:12:22.760229 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5a493-bba1-4c33-b132-54659e5bd5b6 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:12:22.760511 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5a493-bba1-4c33-b132-54659e5bd5b6 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:12:22.760858 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5a493-bba1-4c33-b132-54659e5bd5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:12:22.780731 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-bea5a493-bba1-4c33-b132-54659e5bd5b6 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:12:22.782055 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-bea5a493-bba1-4c33-b132-54659e5bd5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:12:22.789850 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1255/2513] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:12:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:12:22.794002 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defdc307-6aaa-46a8-8717-1b454832dd51 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:12:22.804304 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defdc307-6aaa-46a8-8717-1b454832dd51 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:12:22.808891 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6ed3e0-d992-4b7e-9e74-ccb239157e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:12:22.809536 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ed3e0-d992-4b7e-9e74-ccb239157e3c admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:12:22.809823 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ed3e0-d992-4b7e-9e74-ccb239157e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:12:22.810130 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ed3e0-d992-4b7e-9e74-ccb239157e3c admin admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:12:22.811481 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6ed3e0-d992-4b7e-9e74-ccb239157e3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:12:22.811794 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6ed3e0-d992-4b7e-9e74-ccb239157e3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:12:22.813400 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6ed3e0-d992-4b7e-9e74-ccb239157e3c admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:12:22.824839 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1259/2514] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Jun 22 09:12:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:12:22.829972 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea5a493-bba1-4c33-b132-54659e5bd5b6 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:12:22.840511 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea5a493-bba1-4c33-b132-54659e5bd5b6 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:12:22.845223 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a14201-b6a8-4432-9981-13505ee80e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:12:22.846030 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a14201-b6a8-4432-9981-13505ee80e80 admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:12:22.846236 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a14201-b6a8-4432-9981-13505ee80e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:12:22.846518 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a14201-b6a8-4432-9981-13505ee80e80 admin admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:12:22.847219 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a14201-b6a8-4432-9981-13505ee80e80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:12:22.849125 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a14201-b6a8-4432-9981-13505ee80e80 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:12:22.875003 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1256/2515] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 09:12:22 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:12:22.879165 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6ed3e0-d992-4b7e-9e74-ccb239157e3c admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:12:22.889492 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6ed3e0-d992-4b7e-9e74-ccb239157e3c admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:12:22.946427 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c87dd9-1651-4034-904d-3520f36984b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:12:22.947000 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c87dd9-1651-4034-904d-3520f36984b1 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:12:22.947281 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c87dd9-1651-4034-904d-3520f36984b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:12:22.947556 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c87dd9-1651-4034-904d-3520f36984b1 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:12:22.948236 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c87dd9-1651-4034-904d-3520f36984b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:12:22.950172 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c87dd9-1651-4034-904d-3520f36984b1 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:12:22.970757 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1260/2516] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 09:12:22 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:12:22.974634 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a14201-b6a8-4432-9981-13505ee80e80 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:12:22.985511 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a14201-b6a8-4432-9981-13505ee80e80 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:12:22.990845 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73a2843-43d0-4876-a0a1-336bd310dd0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:12:22.991540 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a2843-43d0-4876-a0a1-336bd310dd0b admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:12:22.991827 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a2843-43d0-4876-a0a1-336bd310dd0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:12:22.992112 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a2843-43d0-4876-a0a1-336bd310dd0b admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:12:22.992848 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73a2843-43d0-4876-a0a1-336bd310dd0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:12:22.994604 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73a2843-43d0-4876-a0a1-336bd310dd0b admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:12:23.006902 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1257/2517] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 09:12:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:12:23.011498 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c87dd9-1651-4034-904d-3520f36984b1 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:12:23.021784 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c87dd9-1651-4034-904d-3520f36984b1 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:12:23.026423 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f243baf-35cf-4022-9c05-006d02772bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:12:23.027085 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f243baf-35cf-4022-9c05-006d02772bb3 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:12:23.027376 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f243baf-35cf-4022-9c05-006d02772bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:12:23.027659 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f243baf-35cf-4022-9c05-006d02772bb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:12:23.028391 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f243baf-35cf-4022-9c05-006d02772bb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:12:23.030023 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f243baf-35cf-4022-9c05-006d02772bb3 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:12:23.041117 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1261/2518] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 09:12:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:12:23.046386 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73a2843-43d0-4876-a0a1-336bd310dd0b admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:12:23.058931 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73a2843-43d0-4876-a0a1-336bd310dd0b admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:12:23.065290 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83479f8-0f29-44dd-b37a-1696e2aeaf54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:12:23.066189 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83479f8-0f29-44dd-b37a-1696e2aeaf54 admin admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:12:23.066470 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83479f8-0f29-44dd-b37a-1696e2aeaf54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:12:23.066743 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83479f8-0f29-44dd-b37a-1696e2aeaf54 admin admin] PATH_INFO: `/v3/projects/03bde12ba982486497997b5f04e23ae2/users/a19792e478a748268d63974aeed96b3a/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:12:23.084087 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83479f8-0f29-44dd-b37a-1696e2aeaf54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03bde12ba982486497997b5f04e23ae2, user_id=a19792e478a748268d63974aeed96b3a, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:12:23.087678 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83479f8-0f29-44dd-b37a-1696e2aeaf54 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:12:23.101636 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1258/2519] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 09:12:23 2022] PUT /identity/v3/projects/03bde12ba982486497997b5f04e23ae2/users/a19792e478a748268d63974aeed96b3a/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:12:23.106709 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f86cf9-3586-407b-90ff-ce9f0c66feb0 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:12:23.107005 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f86cf9-3586-407b-90ff-ce9f0c66feb0 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:12:23.108368 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f86cf9-3586-407b-90ff-ce9f0c66feb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:12:23.126901 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-71f86cf9-3586-407b-90ff-ce9f0c66feb0 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:12:23.128145 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-71f86cf9-3586-407b-90ff-ce9f0c66feb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:12:23.161585 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:12:23.189553 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1262/2520] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:12:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:12:23.199720 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83479f8-0f29-44dd-b37a-1696e2aeaf54 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:12:23.201484 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-c83479f8-0f29-44dd-b37a-1696e2aeaf54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:12:23.259458 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83479f8-0f29-44dd-b37a-1696e2aeaf54 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:12:23.263728 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75750f4e-dce2-4d28-8318-cab7b2f37651 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:12:23.264521 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75750f4e-dce2-4d28-8318-cab7b2f37651 service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:12:23.264811 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75750f4e-dce2-4d28-8318-cab7b2f37651 service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:12:23.265172 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75750f4e-dce2-4d28-8318-cab7b2f37651 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:12:23.275794 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75750f4e-dce2-4d28-8318-cab7b2f37651 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:12:23.277244 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75750f4e-dce2-4d28-8318-cab7b2f37651 service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:12:23.287548 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1259/2521] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:12:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:12:27.194674 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454cac02-dbab-4566-afec-348bbda22260 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:12:27.195246 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454cac02-dbab-4566-afec-348bbda22260 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:12:27.195246 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454cac02-dbab-4566-afec-348bbda22260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:12:27.226982 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-454cac02-dbab-4566-afec-348bbda22260 None None] MFA Rules not processed for user `a19792e478a748268d63974aeed96b3a`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:12:27.228373 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-454cac02-dbab-4566-afec-348bbda22260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:12:27.302588 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1263/2522] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:12:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:12:27.317280 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75750f4e-dce2-4d28-8318-cab7b2f37651 service neutron] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:12:27.318793 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-75750f4e-dce2-4d28-8318-cab7b2f37651 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:12:27.388842 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:12:27.393982 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75750f4e-dce2-4d28-8318-cab7b2f37651 service neutron] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:12:27.401284 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a172f56a-6abd-4a2c-b532-ef0104210c53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f1809a35b244c1db7a185d82859369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:12:27.402339 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a172f56a-6abd-4a2c-b532-ef0104210c53 service nova] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:12:27.402915 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a172f56a-6abd-4a2c-b532-ef0104210c53 service nova] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:12:27.403275 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a172f56a-6abd-4a2c-b532-ef0104210c53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:12:27.412382 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a172f56a-6abd-4a2c-b532-ef0104210c53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:12:27.413972 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a172f56a-6abd-4a2c-b532-ef0104210c53 service nova] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:12:27.423237 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1260/2523] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:12:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:12:28.889417 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdab271-8709-49ad-9328-6a7408996e5d None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:12:28.890001 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdab271-8709-49ad-9328-6a7408996e5d None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:12:28.890001 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdab271-8709-49ad-9328-6a7408996e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:12:28.907798 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-efdab271-8709-49ad-9328-6a7408996e5d None None] MFA Rules not processed for user `a19792e478a748268d63974aeed96b3a`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:12:28.909036 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-efdab271-8709-49ad-9328-6a7408996e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:12:28.918500 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1264/2524] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:12:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:12:29.261936 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a172f56a-6abd-4a2c-b532-ef0104210c53 service nova] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:12:29.272951 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a172f56a-6abd-4a2c-b532-ef0104210c53 service nova] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:12:29.277040 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296525c8-726f-47fa-ba29-4a3551214a6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:12:29.277625 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296525c8-726f-47fa-ba29-4a3551214a6e service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:12:29.277917 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296525c8-726f-47fa-ba29-4a3551214a6e service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:12:29.278263 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296525c8-726f-47fa-ba29-4a3551214a6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:12:29.280691 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-296525c8-726f-47fa-ba29-4a3551214a6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:12:29.292343 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296525c8-726f-47fa-ba29-4a3551214a6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:12:29.293796 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296525c8-726f-47fa-ba29-4a3551214a6e service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:12:29.304676 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1261/2525] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:12:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:12:29.659149 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdab271-8709-49ad-9328-6a7408996e5d None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:12:29.661564 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-efdab271-8709-49ad-9328-6a7408996e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:12:29.744223 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdab271-8709-49ad-9328-6a7408996e5d None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:12:29.750296 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8958e-e713-40c1-8470-382711279b93 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec2627e3cdc94ec38d7cc3b1bc670ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:12:29.750963 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8958e-e713-40c1-8470-382711279b93 service placement] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:12:29.751244 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8958e-e713-40c1-8470-382711279b93 service placement] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:12:29.751516 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8958e-e713-40c1-8470-382711279b93 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:12:29.753331 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-cee8958e-e713-40c1-8470-382711279b93 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:12:29.766324 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee8958e-e713-40c1-8470-382711279b93 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:12:29.767955 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee8958e-e713-40c1-8470-382711279b93 service placement] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:12:29.779935 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1265/2526] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:12:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:12:38.371535 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296525c8-726f-47fa-ba29-4a3551214a6e service neutron] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:12:38.373036 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-296525c8-726f-47fa-ba29-4a3551214a6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:12:38.437431 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296525c8-726f-47fa-ba29-4a3551214a6e service neutron] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:12:38.443807 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f703be-c2b1-4e52-bab0-d6154ba7ea39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f1809a35b244c1db7a185d82859369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:12:38.444465 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f703be-c2b1-4e52-bab0-d6154ba7ea39 service nova] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:12:38.444752 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f703be-c2b1-4e52-bab0-d6154ba7ea39 service nova] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:12:38.445033 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f703be-c2b1-4e52-bab0-d6154ba7ea39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:12:38.446813 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-30f703be-c2b1-4e52-bab0-d6154ba7ea39 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:12:38.459622 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f703be-c2b1-4e52-bab0-d6154ba7ea39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:12:38.461198 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f703be-c2b1-4e52-bab0-d6154ba7ea39 service nova] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:12:38.472945 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1262/2527] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:12:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:12:39.774530 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=76 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:12:46.466454 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8958e-e713-40c1-8470-382711279b93 service placement] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:12:46.528996 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8958e-e713-40c1-8470-382711279b93 service placement] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:12:46.534632 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa97240-c186-4804-8354-89fded598b00 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec2627e3cdc94ec38d7cc3b1bc670ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:12:46.535297 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa97240-c186-4804-8354-89fded598b00 service placement] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:12:46.535568 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa97240-c186-4804-8354-89fded598b00 service placement] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:12:46.535849 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa97240-c186-4804-8354-89fded598b00 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:12:46.537655 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-6aa97240-c186-4804-8354-89fded598b00 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:12:46.549841 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa97240-c186-4804-8354-89fded598b00 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:12:46.551485 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa97240-c186-4804-8354-89fded598b00 service placement] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:12:46.561523 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1266/2528] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:12:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:12:48.467747 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=34 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:12:56.557233 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=27 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:14:50.192360 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f703be-c2b1-4e52-bab0-d6154ba7ea39 service nova] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:50.210654 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f703be-c2b1-4e52-bab0-d6154ba7ea39 service nova] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:50.214285 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4673860c-b498-429f-bce7-3a975ae0d34a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:50.214916 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4673860c-b498-429f-bce7-3a975ae0d34a service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:50.215200 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4673860c-b498-429f-bce7-3a975ae0d34a service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:50.215499 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4673860c-b498-429f-bce7-3a975ae0d34a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:50.217259 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-4673860c-b498-429f-bce7-3a975ae0d34a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:14:50.239418 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4673860c-b498-429f-bce7-3a975ae0d34a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:50.240829 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4673860c-b498-429f-bce7-3a975ae0d34a service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:50.249560 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1263/2529] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:14:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:15:00.245200 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=15 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:14.352604 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa97240-c186-4804-8354-89fded598b00 service placement] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:14.354045 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-6aa97240-c186-4804-8354-89fded598b00 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:14.434976 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa97240-c186-4804-8354-89fded598b00 service placement] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:14.438610 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1babb6-bf7c-461a-a5f1-61c803145ad0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:14.439261 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1babb6-bf7c-461a-a5f1-61c803145ad0 service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:14.450000 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1babb6-bf7c-461a-a5f1-61c803145ad0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:14.450000 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1babb6-bf7c-461a-a5f1-61c803145ad0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:14.450000 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-5c1babb6-bf7c-461a-a5f1-61c803145ad0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:14.450347 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4673860c-b498-429f-bce7-3a975ae0d34a service neutron] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:14.450769 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-4673860c-b498-429f-bce7-3a975ae0d34a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:14.466893 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4673860c-b498-429f-bce7-3a975ae0d34a service neutron] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:14.471766 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0130516-988c-4e73-93f1-7dcccdffda04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:14.472430 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0130516-988c-4e73-93f1-7dcccdffda04 service cinder] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:14.472714 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0130516-988c-4e73-93f1-7dcccdffda04 service cinder] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:14.472991 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0130516-988c-4e73-93f1-7dcccdffda04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:14.475865 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-e0130516-988c-4e73-93f1-7dcccdffda04 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:14.530179 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1babb6-bf7c-461a-a5f1-61c803145ad0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:14.531522 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1babb6-bf7c-461a-a5f1-61c803145ad0 service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:14.540914 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1267/2530] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:16:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:16:14.556277 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0130516-988c-4e73-93f1-7dcccdffda04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:14.557760 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0130516-988c-4e73-93f1-7dcccdffda04 service cinder] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:14.567650 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1264/2531] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:16:14 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:16:24.536473 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=62 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:24.563203 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=33 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:36.635575 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1babb6-bf7c-461a-a5f1-61c803145ad0 service cinder] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:36.644490 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1babb6-bf7c-461a-a5f1-61c803145ad0 service cinder] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:36.648113 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a82c4-bbda-40e9-b069-e974ec62fb85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:36.648747 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a82c4-bbda-40e9-b069-e974ec62fb85 service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:36.649030 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a82c4-bbda-40e9-b069-e974ec62fb85 service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:36.649306 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a82c4-bbda-40e9-b069-e974ec62fb85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:36.651124 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-d40a82c4-bbda-40e9-b069-e974ec62fb85 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:36.709089 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40a82c4-bbda-40e9-b069-e974ec62fb85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:36.710661 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40a82c4-bbda-40e9-b069-e974ec62fb85 service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:36.719965 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1268/2532] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:16:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:16:46.715735 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=28 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:17:13.545461 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0130516-988c-4e73-93f1-7dcccdffda04 service cinder] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:17:13.555159 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0130516-988c-4e73-93f1-7dcccdffda04 service cinder] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:17:13.558951 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1bcec-0aec-43a0-a9a1-d4c5c3b228aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:17:13.559898 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1bcec-0aec-43a0-a9a1-d4c5c3b228aa service cinder] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:17:13.559898 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1bcec-0aec-43a0-a9a1-d4c5c3b228aa service cinder] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:17:13.560370 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1bcec-0aec-43a0-a9a1-d4c5c3b228aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:17:13.561966 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-3ef1bcec-0aec-43a0-a9a1-d4c5c3b228aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:17:13.634481 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef1bcec-0aec-43a0-a9a1-d4c5c3b228aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:17:13.636576 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef1bcec-0aec-43a0-a9a1-d4c5c3b228aa service cinder] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:17:13.646738 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1265/2533] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:17:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:17:23.641939 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=28 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:17:27.399013 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a82c4-bbda-40e9-b069-e974ec62fb85 service cinder] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:17:27.409353 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a82c4-bbda-40e9-b069-e974ec62fb85 service cinder] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:17:27.413877 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db19824-e0b7-4427-91e8-aaf22e6fdd60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:17:27.414659 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db19824-e0b7-4427-91e8-aaf22e6fdd60 service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:17:27.415035 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db19824-e0b7-4427-91e8-aaf22e6fdd60 service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:17:27.415418 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db19824-e0b7-4427-91e8-aaf22e6fdd60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:17:27.426585 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db19824-e0b7-4427-91e8-aaf22e6fdd60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:17:27.428700 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db19824-e0b7-4427-91e8-aaf22e6fdd60 service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:17:27.440693 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1269/2534] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:17:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:17:37.435214 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=6 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:17:50.431728 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1bcec-0aec-43a0-a9a1-d4c5c3b228aa service cinder] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:17:50.444275 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1bcec-0aec-43a0-a9a1-d4c5c3b228aa service cinder] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:17:50.449784 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a8f52f-97cf-4377-a9da-4f925703bd5c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec2627e3cdc94ec38d7cc3b1bc670ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:17:50.450482 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8f52f-97cf-4377-a9da-4f925703bd5c service placement] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:17:50.450776 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8f52f-97cf-4377-a9da-4f925703bd5c service placement] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:17:50.451059 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8f52f-97cf-4377-a9da-4f925703bd5c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:17:50.460423 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a8f52f-97cf-4377-a9da-4f925703bd5c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:17:50.462046 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a8f52f-97cf-4377-a9da-4f925703bd5c service placement] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:17:50.473767 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1266/2535] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:17:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:18:00.468742 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=6 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:19:55.151158 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db19824-e0b7-4427-91e8-aaf22e6fdd60 service cinder] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:19:55.160810 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db19824-e0b7-4427-91e8-aaf22e6fdd60 service cinder] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:19:55.165687 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a1aeb0-4937-4c2f-a2e5-7dee035c2058 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:19:55.166734 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1aeb0-4937-4c2f-a2e5-7dee035c2058 service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:19:55.167118 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1aeb0-4937-4c2f-a2e5-7dee035c2058 service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:19:55.167480 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1aeb0-4937-4c2f-a2e5-7dee035c2058 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:19:55.177724 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a1aeb0-4937-4c2f-a2e5-7dee035c2058 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:19:55.179237 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a1aeb0-4937-4c2f-a2e5-7dee035c2058 service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:19:55.189070 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1270/2536] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:19:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:20:05.184003 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=6 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:20:14.415924 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a8f52f-97cf-4377-a9da-4f925703bd5c service placement] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:20:14.417599 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-07a8f52f-97cf-4377-a9da-4f925703bd5c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:20:14.430919 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a8f52f-97cf-4377-a9da-4f925703bd5c service placement] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:20:14.435302 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea17395f-a789-43b5-acdb-54eeaf65dfb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:20:14.436194 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17395f-a789-43b5-acdb-54eeaf65dfb2 service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:20:14.436658 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17395f-a789-43b5-acdb-54eeaf65dfb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:20:14.437120 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17395f-a789-43b5-acdb-54eeaf65dfb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:20:14.439623 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-ea17395f-a789-43b5-acdb-54eeaf65dfb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:20:14.481155 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea17395f-a789-43b5-acdb-54eeaf65dfb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:20:14.482634 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea17395f-a789-43b5-acdb-54eeaf65dfb2 service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:20:14.514115 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1267/2537] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:20:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:20:14.629253 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a1aeb0-4937-4c2f-a2e5-7dee035c2058 service neutron] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:20:14.640216 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a1aeb0-4937-4c2f-a2e5-7dee035c2058 service neutron] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:20:14.647951 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea9480-de3f-48c6-97b3-2b8a125ff8a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:20:14.648828 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea9480-de3f-48c6-97b3-2b8a125ff8a6 service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:20:14.649335 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea9480-de3f-48c6-97b3-2b8a125ff8a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:20:14.649824 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea9480-de3f-48c6-97b3-2b8a125ff8a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:20:14.652056 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-c2ea9480-de3f-48c6-97b3-2b8a125ff8a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:20:14.666000 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ea9480-de3f-48c6-97b3-2b8a125ff8a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:20:14.667769 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ea9480-de3f-48c6-97b3-2b8a125ff8a6 service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:20:14.684481 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1271/2538] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:20:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:20:18.224092 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea17395f-a789-43b5-acdb-54eeaf65dfb2 service neutron] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:20:18.225657 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-ea17395f-a789-43b5-acdb-54eeaf65dfb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:20:18.297751 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea17395f-a789-43b5-acdb-54eeaf65dfb2 service neutron] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:20:18.306451 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed8eff-1869-4322-af29-fe93e033985b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec2627e3cdc94ec38d7cc3b1bc670ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:20:18.307496 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed8eff-1869-4322-af29-fe93e033985b service placement] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:20:18.307787 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed8eff-1869-4322-af29-fe93e033985b service placement] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:20:18.308071 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed8eff-1869-4322-af29-fe93e033985b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:20:18.311448 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-84ed8eff-1869-4322-af29-fe93e033985b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:20:18.331424 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea9480-de3f-48c6-97b3-2b8a125ff8a6 service neutron] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:20:18.333530 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-c2ea9480-de3f-48c6-97b3-2b8a125ff8a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:20:18.333887 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ed8eff-1869-4322-af29-fe93e033985b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:20:18.335603 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ed8eff-1869-4322-af29-fe93e033985b service placement] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:20:18.352597 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1268/2539] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:20:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:20:18.364878 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea9480-de3f-48c6-97b3-2b8a125ff8a6 service neutron] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:20:18.372164 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d18a92-e30d-4d41-98d5-6814d881d9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:20:18.373335 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d18a92-e30d-4d41-98d5-6814d881d9ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:20:18.373831 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d18a92-e30d-4d41-98d5-6814d881d9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:20:18.374448 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d18a92-e30d-4d41-98d5-6814d881d9ef admin admin] PATH_INFO: `/v3/users/0a2c3b8979a84abf933ab3228cdff26c` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:20:18.376144 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d18a92-e30d-4d41-98d5-6814d881d9ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a2c3b8979a84abf933ab3228cdff26c)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:20:18.378618 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d18a92-e30d-4d41-98d5-6814d881d9ef admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:20:18.467138 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-50d18a92-e30d-4d41-98d5-6814d881d9ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a2c3b8979a84abf933ab3228cdff26c'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:20:18.476557 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-50d18a92-e30d-4d41-98d5-6814d881d9ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a2c3b8979a84abf933ab3228cdff26c'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:20:18.477411 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-50d18a92-e30d-4d41-98d5-6814d881d9ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a2c3b8979a84abf933ab3228cdff26c'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:20:18.487352 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-50d18a92-e30d-4d41-98d5-6814d881d9ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a2c3b8979a84abf933ab3228cdff26c'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:20:18.489033 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-50d18a92-e30d-4d41-98d5-6814d881d9ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a2c3b8979a84abf933ab3228cdff26c'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:20:18.512495 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1272/2540] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 09:20:18 2022] DELETE /identity/v3/users/0a2c3b8979a84abf933ab3228cdff26c => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:20:18.609764 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed8eff-1869-4322-af29-fe93e033985b service placement] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:20:18.635829 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed8eff-1869-4322-af29-fe93e033985b service placement] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:20:18.740417 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef381e65-bd11-4020-b8a4-c5d90fdd6aa8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec2627e3cdc94ec38d7cc3b1bc670ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:20:18.741366 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef381e65-bd11-4020-b8a4-c5d90fdd6aa8 service placement] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:20:18.741857 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef381e65-bd11-4020-b8a4-c5d90fdd6aa8 service placement] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:20:18.742365 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef381e65-bd11-4020-b8a4-c5d90fdd6aa8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:20:18.745322 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-ef381e65-bd11-4020-b8a4-c5d90fdd6aa8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:20:18.761233 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef381e65-bd11-4020-b8a4-c5d90fdd6aa8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:20:18.765054 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef381e65-bd11-4020-b8a4-c5d90fdd6aa8 service placement] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:20:18.784091 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1269/2541] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:20:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:20:18.843243 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d18a92-e30d-4d41-98d5-6814d881d9ef admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:20:18.844845 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-50d18a92-e30d-4d41-98d5-6814d881d9ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:20:18.932946 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d18a92-e30d-4d41-98d5-6814d881d9ef admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:20:18.937830 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d95dd1-4da9-402e-8cff-3f63811822c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:20:18.938750 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d95dd1-4da9-402e-8cff-3f63811822c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:20:18.939041 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d95dd1-4da9-402e-8cff-3f63811822c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:20:18.939319 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d95dd1-4da9-402e-8cff-3f63811822c9 admin admin] PATH_INFO: `/v3/projects/7139670440a6411582ebc4c8a0500bce` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:20:18.952315 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d95dd1-4da9-402e-8cff-3f63811822c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7139670440a6411582ebc4c8a0500bce)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:20:18.954458 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d95dd1-4da9-402e-8cff-3f63811822c9 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:20:19.016647 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c9d95dd1-4da9-402e-8cff-3f63811822c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7139670440a6411582ebc4c8a0500bce', 'request_id': 'req-c9d95dd1-4da9-402e-8cff-3f63811822c9'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:20:19.020149 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:20:19.028759 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c9d95dd1-4da9-402e-8cff-3f63811822c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7139670440a6411582ebc4c8a0500bce', 'request_id': 'req-c9d95dd1-4da9-402e-8cff-3f63811822c9'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:20:19.039996 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c9d95dd1-4da9-402e-8cff-3f63811822c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7139670440a6411582ebc4c8a0500bce', 'request_id': 'req-c9d95dd1-4da9-402e-8cff-3f63811822c9'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:20:19.066992 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c9d95dd1-4da9-402e-8cff-3f63811822c9 admin admin] The token cache is being invalidate because project 7139670440a6411582ebc4c8a0500bce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:20:19.067289 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c9d95dd1-4da9-402e-8cff-3f63811822c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:20:19.067948 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-c9d95dd1-4da9-402e-8cff-3f63811822c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:20:19.069524 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1273/2542] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 09:20:18 2022] DELETE /identity/v3/projects/7139670440a6411582ebc4c8a0500bce => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:20:19.075985 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da563fd-5b36-4b02-a7a0-69178ea7084a None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:20:19.076280 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da563fd-5b36-4b02-a7a0-69178ea7084a None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:20:19.076565 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da563fd-5b36-4b02-a7a0-69178ea7084a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:20:19.107561 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-7da563fd-5b36-4b02-a7a0-69178ea7084a None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:20:19.108784 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-7da563fd-5b36-4b02-a7a0-69178ea7084a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:20:19.179438 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1270/2543] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:20:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:20:19.187153 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0297f-2b5d-4fa7-b2d9-04d3c7557cfa None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:20:19.187452 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0297f-2b5d-4fa7-b2d9-04d3c7557cfa None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:20:19.187756 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0297f-2b5d-4fa7-b2d9-04d3c7557cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:20:19.207453 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-aeb0297f-2b5d-4fa7-b2d9-04d3c7557cfa None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:20:19.208734 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-aeb0297f-2b5d-4fa7-b2d9-04d3c7557cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:20:19.217365 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1274/2544] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:20:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:20:19.221634 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da563fd-5b36-4b02-a7a0-69178ea7084a None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:20:19.233299 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da563fd-5b36-4b02-a7a0-69178ea7084a None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:20:19.238019 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0545a6f0-87ad-41c8-9958-3eead9b76e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:20:19.238728 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545a6f0-87ad-41c8-9958-3eead9b76e68 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:20:19.239015 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545a6f0-87ad-41c8-9958-3eead9b76e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:20:19.239290 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545a6f0-87ad-41c8-9958-3eead9b76e68 admin admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:20:19.240027 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0545a6f0-87ad-41c8-9958-3eead9b76e68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:20:19.240336 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0545a6f0-87ad-41c8-9958-3eead9b76e68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:20:19.241982 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0545a6f0-87ad-41c8-9958-3eead9b76e68 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:20:19.258802 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1271/2545] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Jun 22 09:20:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:20:19.263033 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb0297f-2b5d-4fa7-b2d9-04d3c7557cfa None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:20:19.273330 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb0297f-2b5d-4fa7-b2d9-04d3c7557cfa None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:20:19.278031 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee60f029-b4cc-4165-8829-6b139e951ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:20:19.278725 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60f029-b4cc-4165-8829-6b139e951ea7 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:20:19.279009 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60f029-b4cc-4165-8829-6b139e951ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:20:19.279280 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60f029-b4cc-4165-8829-6b139e951ea7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:20:19.280021 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee60f029-b4cc-4165-8829-6b139e951ea7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:20:19.281945 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee60f029-b4cc-4165-8829-6b139e951ea7 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:20:19.315284 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1275/2546] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 09:20:19 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:20:19.317610 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0545a6f0-87ad-41c8-9958-3eead9b76e68 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:20:19.324243 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:20:19.328539 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0545a6f0-87ad-41c8-9958-3eead9b76e68 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:20:19.390367 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b08bdc8-c5ae-4829-bb72-10d4e8b573db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:20:19.391063 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08bdc8-c5ae-4829-bb72-10d4e8b573db admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:20:19.391336 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08bdc8-c5ae-4829-bb72-10d4e8b573db admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:20:19.391616 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08bdc8-c5ae-4829-bb72-10d4e8b573db admin admin] PATH_INFO: `/v3/users` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:20:19.392328 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b08bdc8-c5ae-4829-bb72-10d4e8b573db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:20:19.394297 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b08bdc8-c5ae-4829-bb72-10d4e8b573db admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:20:19.415714 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1272/2547] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 09:20:19 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:20:19.419674 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee60f029-b4cc-4165-8829-6b139e951ea7 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:20:19.431196 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee60f029-b4cc-4165-8829-6b139e951ea7 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:20:19.436124 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a6696e-8a7f-41fd-a216-ab65ab12f06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:20:19.436788 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a6696e-8a7f-41fd-a216-ab65ab12f06c admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:20:19.437070 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a6696e-8a7f-41fd-a216-ab65ab12f06c admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:20:19.437342 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a6696e-8a7f-41fd-a216-ab65ab12f06c admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:20:19.438093 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a6696e-8a7f-41fd-a216-ab65ab12f06c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:20:19.440406 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a6696e-8a7f-41fd-a216-ab65ab12f06c admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:20:19.453599 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1276/2548] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 09:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:20:19.454581 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b08bdc8-c5ae-4829-bb72-10d4e8b573db admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:20:19.464597 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b08bdc8-c5ae-4829-bb72-10d4e8b573db admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:20:19.469268 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e2d9c-ed13-483b-8814-7cde549e8036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:20:19.469928 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e2d9c-ed13-483b-8814-7cde549e8036 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:20:19.470245 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e2d9c-ed13-483b-8814-7cde549e8036 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:20:19.470520 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e2d9c-ed13-483b-8814-7cde549e8036 admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:20:19.471248 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285e2d9c-ed13-483b-8814-7cde549e8036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:20:19.473358 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285e2d9c-ed13-483b-8814-7cde549e8036 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:20:19.483814 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1273/2549] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 09:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:20:19.489175 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a6696e-8a7f-41fd-a216-ab65ab12f06c admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:20:19.502308 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a6696e-8a7f-41fd-a216-ab65ab12f06c admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:20:19.507360 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb39fc32-fcb2-4368-910e-68a04e1ee2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:20:19.508259 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb39fc32-fcb2-4368-910e-68a04e1ee2d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:20:19.508540 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb39fc32-fcb2-4368-910e-68a04e1ee2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:20:19.508814 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb39fc32-fcb2-4368-910e-68a04e1ee2d3 admin admin] PATH_INFO: `/v3/projects/b5cd2ccdb8454f328b2ba9e9ce36a804/users/742ffa61f3504e0c88ef5ed07f2f9d8b/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:20:19.526738 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb39fc32-fcb2-4368-910e-68a04e1ee2d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5cd2ccdb8454f328b2ba9e9ce36a804, user_id=742ffa61f3504e0c88ef5ed07f2f9d8b, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:20:19.529438 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb39fc32-fcb2-4368-910e-68a04e1ee2d3 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:20:19.543855 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1277/2550] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 09:20:19 2022] PUT /identity/v3/projects/b5cd2ccdb8454f328b2ba9e9ce36a804/users/742ffa61f3504e0c88ef5ed07f2f9d8b/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:20:19.555525 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1341a8-4ec0-412e-b477-1f8785946699 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:20:19.555814 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1341a8-4ec0-412e-b477-1f8785946699 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:20:19.556098 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1341a8-4ec0-412e-b477-1f8785946699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:20:19.583345 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-7e1341a8-4ec0-412e-b477-1f8785946699 None None] MFA Rules not processed for user `742ffa61f3504e0c88ef5ed07f2f9d8b`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:20:19.584586 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-7e1341a8-4ec0-412e-b477-1f8785946699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:20:19.656683 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1274/2551] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:20:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:20:19.670585 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb39fc32-fcb2-4368-910e-68a04e1ee2d3 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:20:19.672941 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-eb39fc32-fcb2-4368-910e-68a04e1ee2d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:20:19.819191 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb39fc32-fcb2-4368-910e-68a04e1ee2d3 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:20:19.825119 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d672ac8c-e1f7-40c5-a401-e1c00a9c7642 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f1809a35b244c1db7a185d82859369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:20:19.825799 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d672ac8c-e1f7-40c5-a401-e1c00a9c7642 service nova] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:20:19.826110 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d672ac8c-e1f7-40c5-a401-e1c00a9c7642 service nova] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:20:19.826413 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d672ac8c-e1f7-40c5-a401-e1c00a9c7642 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:20:19.837000 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d672ac8c-e1f7-40c5-a401-e1c00a9c7642 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:20:19.838661 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d672ac8c-e1f7-40c5-a401-e1c00a9c7642 service nova] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:20:19.849923 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1278/2552] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:20:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:20:19.872063 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1341a8-4ec0-412e-b477-1f8785946699 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:20:19.873635 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-7e1341a8-4ec0-412e-b477-1f8785946699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:20:19.941771 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1341a8-4ec0-412e-b477-1f8785946699 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:20:19.945496 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a9ad42-fea7-4aa4-a87b-c98d059f7cd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:20:19.946175 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a9ad42-fea7-4aa4-a87b-c98d059f7cd1 service cinder] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:20:19.946466 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a9ad42-fea7-4aa4-a87b-c98d059f7cd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:20:19.946743 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a9ad42-fea7-4aa4-a87b-c98d059f7cd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:20:19.948621 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-f4a9ad42-fea7-4aa4-a87b-c98d059f7cd1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:20:19.962948 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a9ad42-fea7-4aa4-a87b-c98d059f7cd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:20:19.964317 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a9ad42-fea7-4aa4-a87b-c98d059f7cd1 service cinder] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:20:19.976943 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1275/2553] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:20:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:20:20.438032 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d672ac8c-e1f7-40c5-a401-e1c00a9c7642 service nova] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:20:20.449887 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d672ac8c-e1f7-40c5-a401-e1c00a9c7642 service nova] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:20:20.453897 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a85173c-26f2-40fe-9027-673abec47cb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:20:20.454580 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85173c-26f2-40fe-9027-673abec47cb7 service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:20:20.454864 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85173c-26f2-40fe-9027-673abec47cb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:20:20.455140 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85173c-26f2-40fe-9027-673abec47cb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:20:20.457757 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-7a85173c-26f2-40fe-9027-673abec47cb7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:20:20.472296 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a85173c-26f2-40fe-9027-673abec47cb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:20:20.474012 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a85173c-26f2-40fe-9027-673abec47cb7 service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:20:20.485711 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1279/2554] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:20:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:20:22.060619 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a9ad42-fea7-4aa4-a87b-c98d059f7cd1 service cinder] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:20:22.062062 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-f4a9ad42-fea7-4aa4-a87b-c98d059f7cd1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:20:22.081219 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:20:22.130294 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a9ad42-fea7-4aa4-a87b-c98d059f7cd1 service cinder] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:20:22.134785 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d712140-a888-4a71-9861-f6046dc40e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:20:22.135647 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d712140-a888-4a71-9861-f6046dc40e2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:20:22.135925 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d712140-a888-4a71-9861-f6046dc40e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:20:22.136195 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d712140-a888-4a71-9861-f6046dc40e2b admin admin] PATH_INFO: `/v3/users/c9c9ad4b291147e2bc7c935e8e940e88` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:20:22.137376 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d712140-a888-4a71-9861-f6046dc40e2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9c9ad4b291147e2bc7c935e8e940e88)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:20:22.139319 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d712140-a888-4a71-9861-f6046dc40e2b admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:20:22.185717 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-6d712140-a888-4a71-9861-f6046dc40e2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9c9ad4b291147e2bc7c935e8e940e88'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:20:22.192918 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-6d712140-a888-4a71-9861-f6046dc40e2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9c9ad4b291147e2bc7c935e8e940e88'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:20:22.193587 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-6d712140-a888-4a71-9861-f6046dc40e2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9c9ad4b291147e2bc7c935e8e940e88'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:20:22.200156 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-6d712140-a888-4a71-9861-f6046dc40e2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9c9ad4b291147e2bc7c935e8e940e88'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:20:22.200829 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-6d712140-a888-4a71-9861-f6046dc40e2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9c9ad4b291147e2bc7c935e8e940e88'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:20:22.217894 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1276/2555] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 09:20:22 2022] DELETE /identity/v3/users/c9c9ad4b291147e2bc7c935e8e940e88 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:20:22.393232 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a85173c-26f2-40fe-9027-673abec47cb7 service cinder] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:20:22.404407 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a85173c-26f2-40fe-9027-673abec47cb7 service cinder] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:20:22.427651 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:20:22.469161 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a0b54f-aac6-4de7-880e-ca1c6c769924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:20:22.470032 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a0b54f-aac6-4de7-880e-ca1c6c769924 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:20:22.470350 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a0b54f-aac6-4de7-880e-ca1c6c769924 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:20:22.470629 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a0b54f-aac6-4de7-880e-ca1c6c769924 admin admin] PATH_INFO: `/v3/projects/f85f3f82b3ad4a1c81dd2c39bcbe9f71` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:20:22.471821 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a0b54f-aac6-4de7-880e-ca1c6c769924 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f85f3f82b3ad4a1c81dd2c39bcbe9f71)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:20:22.473883 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a0b54f-aac6-4de7-880e-ca1c6c769924 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:20:22.521934 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-b5a0b54f-aac6-4de7-880e-ca1c6c769924 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f85f3f82b3ad4a1c81dd2c39bcbe9f71', 'request_id': 'req-b5a0b54f-aac6-4de7-880e-ca1c6c769924'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:20:22.527439 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-b5a0b54f-aac6-4de7-880e-ca1c6c769924 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f85f3f82b3ad4a1c81dd2c39bcbe9f71', 'request_id': 'req-b5a0b54f-aac6-4de7-880e-ca1c6c769924'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:20:22.533593 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-b5a0b54f-aac6-4de7-880e-ca1c6c769924 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f85f3f82b3ad4a1c81dd2c39bcbe9f71', 'request_id': 'req-b5a0b54f-aac6-4de7-880e-ca1c6c769924'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:20:22.545556 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-b5a0b54f-aac6-4de7-880e-ca1c6c769924 admin admin] The token cache is being invalidate because project f85f3f82b3ad4a1c81dd2c39bcbe9f71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:20:22.545843 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-b5a0b54f-aac6-4de7-880e-ca1c6c769924 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:20:22.546483 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-b5a0b54f-aac6-4de7-880e-ca1c6c769924 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:20:22.548012 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1280/2556] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 09:20:22 2022] DELETE /identity/v3/projects/f85f3f82b3ad4a1c81dd2c39bcbe9f71 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:20:22.552544 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d712140-a888-4a71-9861-f6046dc40e2b admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:20:22.554098 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-6d712140-a888-4a71-9861-f6046dc40e2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:20:22.568139 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d712140-a888-4a71-9861-f6046dc40e2b admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:20:22.625458 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f9388-b80e-45e1-9286-2a6cbe7da88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:20:22.626351 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f9388-b80e-45e1-9286-2a6cbe7da88b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:20:22.626634 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f9388-b80e-45e1-9286-2a6cbe7da88b admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:20:22.626909 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f9388-b80e-45e1-9286-2a6cbe7da88b admin admin] PATH_INFO: `/v3/users/3a5a5dd4019e48d6a0abff35921e2d48` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:20:22.628385 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780f9388-b80e-45e1-9286-2a6cbe7da88b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a5a5dd4019e48d6a0abff35921e2d48)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:20:22.630661 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780f9388-b80e-45e1-9286-2a6cbe7da88b admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:20:22.672632 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:20:22.682858 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-780f9388-b80e-45e1-9286-2a6cbe7da88b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a5a5dd4019e48d6a0abff35921e2d48'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:20:22.698754 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-780f9388-b80e-45e1-9286-2a6cbe7da88b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a5a5dd4019e48d6a0abff35921e2d48'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:20:22.699470 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-780f9388-b80e-45e1-9286-2a6cbe7da88b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a5a5dd4019e48d6a0abff35921e2d48'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:20:22.707266 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-780f9388-b80e-45e1-9286-2a6cbe7da88b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a5a5dd4019e48d6a0abff35921e2d48'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:20:22.707893 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-780f9388-b80e-45e1-9286-2a6cbe7da88b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a5a5dd4019e48d6a0abff35921e2d48'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:20:22.724816 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1277/2557] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 09:20:22 2022] DELETE /identity/v3/users/3a5a5dd4019e48d6a0abff35921e2d48 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:20:22.905802 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a0b54f-aac6-4de7-880e-ca1c6c769924 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:20:22.907331 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-b5a0b54f-aac6-4de7-880e-ca1c6c769924 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:20:22.920611 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a0b54f-aac6-4de7-880e-ca1c6c769924 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:20:22.977305 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a7215-fa16-48a8-a793-562a37f730e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:20:22.978204 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a7215-fa16-48a8-a793-562a37f730e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:20:22.978493 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a7215-fa16-48a8-a793-562a37f730e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:20:22.978777 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a7215-fa16-48a8-a793-562a37f730e5 admin admin] PATH_INFO: `/v3/projects/20d954a44fd7438b8396b0875bf604e5` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:20:22.979962 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23a7215-fa16-48a8-a793-562a37f730e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20d954a44fd7438b8396b0875bf604e5)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:20:22.981875 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23a7215-fa16-48a8-a793-562a37f730e5 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:20:23.028484 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-b23a7215-fa16-48a8-a793-562a37f730e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20d954a44fd7438b8396b0875bf604e5', 'request_id': 'req-b23a7215-fa16-48a8-a793-562a37f730e5'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:20:23.032425 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:20:23.036150 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-b23a7215-fa16-48a8-a793-562a37f730e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20d954a44fd7438b8396b0875bf604e5', 'request_id': 'req-b23a7215-fa16-48a8-a793-562a37f730e5'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:20:23.044375 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-b23a7215-fa16-48a8-a793-562a37f730e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20d954a44fd7438b8396b0875bf604e5', 'request_id': 'req-b23a7215-fa16-48a8-a793-562a37f730e5'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:20:23.057007 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-b23a7215-fa16-48a8-a793-562a37f730e5 admin admin] The token cache is being invalidate because project 20d954a44fd7438b8396b0875bf604e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:20:23.057290 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-b23a7215-fa16-48a8-a793-562a37f730e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:20:23.057897 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-b23a7215-fa16-48a8-a793-562a37f730e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:20:23.059488 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1281/2558] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 09:20:22 2022] DELETE /identity/v3/projects/20d954a44fd7438b8396b0875bf604e5 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:20:32.721306 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=15,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:20:33.054061 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:DELETE=2,keystone:SELECT=5,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:21:14.984701 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f9388-b80e-45e1-9286-2a6cbe7da88b admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:21:14.987332 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-780f9388-b80e-45e1-9286-2a6cbe7da88b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:21:15.066424 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f9388-b80e-45e1-9286-2a6cbe7da88b admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:21:15.122591 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb7317-f810-4c82-bae1-409b28570158 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:21:15.123243 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb7317-f810-4c82-bae1-409b28570158 service cinder] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:21:15.123528 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb7317-f810-4c82-bae1-409b28570158 service cinder] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:21:15.123806 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb7317-f810-4c82-bae1-409b28570158 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:21:15.125600 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-6ceb7317-f810-4c82-bae1-409b28570158 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:21:15.196158 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceb7317-f810-4c82-bae1-409b28570158 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:21:15.197479 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceb7317-f810-4c82-bae1-409b28570158 service cinder] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:21:15.216897 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1278/2559] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:21:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:21:25.214292 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=76 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:22:14.298105 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a7215-fa16-48a8-a793-562a37f730e5 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:22:14.300511 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-b23a7215-fa16-48a8-a793-562a37f730e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:22:14.325272 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a7215-fa16-48a8-a793-562a37f730e5 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:22:14.329735 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f3fd0-3dcc-4c04-b142-092bbdf8dd01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:22:14.330466 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f3fd0-3dcc-4c04-b142-092bbdf8dd01 service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:22:14.330755 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f3fd0-3dcc-4c04-b142-092bbdf8dd01 service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:22:14.331033 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f3fd0-3dcc-4c04-b142-092bbdf8dd01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:22:14.333404 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-781f3fd0-3dcc-4c04-b142-092bbdf8dd01 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:22:14.426831 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781f3fd0-3dcc-4c04-b142-092bbdf8dd01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:22:14.428288 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781f3fd0-3dcc-4c04-b142-092bbdf8dd01 service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:22:14.447235 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1282/2560] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:22:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:22:17.054824 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb7317-f810-4c82-bae1-409b28570158 service cinder] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:22:17.057061 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-6ceb7317-f810-4c82-bae1-409b28570158 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:22:17.209656 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb7317-f810-4c82-bae1-409b28570158 service cinder] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:22:17.226389 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aff195b-712f-4896-9b13-8327a50bc942 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f1809a35b244c1db7a185d82859369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:22:17.230012 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff195b-712f-4896-9b13-8327a50bc942 service nova] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:22:17.230367 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff195b-712f-4896-9b13-8327a50bc942 service nova] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:22:17.230655 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff195b-712f-4896-9b13-8327a50bc942 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:22:17.233436 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-8aff195b-712f-4896-9b13-8327a50bc942 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:22:17.259932 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aff195b-712f-4896-9b13-8327a50bc942 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:22:17.263743 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aff195b-712f-4896-9b13-8327a50bc942 service nova] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:22:17.277547 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1279/2561] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:22:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:22:17.918214 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f3fd0-3dcc-4c04-b142-092bbdf8dd01 service cinder] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:22:17.920889 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-781f3fd0-3dcc-4c04-b142-092bbdf8dd01 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:22:17.965841 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aff195b-712f-4896-9b13-8327a50bc942 service nova] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:22:17.967744 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-8aff195b-712f-4896-9b13-8327a50bc942 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:22:18.052187 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f3fd0-3dcc-4c04-b142-092bbdf8dd01 service cinder] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:22:18.057193 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c91ffdc-15de-49e1-94cb-4b47d6170a0b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589eb8cc97714580840ac7a48ea38ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:22:18.058418 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c91ffdc-15de-49e1-94cb-4b47d6170a0b service glance] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:22:18.058996 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c91ffdc-15de-49e1-94cb-4b47d6170a0b service glance] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:22:18.059470 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c91ffdc-15de-49e1-94cb-4b47d6170a0b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:22:18.061610 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-1c91ffdc-15de-49e1-94cb-4b47d6170a0b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:22:18.080110 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application [None req-1c91ffdc-15de-49e1-94cb-4b47d6170a0b service glance] Could not find project: a66fa21fe9894cc0833c10ba15418e93.: keystone.exception.ProjectNotFound: Could not find project: a66fa21fe9894cc0833c10ba15418e93. Jun 22 09:22:18.080110 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:22:18.080110 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:22:18.080110 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:22:18.080110 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:22:18.080110 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:22:18.080110 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:22:18.080110 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:22:18.080110 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:22:18.080110 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:22:18.080110 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:22:18.080110 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:22:18.080110 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Jun 22 09:22:18.080110 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Jun 22 09:22:18.080110 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Jun 22 09:22:18.081105 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Jun 22 09:22:18.081105 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Jun 22 09:22:18.081105 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Jun 22 09:22:18.081105 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:22:18.081105 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:22:18.081105 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 145, in validate_token Jun 22 09:22:18.081105 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application token = self._validate_token(token_id) Jun 22 09:22:18.081105 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:22:18.081105 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:22:18.081105 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:22:18.081105 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:22:18.081105 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:22:18.081105 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 09:22:18.081105 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:22:18.081105 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:22:18.081105 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:22:18.081105 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:22:18.082028 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:22:18.082028 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:22:18.082028 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:22:18.082028 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:22:18.082028 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 179, in _validate_token Jun 22 09:22:18.082028 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application token.mint(token_id, issued_at) Jun 22 09:22:18.082028 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 579, in mint Jun 22 09:22:18.082028 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application self._validate_token_resources() Jun 22 09:22:18.082028 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 464, in _validate_token_resources Jun 22 09:22:18.082028 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application if self.project and not self.project.get('enabled'): Jun 22 09:22:18.082028 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 162, in project Jun 22 09:22:18.082028 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application self.__project = PROVIDERS.resource_api.get_project( Jun 22 09:22:18.082028 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:22:18.082028 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:22:18.082028 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:22:18.082028 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:22:18.082028 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:22:18.083265 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:22:18.083265 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:22:18.083265 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application with Lock( Jun 22 09:22:18.083265 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:22:18.083265 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:22:18.083265 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:22:18.083265 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:22:18.083265 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:22:18.083265 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:22:18.083265 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:22:18.083265 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:22:18.083265 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 09:22:18.083265 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 09:22:18.083265 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 09:22:18.083265 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 09:22:18.083265 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 09:22:18.083265 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 09:22:18.084302 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: a66fa21fe9894cc0833c10ba15418e93. Jun 22 09:22:18.084302 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: ERROR keystone.server.flask.application Jun 22 09:22:18.086601 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1283/2562] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:22:17 2022] GET /identity/v3/auth/tokens => generated 113 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 22 09:22:18.087811 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aff195b-712f-4896-9b13-8327a50bc942 service nova] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:22:18.096287 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c007778-ab9a-4cc2-bbd5-b27485c77a59 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589eb8cc97714580840ac7a48ea38ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:22:18.096971 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c007778-ab9a-4cc2-bbd5-b27485c77a59 service glance] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:22:18.097253 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c007778-ab9a-4cc2-bbd5-b27485c77a59 service glance] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:22:18.097528 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c007778-ab9a-4cc2-bbd5-b27485c77a59 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:22:18.099480 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-2c007778-ab9a-4cc2-bbd5-b27485c77a59 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:22:18.135451 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application [None req-2c007778-ab9a-4cc2-bbd5-b27485c77a59 service glance] Could not find project: f85f3f82b3ad4a1c81dd2c39bcbe9f71.: keystone.exception.ProjectNotFound: Could not find project: f85f3f82b3ad4a1c81dd2c39bcbe9f71. Jun 22 09:22:18.135451 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:22:18.135451 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:22:18.135451 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:22:18.135451 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:22:18.135451 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:22:18.135451 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:22:18.135451 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:22:18.135451 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:22:18.135451 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:22:18.135451 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:22:18.135451 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:22:18.135451 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Jun 22 09:22:18.135451 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Jun 22 09:22:18.135451 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Jun 22 09:22:18.136347 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Jun 22 09:22:18.136347 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Jun 22 09:22:18.136347 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Jun 22 09:22:18.136347 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:22:18.136347 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:22:18.136347 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 145, in validate_token Jun 22 09:22:18.136347 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application token = self._validate_token(token_id) Jun 22 09:22:18.136347 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:22:18.136347 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:22:18.136347 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:22:18.136347 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:22:18.136347 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:22:18.136347 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 09:22:18.136347 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:22:18.136347 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:22:18.136347 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:22:18.136347 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:22:18.137220 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:22:18.137220 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:22:18.137220 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:22:18.137220 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:22:18.137220 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 179, in _validate_token Jun 22 09:22:18.137220 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application token.mint(token_id, issued_at) Jun 22 09:22:18.137220 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 579, in mint Jun 22 09:22:18.137220 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application self._validate_token_resources() Jun 22 09:22:18.137220 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 464, in _validate_token_resources Jun 22 09:22:18.137220 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application if self.project and not self.project.get('enabled'): Jun 22 09:22:18.137220 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 162, in project Jun 22 09:22:18.137220 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application self.__project = PROVIDERS.resource_api.get_project( Jun 22 09:22:18.137220 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:22:18.137220 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:22:18.137220 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:22:18.137220 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:22:18.137220 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:22:18.138610 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:22:18.138610 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:22:18.138610 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application with Lock( Jun 22 09:22:18.138610 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:22:18.138610 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:22:18.138610 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:22:18.138610 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:22:18.138610 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:22:18.138610 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:22:18.138610 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:22:18.138610 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:22:18.138610 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 09:22:18.138610 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 09:22:18.138610 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 09:22:18.138610 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 09:22:18.138610 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 09:22:18.138610 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 09:22:18.140197 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: f85f3f82b3ad4a1c81dd2c39bcbe9f71. Jun 22 09:22:18.140197 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: ERROR keystone.server.flask.application Jun 22 09:22:18.140197 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1280/2563] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:22:17 2022] GET /identity/v3/auth/tokens => generated 113 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 22 09:22:20.313749 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab620cf-79a6-4580-9dbc-1f461b08ef5b None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:22:20.314281 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab620cf-79a6-4580-9dbc-1f461b08ef5b None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:22:20.314386 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab620cf-79a6-4580-9dbc-1f461b08ef5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:22:20.333019 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-aab620cf-79a6-4580-9dbc-1f461b08ef5b None None] MFA Rules not processed for user `a19792e478a748268d63974aeed96b3a`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:22:20.334277 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-aab620cf-79a6-4580-9dbc-1f461b08ef5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:22:20.384968 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=100 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:22:20.398051 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1284/2564] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:22:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:22:20.705465 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c007778-ab9a-4cc2-bbd5-b27485c77a59 service glance] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:22:20.706851 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-2c007778-ab9a-4cc2-bbd5-b27485c77a59 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:22:20.773713 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c007778-ab9a-4cc2-bbd5-b27485c77a59 service glance] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:22:20.777303 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c99089-2413-4bbc-b569-2ac7e574cdd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:22:20.777966 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c99089-2413-4bbc-b569-2ac7e574cdd5 service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:22:20.778255 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c99089-2413-4bbc-b569-2ac7e574cdd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:22:20.778530 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c99089-2413-4bbc-b569-2ac7e574cdd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:22:20.780295 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-53c99089-2413-4bbc-b569-2ac7e574cdd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:22:20.790556 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c99089-2413-4bbc-b569-2ac7e574cdd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:22:20.791975 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c99089-2413-4bbc-b569-2ac7e574cdd5 service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:22:20.801116 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1281/2565] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:22:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:22:21.426601 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab620cf-79a6-4580-9dbc-1f461b08ef5b None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:22:21.428165 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-aab620cf-79a6-4580-9dbc-1f461b08ef5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:22:21.513000 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab620cf-79a6-4580-9dbc-1f461b08ef5b None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:22:21.517902 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada1e6db-d580-442a-9659-951b0bd0c264 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec2627e3cdc94ec38d7cc3b1bc670ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:22:21.518602 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1e6db-d580-442a-9659-951b0bd0c264 service placement] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:22:21.518888 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1e6db-d580-442a-9659-951b0bd0c264 service placement] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:22:21.519143 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1e6db-d580-442a-9659-951b0bd0c264 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:22:21.521213 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-ada1e6db-d580-442a-9659-951b0bd0c264 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:22:21.534097 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada1e6db-d580-442a-9659-951b0bd0c264 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:22:21.536037 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada1e6db-d580-442a-9659-951b0bd0c264 service placement] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:22:21.547346 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1285/2566] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:22:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:22:26.692529 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c99089-2413-4bbc-b569-2ac7e574cdd5 service neutron] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:22:26.693932 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-53c99089-2413-4bbc-b569-2ac7e574cdd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:22:26.732030 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:22:26.774934 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c99089-2413-4bbc-b569-2ac7e574cdd5 service neutron] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:22:26.780129 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44146181-afaa-487d-9a57-d0d2a1b1aff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:22:26.781001 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44146181-afaa-487d-9a57-d0d2a1b1aff3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:22:26.781286 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44146181-afaa-487d-9a57-d0d2a1b1aff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:22:26.781558 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44146181-afaa-487d-9a57-d0d2a1b1aff3 admin admin] PATH_INFO: `/v3/users/742ffa61f3504e0c88ef5ed07f2f9d8b` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:22:26.782835 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44146181-afaa-487d-9a57-d0d2a1b1aff3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=742ffa61f3504e0c88ef5ed07f2f9d8b)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:22:26.784752 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44146181-afaa-487d-9a57-d0d2a1b1aff3 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:22:26.838272 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-44146181-afaa-487d-9a57-d0d2a1b1aff3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '742ffa61f3504e0c88ef5ed07f2f9d8b'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:22:26.845898 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-44146181-afaa-487d-9a57-d0d2a1b1aff3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '742ffa61f3504e0c88ef5ed07f2f9d8b'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:22:26.848481 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-44146181-afaa-487d-9a57-d0d2a1b1aff3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '742ffa61f3504e0c88ef5ed07f2f9d8b'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:22:26.854669 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-44146181-afaa-487d-9a57-d0d2a1b1aff3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '742ffa61f3504e0c88ef5ed07f2f9d8b'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:22:26.855282 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-44146181-afaa-487d-9a57-d0d2a1b1aff3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '742ffa61f3504e0c88ef5ed07f2f9d8b'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:22:26.875574 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1282/2567] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 09:22:26 2022] DELETE /identity/v3/users/742ffa61f3504e0c88ef5ed07f2f9d8b => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:22:26.880842 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7608f-a8e9-48ab-9779-56d3e8b0ba34 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:22:26.881339 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7608f-a8e9-48ab-9779-56d3e8b0ba34 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:22:26.881449 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7608f-a8e9-48ab-9779-56d3e8b0ba34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:22:26.899797 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-68f7608f-a8e9-48ab-9779-56d3e8b0ba34 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:22:26.901040 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-68f7608f-a8e9-48ab-9779-56d3e8b0ba34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:22:26.969942 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1286/2568] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:22:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:22:26.979653 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44146181-afaa-487d-9a57-d0d2a1b1aff3 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:22:26.981107 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-44146181-afaa-487d-9a57-d0d2a1b1aff3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:22:27.045586 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44146181-afaa-487d-9a57-d0d2a1b1aff3 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:22:27.049356 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b807a65a-6b7e-40cf-b22f-5bdbf4b74c21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:22:27.050017 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807a65a-6b7e-40cf-b22f-5bdbf4b74c21 service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:22:27.050330 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807a65a-6b7e-40cf-b22f-5bdbf4b74c21 service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:22:27.050620 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807a65a-6b7e-40cf-b22f-5bdbf4b74c21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:22:27.061339 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b807a65a-6b7e-40cf-b22f-5bdbf4b74c21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:22:27.062888 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b807a65a-6b7e-40cf-b22f-5bdbf4b74c21 service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:22:27.075212 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1283/2569] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:22:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:22:27.428697 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f7608f-a8e9-48ab-9779-56d3e8b0ba34 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:22:27.432666 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-68f7608f-a8e9-48ab-9779-56d3e8b0ba34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:22:27.453843 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f7608f-a8e9-48ab-9779-56d3e8b0ba34 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:22:27.459469 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e584063e-e7a3-4cb5-ba6a-71fd7c9da5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:22:27.460673 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584063e-e7a3-4cb5-ba6a-71fd7c9da5f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:22:27.461346 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584063e-e7a3-4cb5-ba6a-71fd7c9da5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:22:27.461922 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584063e-e7a3-4cb5-ba6a-71fd7c9da5f0 admin admin] PATH_INFO: `/v3/projects/b5cd2ccdb8454f328b2ba9e9ce36a804` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:22:27.463524 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e584063e-e7a3-4cb5-ba6a-71fd7c9da5f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5cd2ccdb8454f328b2ba9e9ce36a804)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:22:27.465632 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e584063e-e7a3-4cb5-ba6a-71fd7c9da5f0 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:22:27.531451 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-e584063e-e7a3-4cb5-ba6a-71fd7c9da5f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5cd2ccdb8454f328b2ba9e9ce36a804', 'request_id': 'req-e584063e-e7a3-4cb5-ba6a-71fd7c9da5f0'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:22:27.538192 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-e584063e-e7a3-4cb5-ba6a-71fd7c9da5f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5cd2ccdb8454f328b2ba9e9ce36a804', 'request_id': 'req-e584063e-e7a3-4cb5-ba6a-71fd7c9da5f0'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:22:27.545482 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-e584063e-e7a3-4cb5-ba6a-71fd7c9da5f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5cd2ccdb8454f328b2ba9e9ce36a804', 'request_id': 'req-e584063e-e7a3-4cb5-ba6a-71fd7c9da5f0'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:22:27.561877 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-e584063e-e7a3-4cb5-ba6a-71fd7c9da5f0 admin admin] The token cache is being invalidate because project b5cd2ccdb8454f328b2ba9e9ce36a804 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:22:27.562200 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-e584063e-e7a3-4cb5-ba6a-71fd7c9da5f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:22:27.563002 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-e584063e-e7a3-4cb5-ba6a-71fd7c9da5f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:22:27.564637 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1287/2570] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 09:22:27 2022] DELETE /identity/v3/projects/b5cd2ccdb8454f328b2ba9e9ce36a804 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:22:27.569698 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ffa5d0-aa2a-467f-8a02-970a9615f38d None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:22:27.570145 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ffa5d0-aa2a-467f-8a02-970a9615f38d None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:22:27.570538 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ffa5d0-aa2a-467f-8a02-970a9615f38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:22:27.632448 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-95ffa5d0-aa2a-467f-8a02-970a9615f38d None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:22:27.633674 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-95ffa5d0-aa2a-467f-8a02-970a9615f38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:22:27.656817 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:22:27.704145 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1284/2571] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:22:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:22:27.713707 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af134ab8-4a56-48d4-be0e-41c425aeb994 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:22:27.714202 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af134ab8-4a56-48d4-be0e-41c425aeb994 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:22:27.714669 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af134ab8-4a56-48d4-be0e-41c425aeb994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:22:27.731753 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:22:27.739137 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-af134ab8-4a56-48d4-be0e-41c425aeb994 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:22:27.741184 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-af134ab8-4a56-48d4-be0e-41c425aeb994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:22:27.750754 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1288/2572] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:22:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:22:27.759558 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ffa5d0-aa2a-467f-8a02-970a9615f38d None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:22:27.769637 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ffa5d0-aa2a-467f-8a02-970a9615f38d None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:22:27.774636 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fd62fc-6577-4d90-bb7c-820858c95da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:22:27.775323 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd62fc-6577-4d90-bb7c-820858c95da6 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:22:27.775775 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd62fc-6577-4d90-bb7c-820858c95da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:22:27.775884 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd62fc-6577-4d90-bb7c-820858c95da6 admin admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:22:27.776621 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fd62fc-6577-4d90-bb7c-820858c95da6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:22:27.776938 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fd62fc-6577-4d90-bb7c-820858c95da6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:22:27.778588 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fd62fc-6577-4d90-bb7c-820858c95da6 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:22:27.791685 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1285/2573] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Jun 22 09:22:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:22:27.796536 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af134ab8-4a56-48d4-be0e-41c425aeb994 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:22:27.808272 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af134ab8-4a56-48d4-be0e-41c425aeb994 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:22:27.814244 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e347a53b-8d98-4b28-bb52-f6a8f5c682ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:22:27.814691 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e347a53b-8d98-4b28-bb52-f6a8f5c682ef admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:22:27.815217 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e347a53b-8d98-4b28-bb52-f6a8f5c682ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:22:27.815562 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e347a53b-8d98-4b28-bb52-f6a8f5c682ef admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:22:27.816349 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e347a53b-8d98-4b28-bb52-f6a8f5c682ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:22:27.818641 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e347a53b-8d98-4b28-bb52-f6a8f5c682ef admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:22:27.869023 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1289/2574] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 09:22:27 2022] POST /identity/v3/projects => generated 371 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:22:27.870227 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fd62fc-6577-4d90-bb7c-820858c95da6 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:22:27.882830 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fd62fc-6577-4d90-bb7c-820858c95da6 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:22:27.943644 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a6eec1-b69f-4ccc-8d8f-e55c6f8529bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:22:27.944317 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6eec1-b69f-4ccc-8d8f-e55c6f8529bc admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:22:27.944597 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6eec1-b69f-4ccc-8d8f-e55c6f8529bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:22:27.944870 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6eec1-b69f-4ccc-8d8f-e55c6f8529bc admin admin] PATH_INFO: `/v3/users` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:22:27.945576 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a6eec1-b69f-4ccc-8d8f-e55c6f8529bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:22:27.947522 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a6eec1-b69f-4ccc-8d8f-e55c6f8529bc admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:22:27.972780 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1286/2575] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 09:22:27 2022] POST /identity/v3/users => generated 286 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:22:27.974120 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e347a53b-8d98-4b28-bb52-f6a8f5c682ef admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:22:27.985873 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e347a53b-8d98-4b28-bb52-f6a8f5c682ef admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:22:27.990648 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551063dc-4ccf-4d6e-9f46-9c725a58d426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:22:27.991330 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551063dc-4ccf-4d6e-9f46-9c725a58d426 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:22:27.991617 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551063dc-4ccf-4d6e-9f46-9c725a58d426 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:22:27.991913 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551063dc-4ccf-4d6e-9f46-9c725a58d426 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:22:27.992630 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551063dc-4ccf-4d6e-9f46-9c725a58d426 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:22:27.994298 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551063dc-4ccf-4d6e-9f46-9c725a58d426 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:22:28.008861 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1290/2576] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 09:22:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:22:28.010127 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a6eec1-b69f-4ccc-8d8f-e55c6f8529bc admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:22:28.020471 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a6eec1-b69f-4ccc-8d8f-e55c6f8529bc admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:22:28.025174 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf432af-02dd-4482-bb4f-f03c3b10badc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:22:28.025848 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf432af-02dd-4482-bb4f-f03c3b10badc admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:22:28.026172 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf432af-02dd-4482-bb4f-f03c3b10badc admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:22:28.026456 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf432af-02dd-4482-bb4f-f03c3b10badc admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:22:28.027188 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf432af-02dd-4482-bb4f-f03c3b10badc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:22:28.028868 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf432af-02dd-4482-bb4f-f03c3b10badc admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:22:28.042697 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1287/2577] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 09:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:22:28.043946 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551063dc-4ccf-4d6e-9f46-9c725a58d426 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:22:28.054979 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551063dc-4ccf-4d6e-9f46-9c725a58d426 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:22:28.059831 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb22262-7f1c-4aa9-9f56-e6c2a08be2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:22:28.061340 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb22262-7f1c-4aa9-9f56-e6c2a08be2db admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:22:28.061651 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb22262-7f1c-4aa9-9f56-e6c2a08be2db admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:22:28.061979 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb22262-7f1c-4aa9-9f56-e6c2a08be2db admin admin] PATH_INFO: `/v3/projects/c57177bf30a14dc88d28c831bca08353/users/8ea09872854e4ddf853be135e379d5a3/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:22:28.078093 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb22262-7f1c-4aa9-9f56-e6c2a08be2db admin admin] RBAC: Authorizing `identity:create_grant(project_id=c57177bf30a14dc88d28c831bca08353, user_id=8ea09872854e4ddf853be135e379d5a3, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:22:28.080863 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb22262-7f1c-4aa9-9f56-e6c2a08be2db admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:22:28.095420 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1291/2578] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 09:22:28 2022] PUT /identity/v3/projects/c57177bf30a14dc88d28c831bca08353/users/8ea09872854e4ddf853be135e379d5a3/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:22:28.106308 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd736b-6018-4f24-8050-cd608bddb8c7 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:22:28.106712 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd736b-6018-4f24-8050-cd608bddb8c7 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:22:28.107546 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd736b-6018-4f24-8050-cd608bddb8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:22:28.135529 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-89bd736b-6018-4f24-8050-cd608bddb8c7 None None] MFA Rules not processed for user `8ea09872854e4ddf853be135e379d5a3`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:22:28.136771 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-89bd736b-6018-4f24-8050-cd608bddb8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:22:28.202980 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1288/2579] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:22:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:22:28.207677 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb22262-7f1c-4aa9-9f56-e6c2a08be2db admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:22:28.214421 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd736b-6018-4f24-8050-cd608bddb8c7 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:22:28.215920 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-89bd736b-6018-4f24-8050-cd608bddb8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:22:28.239707 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:22:28.279451 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb22262-7f1c-4aa9-9f56-e6c2a08be2db admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:22:28.284309 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3daee58-2d1a-4266-878c-9c712495280b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:22:28.284971 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3daee58-2d1a-4266-878c-9c712495280b admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:22:28.285399 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3daee58-2d1a-4266-878c-9c712495280b admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:22:28.285702 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3daee58-2d1a-4266-878c-9c712495280b admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:22:28.286450 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3daee58-2d1a-4266-878c-9c712495280b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:22:28.288490 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3daee58-2d1a-4266-878c-9c712495280b admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:22:28.301141 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd736b-6018-4f24-8050-cd608bddb8c7 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:22:28.307334 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3da65b-466f-4c04-bea4-f7c880619066 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f1809a35b244c1db7a185d82859369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:22:28.307919 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3da65b-466f-4c04-bea4-f7c880619066 service nova] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:22:28.308206 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3da65b-466f-4c04-bea4-f7c880619066 service nova] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:22:28.308550 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3da65b-466f-4c04-bea4-f7c880619066 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:22:28.311139 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-8c3da65b-466f-4c04-bea4-f7c880619066 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:22:28.321254 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1292/2580] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 09:22:28 2022] POST /identity/v3/projects => generated 373 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:22:28.326038 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3daee58-2d1a-4266-878c-9c712495280b admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:22:28.398493 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3daee58-2d1a-4266-878c-9c712495280b admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:22:28.403469 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c8294-8c7e-4ade-ab47-90cb5531caa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:22:28.404192 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c8294-8c7e-4ade-ab47-90cb5531caa1 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:22:28.404482 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c8294-8c7e-4ade-ab47-90cb5531caa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:22:28.404758 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c8294-8c7e-4ade-ab47-90cb5531caa1 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:22:28.405455 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89c8294-8c7e-4ade-ab47-90cb5531caa1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:22:28.407625 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89c8294-8c7e-4ade-ab47-90cb5531caa1 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:22:28.407745 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3da65b-466f-4c04-bea4-f7c880619066 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:22:28.409382 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3da65b-466f-4c04-bea4-f7c880619066 service nova] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:22:28.428395 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1293/2581] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 09:22:28 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:22:28.428761 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1289/2582] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:22:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:22:28.432269 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c8294-8c7e-4ade-ab47-90cb5531caa1 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:22:28.444046 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c8294-8c7e-4ade-ab47-90cb5531caa1 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:22:28.448995 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f700994c-21e7-431f-8acb-1f37871bfe4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:22:28.449662 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f700994c-21e7-431f-8acb-1f37871bfe4c admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:22:28.450018 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f700994c-21e7-431f-8acb-1f37871bfe4c admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:22:28.452526 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f700994c-21e7-431f-8acb-1f37871bfe4c admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:22:28.452526 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f700994c-21e7-431f-8acb-1f37871bfe4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:22:28.453331 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f700994c-21e7-431f-8acb-1f37871bfe4c admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:22:28.455794 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:22:28.467407 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1294/2583] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 09:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:22:28.471454 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3da65b-466f-4c04-bea4-f7c880619066 service nova] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:22:28.483900 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3da65b-466f-4c04-bea4-f7c880619066 service nova] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:22:28.488675 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9391ce-38d5-4222-86aa-82297c8d2fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:22:28.489568 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9391ce-38d5-4222-86aa-82297c8d2fa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:22:28.489925 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9391ce-38d5-4222-86aa-82297c8d2fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:22:28.490178 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9391ce-38d5-4222-86aa-82297c8d2fa8 admin admin] PATH_INFO: `/v3/projects/9d486dc4a0be4160aba4ee888cc422db/users/86cf6efa7c3349b3a1068517f32b5bf9/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:22:28.508599 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9391ce-38d5-4222-86aa-82297c8d2fa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d486dc4a0be4160aba4ee888cc422db, user_id=86cf6efa7c3349b3a1068517f32b5bf9, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:22:28.511338 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9391ce-38d5-4222-86aa-82297c8d2fa8 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:22:28.528009 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1290/2584] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 09:22:28 2022] PUT /identity/v3/projects/9d486dc4a0be4160aba4ee888cc422db/users/86cf6efa7c3349b3a1068517f32b5bf9/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:22:28.532713 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f700994c-21e7-431f-8acb-1f37871bfe4c admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:22:28.549062 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f700994c-21e7-431f-8acb-1f37871bfe4c admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:22:28.621452 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e065a-30e7-4e6b-9b31-787af3b862ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:22:28.622163 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e065a-30e7-4e6b-9b31-787af3b862ac admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:22:28.622489 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e065a-30e7-4e6b-9b31-787af3b862ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:22:28.622772 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e065a-30e7-4e6b-9b31-787af3b862ac admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:22:28.623540 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6e065a-30e7-4e6b-9b31-787af3b862ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:22:28.625171 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6e065a-30e7-4e6b-9b31-787af3b862ac admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:22:28.638827 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1295/2585] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 09:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:22:28.639996 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9391ce-38d5-4222-86aa-82297c8d2fa8 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:22:28.651859 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9391ce-38d5-4222-86aa-82297c8d2fa8 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:22:28.661041 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8bcd02-cda8-4f8f-9234-c08c8aa07c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:22:28.661041 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8bcd02-cda8-4f8f-9234-c08c8aa07c6d admin admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:22:28.661041 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8bcd02-cda8-4f8f-9234-c08c8aa07c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:22:28.661041 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8bcd02-cda8-4f8f-9234-c08c8aa07c6d admin admin] PATH_INFO: `/v3/projects/9d486dc4a0be4160aba4ee888cc422db/users/86cf6efa7c3349b3a1068517f32b5bf9/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:22:28.661898 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8bcd02-cda8-4f8f-9234-c08c8aa07c6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d486dc4a0be4160aba4ee888cc422db, user_id=86cf6efa7c3349b3a1068517f32b5bf9, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:22:28.665345 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8bcd02-cda8-4f8f-9234-c08c8aa07c6d admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:22:28.677261 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1291/2586] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 09:22:28 2022] PUT /identity/v3/projects/9d486dc4a0be4160aba4ee888cc422db/users/86cf6efa7c3349b3a1068517f32b5bf9/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:22:28.688591 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3119427-fe36-4cc5-8713-60bebf1647e7 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:22:28.688899 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3119427-fe36-4cc5-8713-60bebf1647e7 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:22:28.689180 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3119427-fe36-4cc5-8713-60bebf1647e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:22:28.720643 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-e3119427-fe36-4cc5-8713-60bebf1647e7 None None] MFA Rules not processed for user `86cf6efa7c3349b3a1068517f32b5bf9`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:22:28.721862 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-e3119427-fe36-4cc5-8713-60bebf1647e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:22:28.814744 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1296/2587] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:22:28 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:22:28.827101 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8bcd02-cda8-4f8f-9234-c08c8aa07c6d admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:22:28.828947 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-5f8bcd02-cda8-4f8f-9234-c08c8aa07c6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:22:28.894036 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8bcd02-cda8-4f8f-9234-c08c8aa07c6d admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:22:28.897766 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842da562-a435-4320-aee5-6b4f5fa33fc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:22:28.898455 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842da562-a435-4320-aee5-6b4f5fa33fc3 service cinder] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:22:28.898744 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842da562-a435-4320-aee5-6b4f5fa33fc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:22:28.899024 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842da562-a435-4320-aee5-6b4f5fa33fc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:22:28.905271 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:22:28.908994 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842da562-a435-4320-aee5-6b4f5fa33fc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:22:28.911091 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842da562-a435-4320-aee5-6b4f5fa33fc3 service cinder] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:22:28.923191 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1292/2588] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:22:28 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:22:29.003711 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3119427-fe36-4cc5-8713-60bebf1647e7 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:22:29.013729 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3119427-fe36-4cc5-8713-60bebf1647e7 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:22:29.017339 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450fd40e-c3cb-45a0-90c6-b37bc42548ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:22:29.018352 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450fd40e-c3cb-45a0-90c6-b37bc42548ed service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:22:29.018352 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450fd40e-c3cb-45a0-90c6-b37bc42548ed service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:22:29.018589 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450fd40e-c3cb-45a0-90c6-b37bc42548ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:22:29.077159 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450fd40e-c3cb-45a0-90c6-b37bc42548ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:22:29.078647 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450fd40e-c3cb-45a0-90c6-b37bc42548ed service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:22:29.087821 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1297/2589] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:22:29 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:22:34.255893 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842da562-a435-4320-aee5-6b4f5fa33fc3 service cinder] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:22:34.257738 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-842da562-a435-4320-aee5-6b4f5fa33fc3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:22:34.356078 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842da562-a435-4320-aee5-6b4f5fa33fc3 service cinder] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:22:34.361716 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b384fd-b77c-477f-bf9b-e0c462732d30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f1809a35b244c1db7a185d82859369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:22:34.362430 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b384fd-b77c-477f-bf9b-e0c462732d30 service nova] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:22:34.362719 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b384fd-b77c-477f-bf9b-e0c462732d30 service nova] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:22:34.363011 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b384fd-b77c-477f-bf9b-e0c462732d30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:22:34.364801 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-e7b384fd-b77c-477f-bf9b-e0c462732d30 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:22:34.378243 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b384fd-b77c-477f-bf9b-e0c462732d30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:22:34.379821 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b384fd-b77c-477f-bf9b-e0c462732d30 service nova] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:22:34.391343 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1293/2590] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:22:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:22:39.084006 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=92 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:22:39.166207 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450fd40e-c3cb-45a0-90c6-b37bc42548ed service cinder] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:22:39.183893 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450fd40e-c3cb-45a0-90c6-b37bc42548ed service cinder] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:22:39.191277 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd7a3b1-71c5-4368-b2e0-ed74a80ed570 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f1809a35b244c1db7a185d82859369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:22:39.191277 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7a3b1-71c5-4368-b2e0-ed74a80ed570 service nova] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:22:39.191277 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7a3b1-71c5-4368-b2e0-ed74a80ed570 service nova] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:22:39.191277 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7a3b1-71c5-4368-b2e0-ed74a80ed570 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:22:39.193379 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-8bd7a3b1-71c5-4368-b2e0-ed74a80ed570 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:22:39.208074 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd7a3b1-71c5-4368-b2e0-ed74a80ed570 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:22:39.210583 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd7a3b1-71c5-4368-b2e0-ed74a80ed570 service nova] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:22:39.223798 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1298/2591] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:22:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:22:44.386875 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=37 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:22:48.893982 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b384fd-b77c-477f-bf9b-e0c462732d30 service nova] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:22:48.895527 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-e7b384fd-b77c-477f-bf9b-e0c462732d30 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:22:48.976824 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b384fd-b77c-477f-bf9b-e0c462732d30 service nova] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:22:48.980586 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba0c749-4754-48cd-82e7-7fd4cb660819 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:22:48.981240 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba0c749-4754-48cd-82e7-7fd4cb660819 service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:22:48.982214 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba0c749-4754-48cd-82e7-7fd4cb660819 service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:22:48.982338 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba0c749-4754-48cd-82e7-7fd4cb660819 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:22:48.984229 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-2ba0c749-4754-48cd-82e7-7fd4cb660819 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:22:49.070813 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba0c749-4754-48cd-82e7-7fd4cb660819 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:22:49.072256 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba0c749-4754-48cd-82e7-7fd4cb660819 service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:22:49.082291 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1294/2592] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:22:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:22:49.218694 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=6 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:22:49.641614 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd7a3b1-71c5-4368-b2e0-ed74a80ed570 service nova] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:22:49.643231 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-8bd7a3b1-71c5-4368-b2e0-ed74a80ed570 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:22:49.686211 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd7a3b1-71c5-4368-b2e0-ed74a80ed570 service nova] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:22:49.690909 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725fe4c9-fdc4-4bdd-ac3b-f4b3b5fd1bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:22:49.691781 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725fe4c9-fdc4-4bdd-ac3b-f4b3b5fd1bce admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:22:49.692066 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725fe4c9-fdc4-4bdd-ac3b-f4b3b5fd1bce admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:22:49.692342 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725fe4c9-fdc4-4bdd-ac3b-f4b3b5fd1bce admin admin] PATH_INFO: `/v3/users/dac980fabf4f4fef8694d1ce2d75372c` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:22:49.693553 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725fe4c9-fdc4-4bdd-ac3b-f4b3b5fd1bce admin admin] RBAC: Authorizing `identity:delete_user(user_id=dac980fabf4f4fef8694d1ce2d75372c)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:22:49.695523 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725fe4c9-fdc4-4bdd-ac3b-f4b3b5fd1bce admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:22:49.743432 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-725fe4c9-fdc4-4bdd-ac3b-f4b3b5fd1bce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dac980fabf4f4fef8694d1ce2d75372c'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:22:49.750399 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-725fe4c9-fdc4-4bdd-ac3b-f4b3b5fd1bce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dac980fabf4f4fef8694d1ce2d75372c'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:22:49.751360 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-725fe4c9-fdc4-4bdd-ac3b-f4b3b5fd1bce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dac980fabf4f4fef8694d1ce2d75372c'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:22:49.759290 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-725fe4c9-fdc4-4bdd-ac3b-f4b3b5fd1bce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dac980fabf4f4fef8694d1ce2d75372c'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:22:49.760123 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-725fe4c9-fdc4-4bdd-ac3b-f4b3b5fd1bce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dac980fabf4f4fef8694d1ce2d75372c'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:22:49.779176 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1299/2593] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 09:22:49 2022] DELETE /identity/v3/users/dac980fabf4f4fef8694d1ce2d75372c => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:22:49.965608 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba0c749-4754-48cd-82e7-7fd4cb660819 service neutron] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:22:49.977521 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba0c749-4754-48cd-82e7-7fd4cb660819 service neutron] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:22:50.038870 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e629fe8a-799b-4a10-a1fc-58e0f1b23099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:22:50.039729 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629fe8a-799b-4a10-a1fc-58e0f1b23099 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:22:50.040013 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629fe8a-799b-4a10-a1fc-58e0f1b23099 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:22:50.040296 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629fe8a-799b-4a10-a1fc-58e0f1b23099 admin admin] PATH_INFO: `/v3/projects/898e7193de204076abe886e6b4e4a581` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:22:50.041490 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e629fe8a-799b-4a10-a1fc-58e0f1b23099 admin admin] RBAC: Authorizing `identity:delete_project(project_id=898e7193de204076abe886e6b4e4a581)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:22:50.043421 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e629fe8a-799b-4a10-a1fc-58e0f1b23099 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:22:50.055808 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:22:50.092314 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-e629fe8a-799b-4a10-a1fc-58e0f1b23099 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '898e7193de204076abe886e6b4e4a581', 'request_id': 'req-e629fe8a-799b-4a10-a1fc-58e0f1b23099'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:22:50.097793 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-e629fe8a-799b-4a10-a1fc-58e0f1b23099 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '898e7193de204076abe886e6b4e4a581', 'request_id': 'req-e629fe8a-799b-4a10-a1fc-58e0f1b23099'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:22:50.104798 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-e629fe8a-799b-4a10-a1fc-58e0f1b23099 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '898e7193de204076abe886e6b4e4a581', 'request_id': 'req-e629fe8a-799b-4a10-a1fc-58e0f1b23099'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:22:50.118329 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-e629fe8a-799b-4a10-a1fc-58e0f1b23099 admin admin] The token cache is being invalidate because project 898e7193de204076abe886e6b4e4a581 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:22:50.118615 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-e629fe8a-799b-4a10-a1fc-58e0f1b23099 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:22:50.119281 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-e629fe8a-799b-4a10-a1fc-58e0f1b23099 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:22:50.120833 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1295/2594] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 09:22:49 2022] DELETE /identity/v3/projects/898e7193de204076abe886e6b4e4a581 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:22:57.936922 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725fe4c9-fdc4-4bdd-ac3b-f4b3b5fd1bce admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:22:57.938495 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-725fe4c9-fdc4-4bdd-ac3b-f4b3b5fd1bce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:22:58.021588 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725fe4c9-fdc4-4bdd-ac3b-f4b3b5fd1bce admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:22:58.075248 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:22:58.100653 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2dd656-b2af-403f-95c0-1d8d8b4d5603 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec2627e3cdc94ec38d7cc3b1bc670ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:22:58.101314 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2dd656-b2af-403f-95c0-1d8d8b4d5603 service placement] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:22:58.101612 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2dd656-b2af-403f-95c0-1d8d8b4d5603 service placement] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:22:58.101892 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2dd656-b2af-403f-95c0-1d8d8b4d5603 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:22:58.103767 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-0d2dd656-b2af-403f-95c0-1d8d8b4d5603 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:22:58.116319 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2dd656-b2af-403f-95c0-1d8d8b4d5603 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:22:58.117927 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2dd656-b2af-403f-95c0-1d8d8b4d5603 service placement] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:22:58.129202 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1300/2595] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:22:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:23:00.115193 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=19,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:23:08.124602 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=13 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:23:12.136937 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e629fe8a-799b-4a10-a1fc-58e0f1b23099 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:12.139024 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-e629fe8a-799b-4a10-a1fc-58e0f1b23099 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:23:12.209489 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e629fe8a-799b-4a10-a1fc-58e0f1b23099 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:12.214025 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458a1b4-e3a2-47cd-add8-b42eda0c266a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:12.215223 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458a1b4-e3a2-47cd-add8-b42eda0c266a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:12.215510 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458a1b4-e3a2-47cd-add8-b42eda0c266a admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:12.215787 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458a1b4-e3a2-47cd-add8-b42eda0c266a admin admin] PATH_INFO: `/v3/users/8ea09872854e4ddf853be135e379d5a3` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:12.217075 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8458a1b4-e3a2-47cd-add8-b42eda0c266a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ea09872854e4ddf853be135e379d5a3)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:12.219422 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8458a1b4-e3a2-47cd-add8-b42eda0c266a admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:12.271337 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-8458a1b4-e3a2-47cd-add8-b42eda0c266a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ea09872854e4ddf853be135e379d5a3'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:12.278043 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-8458a1b4-e3a2-47cd-add8-b42eda0c266a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ea09872854e4ddf853be135e379d5a3'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:12.278793 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-8458a1b4-e3a2-47cd-add8-b42eda0c266a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ea09872854e4ddf853be135e379d5a3'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:12.286065 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-8458a1b4-e3a2-47cd-add8-b42eda0c266a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ea09872854e4ddf853be135e379d5a3'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:12.286780 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-8458a1b4-e3a2-47cd-add8-b42eda0c266a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ea09872854e4ddf853be135e379d5a3'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:12.304516 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1296/2596] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 09:23:12 2022] DELETE /identity/v3/users/8ea09872854e4ddf853be135e379d5a3 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:23:12.308966 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd1823-7c96-4833-8bfc-3417fa55621a None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:12.309428 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd1823-7c96-4833-8bfc-3417fa55621a None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:12.309526 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd1823-7c96-4833-8bfc-3417fa55621a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:12.331684 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-2efd1823-7c96-4833-8bfc-3417fa55621a None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:23:12.332899 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-2efd1823-7c96-4833-8bfc-3417fa55621a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:23:12.391750 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1301/2597] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:23:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:23:12.401880 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458a1b4-e3a2-47cd-add8-b42eda0c266a admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:12.403326 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-8458a1b4-e3a2-47cd-add8-b42eda0c266a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:23:12.465953 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458a1b4-e3a2-47cd-add8-b42eda0c266a admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:12.470782 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe5a7c-62c5-4b7f-a04f-fa00bb021f79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:12.471438 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe5a7c-62c5-4b7f-a04f-fa00bb021f79 service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:12.471726 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe5a7c-62c5-4b7f-a04f-fa00bb021f79 service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:12.472010 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe5a7c-62c5-4b7f-a04f-fa00bb021f79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:12.482774 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efe5a7c-62c5-4b7f-a04f-fa00bb021f79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:12.484223 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efe5a7c-62c5-4b7f-a04f-fa00bb021f79 service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:12.495206 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1297/2598] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:23:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:23:12.807228 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd1823-7c96-4833-8bfc-3417fa55621a None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:12.808795 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-2efd1823-7c96-4833-8bfc-3417fa55621a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:23:12.821229 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd1823-7c96-4833-8bfc-3417fa55621a None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:12.828214 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f7757e-3f6c-48c2-a41e-0cffc2a0f4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:12.829100 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7757e-3f6c-48c2-a41e-0cffc2a0f4ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:12.829418 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7757e-3f6c-48c2-a41e-0cffc2a0f4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:12.829746 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7757e-3f6c-48c2-a41e-0cffc2a0f4ca admin admin] PATH_INFO: `/v3/projects/c57177bf30a14dc88d28c831bca08353` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:12.830960 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f7757e-3f6c-48c2-a41e-0cffc2a0f4ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=c57177bf30a14dc88d28c831bca08353)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:12.832902 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f7757e-3f6c-48c2-a41e-0cffc2a0f4ca admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:12.906160 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-a3f7757e-3f6c-48c2-a41e-0cffc2a0f4ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c57177bf30a14dc88d28c831bca08353', 'request_id': 'req-a3f7757e-3f6c-48c2-a41e-0cffc2a0f4ca'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:12.915112 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-a3f7757e-3f6c-48c2-a41e-0cffc2a0f4ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c57177bf30a14dc88d28c831bca08353', 'request_id': 'req-a3f7757e-3f6c-48c2-a41e-0cffc2a0f4ca'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:12.923070 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-a3f7757e-3f6c-48c2-a41e-0cffc2a0f4ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c57177bf30a14dc88d28c831bca08353', 'request_id': 'req-a3f7757e-3f6c-48c2-a41e-0cffc2a0f4ca'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:12.936300 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-a3f7757e-3f6c-48c2-a41e-0cffc2a0f4ca admin admin] The token cache is being invalidate because project c57177bf30a14dc88d28c831bca08353 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:23:12.936591 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-a3f7757e-3f6c-48c2-a41e-0cffc2a0f4ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:12.937293 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-a3f7757e-3f6c-48c2-a41e-0cffc2a0f4ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:12.938938 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1302/2599] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 09:23:12 2022] DELETE /identity/v3/projects/c57177bf30a14dc88d28c831bca08353 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:23:12.943075 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe5a7c-62c5-4b7f-a04f-fa00bb021f79 service neutron] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:12.953721 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe5a7c-62c5-4b7f-a04f-fa00bb021f79 service neutron] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:12.979096 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:23:13.020364 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af51a4-978f-42dc-9f72-4400e03ec210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:13.021233 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af51a4-978f-42dc-9f72-4400e03ec210 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:13.021524 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af51a4-978f-42dc-9f72-4400e03ec210 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:13.021806 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af51a4-978f-42dc-9f72-4400e03ec210 admin admin] PATH_INFO: `/v3/users/86cf6efa7c3349b3a1068517f32b5bf9` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:13.023027 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30af51a4-978f-42dc-9f72-4400e03ec210 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86cf6efa7c3349b3a1068517f32b5bf9)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:13.024947 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30af51a4-978f-42dc-9f72-4400e03ec210 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:13.071972 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-30af51a4-978f-42dc-9f72-4400e03ec210 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86cf6efa7c3349b3a1068517f32b5bf9'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:13.078857 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-30af51a4-978f-42dc-9f72-4400e03ec210 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86cf6efa7c3349b3a1068517f32b5bf9'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:13.079522 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-30af51a4-978f-42dc-9f72-4400e03ec210 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86cf6efa7c3349b3a1068517f32b5bf9'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:13.086920 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-30af51a4-978f-42dc-9f72-4400e03ec210 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86cf6efa7c3349b3a1068517f32b5bf9'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:13.087592 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-30af51a4-978f-42dc-9f72-4400e03ec210 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86cf6efa7c3349b3a1068517f32b5bf9'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:13.104902 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1298/2600] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 09:23:12 2022] DELETE /identity/v3/users/86cf6efa7c3349b3a1068517f32b5bf9 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:23:13.386675 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f7757e-3f6c-48c2-a41e-0cffc2a0f4ca admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:13.389030 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-a3f7757e-3f6c-48c2-a41e-0cffc2a0f4ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:23:13.411626 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f7757e-3f6c-48c2-a41e-0cffc2a0f4ca admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:13.479464 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a8e4de-efb4-4a18-ae92-fb314a02f05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:13.480336 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a8e4de-efb4-4a18-ae92-fb314a02f05d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:13.480618 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a8e4de-efb4-4a18-ae92-fb314a02f05d admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:13.480922 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a8e4de-efb4-4a18-ae92-fb314a02f05d admin admin] PATH_INFO: `/v3/projects/9d486dc4a0be4160aba4ee888cc422db` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:13.482243 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a8e4de-efb4-4a18-ae92-fb314a02f05d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d486dc4a0be4160aba4ee888cc422db)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:13.484198 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a8e4de-efb4-4a18-ae92-fb314a02f05d admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:13.517476 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:23:13.535946 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-37a8e4de-efb4-4a18-ae92-fb314a02f05d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d486dc4a0be4160aba4ee888cc422db', 'request_id': 'req-37a8e4de-efb4-4a18-ae92-fb314a02f05d'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:13.541385 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-37a8e4de-efb4-4a18-ae92-fb314a02f05d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d486dc4a0be4160aba4ee888cc422db', 'request_id': 'req-37a8e4de-efb4-4a18-ae92-fb314a02f05d'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:13.548218 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-37a8e4de-efb4-4a18-ae92-fb314a02f05d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d486dc4a0be4160aba4ee888cc422db', 'request_id': 'req-37a8e4de-efb4-4a18-ae92-fb314a02f05d'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:13.560512 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-37a8e4de-efb4-4a18-ae92-fb314a02f05d admin admin] The token cache is being invalidate because project 9d486dc4a0be4160aba4ee888cc422db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:23:13.560819 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-37a8e4de-efb4-4a18-ae92-fb314a02f05d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:13.561456 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-37a8e4de-efb4-4a18-ae92-fb314a02f05d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:13.563052 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1303/2601] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 09:23:13 2022] DELETE /identity/v3/projects/9d486dc4a0be4160aba4ee888cc422db => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:23:13.568173 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c558928f-8af0-42de-8e2f-5a5535939bf0 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:13.568614 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c558928f-8af0-42de-8e2f-5a5535939bf0 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:13.568762 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c558928f-8af0-42de-8e2f-5a5535939bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:13.587341 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-c558928f-8af0-42de-8e2f-5a5535939bf0 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:23:13.588547 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-c558928f-8af0-42de-8e2f-5a5535939bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:23:13.652960 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1299/2602] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:23:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:23:13.661570 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19921e2b-8f3c-4a95-aa20-26d41da3d683 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:13.661972 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19921e2b-8f3c-4a95-aa20-26d41da3d683 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:13.662428 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19921e2b-8f3c-4a95-aa20-26d41da3d683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:13.682709 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-19921e2b-8f3c-4a95-aa20-26d41da3d683 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:23:13.683917 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-19921e2b-8f3c-4a95-aa20-26d41da3d683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:23:13.692640 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1304/2603] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:23:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:23:13.696907 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c558928f-8af0-42de-8e2f-5a5535939bf0 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:13.707553 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c558928f-8af0-42de-8e2f-5a5535939bf0 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:13.712173 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f3e6d8-7e5e-4e27-bdf6-9128800d8031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:13.712828 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3e6d8-7e5e-4e27-bdf6-9128800d8031 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:13.713114 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3e6d8-7e5e-4e27-bdf6-9128800d8031 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:13.713394 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3e6d8-7e5e-4e27-bdf6-9128800d8031 admin admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:13.714155 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f3e6d8-7e5e-4e27-bdf6-9128800d8031 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:23:13.714470 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f3e6d8-7e5e-4e27-bdf6-9128800d8031 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:13.716067 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f3e6d8-7e5e-4e27-bdf6-9128800d8031 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:13.727748 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1300/2604] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Jun 22 09:23:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:23:13.733182 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19921e2b-8f3c-4a95-aa20-26d41da3d683 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:13.742870 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19921e2b-8f3c-4a95-aa20-26d41da3d683 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:13.748115 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17c901-c799-4be1-a3ac-49ffd7ea10c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:13.748760 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17c901-c799-4be1-a3ac-49ffd7ea10c5 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:13.749045 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17c901-c799-4be1-a3ac-49ffd7ea10c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:13.749356 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17c901-c799-4be1-a3ac-49ffd7ea10c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:13.750121 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b17c901-c799-4be1-a3ac-49ffd7ea10c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:13.752290 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b17c901-c799-4be1-a3ac-49ffd7ea10c5 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:13.777640 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1305/2605] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 09:23:13 2022] POST /identity/v3/projects => generated 387 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:23:13.781671 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f3e6d8-7e5e-4e27-bdf6-9128800d8031 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:13.792049 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f3e6d8-7e5e-4e27-bdf6-9128800d8031 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:13.818253 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:23:13.850013 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1643d8-1f4c-4386-8b09-06e0ebfc2e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:13.850641 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1643d8-1f4c-4386-8b09-06e0ebfc2e19 admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:13.850931 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1643d8-1f4c-4386-8b09-06e0ebfc2e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:13.851210 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1643d8-1f4c-4386-8b09-06e0ebfc2e19 admin admin] PATH_INFO: `/v3/users` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:13.851896 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1643d8-1f4c-4386-8b09-06e0ebfc2e19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:13.853812 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1643d8-1f4c-4386-8b09-06e0ebfc2e19 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:13.873643 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1301/2606] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 09:23:13 2022] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:23:13.877888 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17c901-c799-4be1-a3ac-49ffd7ea10c5 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:13.888452 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17c901-c799-4be1-a3ac-49ffd7ea10c5 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:13.893033 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608cedde-8287-45f2-beaf-8b160b1363db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:13.893685 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608cedde-8287-45f2-beaf-8b160b1363db admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:13.893969 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608cedde-8287-45f2-beaf-8b160b1363db admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:13.894276 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608cedde-8287-45f2-beaf-8b160b1363db admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:13.895008 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608cedde-8287-45f2-beaf-8b160b1363db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:13.896587 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608cedde-8287-45f2-beaf-8b160b1363db admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:13.906882 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1306/2607] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 09:23:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:23:13.910807 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1643d8-1f4c-4386-8b09-06e0ebfc2e19 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:13.921295 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1643d8-1f4c-4386-8b09-06e0ebfc2e19 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:13.925894 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d79c47-bcd4-4f0c-83eb-b2acbcec548a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:13.926587 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d79c47-bcd4-4f0c-83eb-b2acbcec548a admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:13.926873 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d79c47-bcd4-4f0c-83eb-b2acbcec548a admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:13.927150 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d79c47-bcd4-4f0c-83eb-b2acbcec548a admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:13.927867 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d79c47-bcd4-4f0c-83eb-b2acbcec548a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:13.929445 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d79c47-bcd4-4f0c-83eb-b2acbcec548a admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:13.942127 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1302/2608] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 09:23:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:23:13.946211 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608cedde-8287-45f2-beaf-8b160b1363db admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:13.956181 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608cedde-8287-45f2-beaf-8b160b1363db admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:13.960810 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416fad6d-1a58-4335-835c-462fe82d6a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:13.961677 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416fad6d-1a58-4335-835c-462fe82d6a01 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:13.961965 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416fad6d-1a58-4335-835c-462fe82d6a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:13.962277 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416fad6d-1a58-4335-835c-462fe82d6a01 admin admin] PATH_INFO: `/v3/projects/49ee5e95227548e4bfb2b8585476d8ad/users/558e1e34ff04474f9c3b78d7b433fa8d/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:13.977812 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416fad6d-1a58-4335-835c-462fe82d6a01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49ee5e95227548e4bfb2b8585476d8ad, user_id=558e1e34ff04474f9c3b78d7b433fa8d, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:13.982789 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416fad6d-1a58-4335-835c-462fe82d6a01 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:13.996277 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1307/2609] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 09:23:13 2022] PUT /identity/v3/projects/49ee5e95227548e4bfb2b8585476d8ad/users/558e1e34ff04474f9c3b78d7b433fa8d/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:23:14.007705 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d987d8-4771-4548-bd7c-d502a7a40604 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:14.008000 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d987d8-4771-4548-bd7c-d502a7a40604 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:14.008280 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d987d8-4771-4548-bd7c-d502a7a40604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:14.035422 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-89d987d8-4771-4548-bd7c-d502a7a40604 None None] MFA Rules not processed for user `558e1e34ff04474f9c3b78d7b433fa8d`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:23:14.036634 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-89d987d8-4771-4548-bd7c-d502a7a40604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:23:14.098700 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1303/2610] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:23:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:23:14.103348 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416fad6d-1a58-4335-835c-462fe82d6a01 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:14.164354 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416fad6d-1a58-4335-835c-462fe82d6a01 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:14.169928 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90df0de8-f550-4fe3-adb2-b56b3e83f3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:14.170600 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df0de8-f550-4fe3-adb2-b56b3e83f3f7 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:14.170886 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df0de8-f550-4fe3-adb2-b56b3e83f3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:14.171165 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df0de8-f550-4fe3-adb2-b56b3e83f3f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:14.171850 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90df0de8-f550-4fe3-adb2-b56b3e83f3f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:14.173749 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90df0de8-f550-4fe3-adb2-b56b3e83f3f7 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:14.198245 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1308/2611] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 09:23:14 2022] POST /identity/v3/projects => generated 387 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:23:14.202500 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d987d8-4771-4548-bd7c-d502a7a40604 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:14.213049 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d987d8-4771-4548-bd7c-d502a7a40604 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:14.272214 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ed6bc-c0d0-4535-93ac-e6507c21292a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:14.272895 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ed6bc-c0d0-4535-93ac-e6507c21292a admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:14.273257 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ed6bc-c0d0-4535-93ac-e6507c21292a admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:14.273467 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ed6bc-c0d0-4535-93ac-e6507c21292a admin admin] PATH_INFO: `/v3/users` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:14.274268 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882ed6bc-c0d0-4535-93ac-e6507c21292a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:14.276170 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882ed6bc-c0d0-4535-93ac-e6507c21292a admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:14.299279 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1304/2612] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 09:23:14 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:23:14.304282 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90df0de8-f550-4fe3-adb2-b56b3e83f3f7 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:14.315261 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90df0de8-f550-4fe3-adb2-b56b3e83f3f7 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:14.320094 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b8f21d-7aa9-4b5f-ac91-d23015b98e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:14.320752 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8f21d-7aa9-4b5f-ac91-d23015b98e46 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:14.321034 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8f21d-7aa9-4b5f-ac91-d23015b98e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:14.321314 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8f21d-7aa9-4b5f-ac91-d23015b98e46 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:14.322043 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b8f21d-7aa9-4b5f-ac91-d23015b98e46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:14.323680 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b8f21d-7aa9-4b5f-ac91-d23015b98e46 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:14.336196 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1309/2613] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 09:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:23:14.340401 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ed6bc-c0d0-4535-93ac-e6507c21292a admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:14.351593 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ed6bc-c0d0-4535-93ac-e6507c21292a admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:14.358689 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f740a199-10da-43de-8e02-5c31d67f9de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:14.359666 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740a199-10da-43de-8e02-5c31d67f9de6 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:14.360123 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740a199-10da-43de-8e02-5c31d67f9de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:14.360570 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740a199-10da-43de-8e02-5c31d67f9de6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:14.361789 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f740a199-10da-43de-8e02-5c31d67f9de6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:14.364559 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f740a199-10da-43de-8e02-5c31d67f9de6 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:14.377880 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1305/2614] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 09:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:23:14.382466 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b8f21d-7aa9-4b5f-ac91-d23015b98e46 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:14.393414 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b8f21d-7aa9-4b5f-ac91-d23015b98e46 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:14.401033 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be2d16-9a16-434c-a608-00f002d8313a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:14.402865 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be2d16-9a16-434c-a608-00f002d8313a admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:14.403669 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be2d16-9a16-434c-a608-00f002d8313a admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:14.404313 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be2d16-9a16-434c-a608-00f002d8313a admin admin] PATH_INFO: `/v3/projects/32f8b1062d824a3ea69edfd374e3c507/users/a3805c2315e942e8b5e2bacfa4b1c51d/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:14.424626 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4be2d16-9a16-434c-a608-00f002d8313a admin admin] RBAC: Authorizing `identity:create_grant(project_id=32f8b1062d824a3ea69edfd374e3c507, user_id=a3805c2315e942e8b5e2bacfa4b1c51d, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:14.428179 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4be2d16-9a16-434c-a608-00f002d8313a admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:14.439361 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:23:14.444545 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1310/2615] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 09:23:14 2022] PUT /identity/v3/projects/32f8b1062d824a3ea69edfd374e3c507/users/a3805c2315e942e8b5e2bacfa4b1c51d/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:23:14.503907 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bab3f6-a35d-440a-964f-ef7d64fd93a6 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:14.504204 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bab3f6-a35d-440a-964f-ef7d64fd93a6 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:14.504489 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bab3f6-a35d-440a-964f-ef7d64fd93a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:14.531401 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-86bab3f6-a35d-440a-964f-ef7d64fd93a6 None None] MFA Rules not processed for user `a3805c2315e942e8b5e2bacfa4b1c51d`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:23:14.533327 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-86bab3f6-a35d-440a-964f-ef7d64fd93a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:23:14.539775 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:23:14.605862 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1306/2616] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:23:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:23:14.610989 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be2d16-9a16-434c-a608-00f002d8313a admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:14.678973 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be2d16-9a16-434c-a608-00f002d8313a admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:14.683705 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e375032-1c77-4bcf-a432-ab3dba11516b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:14.684369 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e375032-1c77-4bcf-a432-ab3dba11516b admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:14.684658 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e375032-1c77-4bcf-a432-ab3dba11516b admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:14.685522 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e375032-1c77-4bcf-a432-ab3dba11516b admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:14.686269 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e375032-1c77-4bcf-a432-ab3dba11516b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:14.688186 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e375032-1c77-4bcf-a432-ab3dba11516b admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:14.714413 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1311/2617] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 09:23:14 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:23:14.719330 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bab3f6-a35d-440a-964f-ef7d64fd93a6 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:14.730219 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bab3f6-a35d-440a-964f-ef7d64fd93a6 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:14.786379 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc5474-1c61-4a8d-a03f-4d59ba461891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:14.787090 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc5474-1c61-4a8d-a03f-4d59ba461891 admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:14.787372 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc5474-1c61-4a8d-a03f-4d59ba461891 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:14.787657 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc5474-1c61-4a8d-a03f-4d59ba461891 admin admin] PATH_INFO: `/v3/users` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:14.788349 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc5474-1c61-4a8d-a03f-4d59ba461891 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:14.790301 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc5474-1c61-4a8d-a03f-4d59ba461891 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:14.809808 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1307/2618] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 09:23:14 2022] POST /identity/v3/users => generated 299 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:23:14.813748 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e375032-1c77-4bcf-a432-ab3dba11516b admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:14.824198 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e375032-1c77-4bcf-a432-ab3dba11516b admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:14.829363 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd6425f-f5df-4052-9b84-76f8e63bddbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:14.830034 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6425f-f5df-4052-9b84-76f8e63bddbb admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:14.830350 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6425f-f5df-4052-9b84-76f8e63bddbb admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:14.830628 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6425f-f5df-4052-9b84-76f8e63bddbb admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:14.831366 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd6425f-f5df-4052-9b84-76f8e63bddbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:14.832966 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd6425f-f5df-4052-9b84-76f8e63bddbb admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:14.844444 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1312/2619] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 09:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:23:14.848599 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc5474-1c61-4a8d-a03f-4d59ba461891 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:14.858792 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc5474-1c61-4a8d-a03f-4d59ba461891 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:14.863535 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f55c14-af64-43fd-9cc0-2e9f88ee1aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:14.864360 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f55c14-af64-43fd-9cc0-2e9f88ee1aa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:14.864647 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f55c14-af64-43fd-9cc0-2e9f88ee1aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:14.864929 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f55c14-af64-43fd-9cc0-2e9f88ee1aa0 admin admin] PATH_INFO: `/v3/projects/d29e8610bbfe42d686e479dc4216cf34/users/9d56f82b86084dad86673a9595ec87f0/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:14.880525 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f55c14-af64-43fd-9cc0-2e9f88ee1aa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d29e8610bbfe42d686e479dc4216cf34, user_id=9d56f82b86084dad86673a9595ec87f0, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:14.883228 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f55c14-af64-43fd-9cc0-2e9f88ee1aa0 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:14.897178 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1308/2620] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 09:23:14 2022] PUT /identity/v3/projects/d29e8610bbfe42d686e479dc4216cf34/users/9d56f82b86084dad86673a9595ec87f0/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:23:14.901151 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd6425f-f5df-4052-9b84-76f8e63bddbb admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:14.911443 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd6425f-f5df-4052-9b84-76f8e63bddbb admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:14.967559 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e826b0f-2ec4-475f-beea-1a1acda5d9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:14.968216 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e826b0f-2ec4-475f-beea-1a1acda5d9ab admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:14.968498 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e826b0f-2ec4-475f-beea-1a1acda5d9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:14.968774 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e826b0f-2ec4-475f-beea-1a1acda5d9ab admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:14.969496 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e826b0f-2ec4-475f-beea-1a1acda5d9ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:14.971118 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e826b0f-2ec4-475f-beea-1a1acda5d9ab admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:14.980933 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1313/2621] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 09:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:23:14.985094 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f55c14-af64-43fd-9cc0-2e9f88ee1aa0 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:14.995841 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f55c14-af64-43fd-9cc0-2e9f88ee1aa0 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:15.001278 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e76ca-72bf-4951-823e-8cfba16accbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:15.002190 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e76ca-72bf-4951-823e-8cfba16accbf admin admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:15.002476 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e76ca-72bf-4951-823e-8cfba16accbf admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:15.002756 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e76ca-72bf-4951-823e-8cfba16accbf admin admin] PATH_INFO: `/v3/projects/d29e8610bbfe42d686e479dc4216cf34/users/9d56f82b86084dad86673a9595ec87f0/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:15.004724 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5e76ca-72bf-4951-823e-8cfba16accbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d29e8610bbfe42d686e479dc4216cf34, user_id=9d56f82b86084dad86673a9595ec87f0, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:15.007405 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5e76ca-72bf-4951-823e-8cfba16accbf admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:15.018490 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1309/2622] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 09:23:14 2022] PUT /identity/v3/projects/d29e8610bbfe42d686e479dc4216cf34/users/9d56f82b86084dad86673a9595ec87f0/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:23:15.028584 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298a5ce-784c-44da-a0d6-cdcb86ba43a3 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:15.028878 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298a5ce-784c-44da-a0d6-cdcb86ba43a3 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:15.029156 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298a5ce-784c-44da-a0d6-cdcb86ba43a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:15.055050 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-9298a5ce-784c-44da-a0d6-cdcb86ba43a3 None None] MFA Rules not processed for user `9d56f82b86084dad86673a9595ec87f0`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:23:15.056287 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-9298a5ce-784c-44da-a0d6-cdcb86ba43a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:23:15.116083 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:23:15.127823 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1314/2623] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:23:15 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:23:15.139363 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e76ca-72bf-4951-823e-8cfba16accbf admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:15.141062 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-3a5e76ca-72bf-4951-823e-8cfba16accbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:23:15.202502 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e76ca-72bf-4951-823e-8cfba16accbf admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:15.206360 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3723a16f-2bda-4dec-9bab-90901afbafdd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:15.207011 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3723a16f-2bda-4dec-9bab-90901afbafdd service cinder] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:15.207300 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3723a16f-2bda-4dec-9bab-90901afbafdd service cinder] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:15.207579 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3723a16f-2bda-4dec-9bab-90901afbafdd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:15.217557 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3723a16f-2bda-4dec-9bab-90901afbafdd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:15.219043 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3723a16f-2bda-4dec-9bab-90901afbafdd service cinder] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:15.224324 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:23:15.229764 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1310/2624] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:23:15 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:23:15.725872 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9298a5ce-784c-44da-a0d6-cdcb86ba43a3 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:15.727465 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-9298a5ce-784c-44da-a0d6-cdcb86ba43a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:23:15.739519 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9298a5ce-784c-44da-a0d6-cdcb86ba43a3 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:15.743126 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0975b89-d0b0-443a-b613-7a934471e74d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:15.743772 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0975b89-d0b0-443a-b613-7a934471e74d service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:15.744058 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0975b89-d0b0-443a-b613-7a934471e74d service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:15.744339 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0975b89-d0b0-443a-b613-7a934471e74d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:15.803668 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0975b89-d0b0-443a-b613-7a934471e74d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:15.805157 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0975b89-d0b0-443a-b613-7a934471e74d service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:15.814780 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1315/2625] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:23:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:23:19.821952 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3723a16f-2bda-4dec-9bab-90901afbafdd service cinder] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:19.830624 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3723a16f-2bda-4dec-9bab-90901afbafdd service cinder] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:19.834202 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad348fc-10ce-43d0-b6e4-1c9608b44ee0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:19.834836 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad348fc-10ce-43d0-b6e4-1c9608b44ee0 service cinder] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:19.835113 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad348fc-10ce-43d0-b6e4-1c9608b44ee0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:19.835385 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad348fc-10ce-43d0-b6e4-1c9608b44ee0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:19.894294 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad348fc-10ce-43d0-b6e4-1c9608b44ee0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:19.895753 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad348fc-10ce-43d0-b6e4-1c9608b44ee0 service cinder] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:19.905902 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1311/2626] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:23:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:23:22.007689 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0975b89-d0b0-443a-b613-7a934471e74d service cinder] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:22.077603 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0975b89-d0b0-443a-b613-7a934471e74d service cinder] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:22.082151 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a76ad2-5ba1-4478-9770-7914bb5a255e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:22.083019 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a76ad2-5ba1-4478-9770-7914bb5a255e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:22.083299 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a76ad2-5ba1-4478-9770-7914bb5a255e admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:22.083574 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a76ad2-5ba1-4478-9770-7914bb5a255e admin admin] PATH_INFO: `/v3/users/558e1e34ff04474f9c3b78d7b433fa8d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:22.084799 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a76ad2-5ba1-4478-9770-7914bb5a255e admin admin] RBAC: Authorizing `identity:delete_user(user_id=558e1e34ff04474f9c3b78d7b433fa8d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:22.086758 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a76ad2-5ba1-4478-9770-7914bb5a255e admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:22.138673 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-03a76ad2-5ba1-4478-9770-7914bb5a255e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '558e1e34ff04474f9c3b78d7b433fa8d'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:22.145488 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-03a76ad2-5ba1-4478-9770-7914bb5a255e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '558e1e34ff04474f9c3b78d7b433fa8d'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:22.146272 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-03a76ad2-5ba1-4478-9770-7914bb5a255e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '558e1e34ff04474f9c3b78d7b433fa8d'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:22.153914 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-03a76ad2-5ba1-4478-9770-7914bb5a255e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '558e1e34ff04474f9c3b78d7b433fa8d'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:22.154600 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-03a76ad2-5ba1-4478-9770-7914bb5a255e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '558e1e34ff04474f9c3b78d7b433fa8d'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:22.172599 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1316/2627] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 09:23:22 2022] DELETE /identity/v3/users/558e1e34ff04474f9c3b78d7b433fa8d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:23:22.177799 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b6d4c-edfb-4ae4-bf32-86f7409fa899 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:22.178313 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b6d4c-edfb-4ae4-bf32-86f7409fa899 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:22.178802 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b6d4c-edfb-4ae4-bf32-86f7409fa899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:22.198823 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-006b6d4c-edfb-4ae4-bf32-86f7409fa899 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:23:22.200238 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-006b6d4c-edfb-4ae4-bf32-86f7409fa899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:23:22.261244 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1312/2628] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:23:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:23:22.270871 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a76ad2-5ba1-4478-9770-7914bb5a255e admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:22.272298 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-03a76ad2-5ba1-4478-9770-7914bb5a255e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:23:22.286659 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:23:22.334042 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a76ad2-5ba1-4478-9770-7914bb5a255e admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:22.337753 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d7190-5cdf-4502-9c47-cc9ec7a66647 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:22.338445 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d7190-5cdf-4502-9c47-cc9ec7a66647 service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:22.338733 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d7190-5cdf-4502-9c47-cc9ec7a66647 service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:22.339013 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d7190-5cdf-4502-9c47-cc9ec7a66647 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:22.349519 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d7190-5cdf-4502-9c47-cc9ec7a66647 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:22.351007 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d7190-5cdf-4502-9c47-cc9ec7a66647 service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:22.360641 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1317/2629] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:23:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:23:22.647778 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006b6d4c-edfb-4ae4-bf32-86f7409fa899 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:22.649270 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-006b6d4c-edfb-4ae4-bf32-86f7409fa899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:23:22.661156 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006b6d4c-edfb-4ae4-bf32-86f7409fa899 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:22.665895 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2347e41c-f212-41fd-aac2-15525dc5aef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:22.666787 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2347e41c-f212-41fd-aac2-15525dc5aef3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:22.667086 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2347e41c-f212-41fd-aac2-15525dc5aef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:22.667346 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2347e41c-f212-41fd-aac2-15525dc5aef3 admin admin] PATH_INFO: `/v3/projects/49ee5e95227548e4bfb2b8585476d8ad` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:22.668551 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2347e41c-f212-41fd-aac2-15525dc5aef3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49ee5e95227548e4bfb2b8585476d8ad)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:22.670656 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2347e41c-f212-41fd-aac2-15525dc5aef3 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:22.727075 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-2347e41c-f212-41fd-aac2-15525dc5aef3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49ee5e95227548e4bfb2b8585476d8ad', 'request_id': 'req-2347e41c-f212-41fd-aac2-15525dc5aef3'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:22.733048 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-2347e41c-f212-41fd-aac2-15525dc5aef3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49ee5e95227548e4bfb2b8585476d8ad', 'request_id': 'req-2347e41c-f212-41fd-aac2-15525dc5aef3'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:22.739262 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-2347e41c-f212-41fd-aac2-15525dc5aef3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49ee5e95227548e4bfb2b8585476d8ad', 'request_id': 'req-2347e41c-f212-41fd-aac2-15525dc5aef3'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:22.755286 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-2347e41c-f212-41fd-aac2-15525dc5aef3 admin admin] The token cache is being invalidate because project 49ee5e95227548e4bfb2b8585476d8ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:23:22.755580 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-2347e41c-f212-41fd-aac2-15525dc5aef3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:22.756385 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-2347e41c-f212-41fd-aac2-15525dc5aef3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:22.757982 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1313/2630] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 09:23:22 2022] DELETE /identity/v3/projects/49ee5e95227548e4bfb2b8585476d8ad => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:23:22.762264 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d7190-5cdf-4502-9c47-cc9ec7a66647 service neutron] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:22.772386 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d7190-5cdf-4502-9c47-cc9ec7a66647 service neutron] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:22.837062 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f00393-60b9-4380-9225-a31ee1b95ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:22.837956 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f00393-60b9-4380-9225-a31ee1b95ab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:22.838275 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f00393-60b9-4380-9225-a31ee1b95ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:22.838556 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f00393-60b9-4380-9225-a31ee1b95ab6 admin admin] PATH_INFO: `/v3/users/a3805c2315e942e8b5e2bacfa4b1c51d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:22.839789 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f00393-60b9-4380-9225-a31ee1b95ab6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3805c2315e942e8b5e2bacfa4b1c51d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:22.841734 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f00393-60b9-4380-9225-a31ee1b95ab6 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:22.892679 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-d7f00393-60b9-4380-9225-a31ee1b95ab6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3805c2315e942e8b5e2bacfa4b1c51d'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:22.899541 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-d7f00393-60b9-4380-9225-a31ee1b95ab6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3805c2315e942e8b5e2bacfa4b1c51d'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:22.900244 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-d7f00393-60b9-4380-9225-a31ee1b95ab6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3805c2315e942e8b5e2bacfa4b1c51d'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:22.907854 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-d7f00393-60b9-4380-9225-a31ee1b95ab6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3805c2315e942e8b5e2bacfa4b1c51d'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:22.908656 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-d7f00393-60b9-4380-9225-a31ee1b95ab6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3805c2315e942e8b5e2bacfa4b1c51d'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:22.927875 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1318/2631] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 09:23:22 2022] DELETE /identity/v3/users/a3805c2315e942e8b5e2bacfa4b1c51d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:23:23.224537 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2347e41c-f212-41fd-aac2-15525dc5aef3 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:23.226102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-2347e41c-f212-41fd-aac2-15525dc5aef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:23:23.241689 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2347e41c-f212-41fd-aac2-15525dc5aef3 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:23.288337 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:23:23.343137 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6d5bd9-fff5-4c8b-933c-bd0cced11dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:23.344278 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d5bd9-fff5-4c8b-933c-bd0cced11dca admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:23.344565 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d5bd9-fff5-4c8b-933c-bd0cced11dca admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:23.344845 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d5bd9-fff5-4c8b-933c-bd0cced11dca admin admin] PATH_INFO: `/v3/projects/32f8b1062d824a3ea69edfd374e3c507` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:23.346120 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6d5bd9-fff5-4c8b-933c-bd0cced11dca admin admin] RBAC: Authorizing `identity:delete_project(project_id=32f8b1062d824a3ea69edfd374e3c507)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:23.348074 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6d5bd9-fff5-4c8b-933c-bd0cced11dca admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:23.400302 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-ab6d5bd9-fff5-4c8b-933c-bd0cced11dca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32f8b1062d824a3ea69edfd374e3c507', 'request_id': 'req-ab6d5bd9-fff5-4c8b-933c-bd0cced11dca'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:23.406208 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-ab6d5bd9-fff5-4c8b-933c-bd0cced11dca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32f8b1062d824a3ea69edfd374e3c507', 'request_id': 'req-ab6d5bd9-fff5-4c8b-933c-bd0cced11dca'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:23.412467 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-ab6d5bd9-fff5-4c8b-933c-bd0cced11dca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32f8b1062d824a3ea69edfd374e3c507', 'request_id': 'req-ab6d5bd9-fff5-4c8b-933c-bd0cced11dca'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:23.430277 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-ab6d5bd9-fff5-4c8b-933c-bd0cced11dca admin admin] The token cache is being invalidate because project 32f8b1062d824a3ea69edfd374e3c507 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:23:23.430277 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-ab6d5bd9-fff5-4c8b-933c-bd0cced11dca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:23.430277 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-ab6d5bd9-fff5-4c8b-933c-bd0cced11dca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:23.430277 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1314/2632] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 09:23:23 2022] DELETE /identity/v3/projects/32f8b1062d824a3ea69edfd374e3c507 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:23:23.432661 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f00393-60b9-4380-9225-a31ee1b95ab6 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:23.434828 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-d7f00393-60b9-4380-9225-a31ee1b95ab6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:23:23.448065 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f00393-60b9-4380-9225-a31ee1b95ab6 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:23.484272 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:23:23.511701 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bac746-96cd-4451-809a-1023ee6b12b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:23.512529 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bac746-96cd-4451-809a-1023ee6b12b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:23.512817 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bac746-96cd-4451-809a-1023ee6b12b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:23.513095 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bac746-96cd-4451-809a-1023ee6b12b7 admin admin] PATH_INFO: `/v3/users/9d56f82b86084dad86673a9595ec87f0` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:23.514324 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bac746-96cd-4451-809a-1023ee6b12b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d56f82b86084dad86673a9595ec87f0)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:23.516256 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bac746-96cd-4451-809a-1023ee6b12b7 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:23.563147 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-18bac746-96cd-4451-809a-1023ee6b12b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d56f82b86084dad86673a9595ec87f0'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:23.570169 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-18bac746-96cd-4451-809a-1023ee6b12b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d56f82b86084dad86673a9595ec87f0'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:23.570870 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-18bac746-96cd-4451-809a-1023ee6b12b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d56f82b86084dad86673a9595ec87f0'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:23.579440 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-18bac746-96cd-4451-809a-1023ee6b12b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d56f82b86084dad86673a9595ec87f0'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:23.580223 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-18bac746-96cd-4451-809a-1023ee6b12b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d56f82b86084dad86673a9595ec87f0'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:23.599413 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1319/2633] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 09:23:23 2022] DELETE /identity/v3/users/9d56f82b86084dad86673a9595ec87f0 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:23:23.877808 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6d5bd9-fff5-4c8b-933c-bd0cced11dca admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:23.879565 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-ab6d5bd9-fff5-4c8b-933c-bd0cced11dca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:23:23.892918 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6d5bd9-fff5-4c8b-933c-bd0cced11dca admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:23.951933 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee71f9-6e8f-4c8f-a671-0113ad03e2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:23.952805 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee71f9-6e8f-4c8f-a671-0113ad03e2e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:23.953090 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee71f9-6e8f-4c8f-a671-0113ad03e2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:23.953369 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee71f9-6e8f-4c8f-a671-0113ad03e2e6 admin admin] PATH_INFO: `/v3/projects/d29e8610bbfe42d686e479dc4216cf34` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:23.954587 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ee71f9-6e8f-4c8f-a671-0113ad03e2e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d29e8610bbfe42d686e479dc4216cf34)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:23.956497 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ee71f9-6e8f-4c8f-a671-0113ad03e2e6 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:24.003099 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-b7ee71f9-6e8f-4c8f-a671-0113ad03e2e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd29e8610bbfe42d686e479dc4216cf34', 'request_id': 'req-b7ee71f9-6e8f-4c8f-a671-0113ad03e2e6'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:24.007181 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:23:24.009545 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-b7ee71f9-6e8f-4c8f-a671-0113ad03e2e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd29e8610bbfe42d686e479dc4216cf34', 'request_id': 'req-b7ee71f9-6e8f-4c8f-a671-0113ad03e2e6'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:24.017583 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-b7ee71f9-6e8f-4c8f-a671-0113ad03e2e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd29e8610bbfe42d686e479dc4216cf34', 'request_id': 'req-b7ee71f9-6e8f-4c8f-a671-0113ad03e2e6'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:24.031358 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-b7ee71f9-6e8f-4c8f-a671-0113ad03e2e6 admin admin] The token cache is being invalidate because project d29e8610bbfe42d686e479dc4216cf34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:23:24.031647 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-b7ee71f9-6e8f-4c8f-a671-0113ad03e2e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:24.032292 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-b7ee71f9-6e8f-4c8f-a671-0113ad03e2e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:24.033829 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1315/2634] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 09:23:23 2022] DELETE /identity/v3/projects/d29e8610bbfe42d686e479dc4216cf34 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:23:24.039780 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40339d4-daed-4f39-b5ef-961d72682278 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:24.040075 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40339d4-daed-4f39-b5ef-961d72682278 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:24.040359 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40339d4-daed-4f39-b5ef-961d72682278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:24.059179 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-d40339d4-daed-4f39-b5ef-961d72682278 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:23:24.060376 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-d40339d4-daed-4f39-b5ef-961d72682278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:23:24.124134 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1320/2635] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:23:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:23:24.133844 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e856ee21-9630-4b1e-b459-0cf6fa5336e4 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:24.134171 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e856ee21-9630-4b1e-b459-0cf6fa5336e4 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:24.134452 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e856ee21-9630-4b1e-b459-0cf6fa5336e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:24.152868 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-e856ee21-9630-4b1e-b459-0cf6fa5336e4 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:23:24.154628 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-e856ee21-9630-4b1e-b459-0cf6fa5336e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:23:24.162603 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1316/2636] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:23:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:23:24.166844 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40339d4-daed-4f39-b5ef-961d72682278 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:24.177429 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40339d4-daed-4f39-b5ef-961d72682278 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:24.182045 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6afc1f-90ea-4d4d-91bf-8b5b88e2a55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:24.182728 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6afc1f-90ea-4d4d-91bf-8b5b88e2a55d admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:24.183017 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6afc1f-90ea-4d4d-91bf-8b5b88e2a55d admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:24.183296 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6afc1f-90ea-4d4d-91bf-8b5b88e2a55d admin admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:24.184032 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6afc1f-90ea-4d4d-91bf-8b5b88e2a55d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:23:24.184345 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6afc1f-90ea-4d4d-91bf-8b5b88e2a55d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:24.185946 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6afc1f-90ea-4d4d-91bf-8b5b88e2a55d admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:24.197617 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1321/2637] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Jun 22 09:23:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:23:24.202433 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e856ee21-9630-4b1e-b459-0cf6fa5336e4 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:24.212404 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e856ee21-9630-4b1e-b459-0cf6fa5336e4 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:24.217682 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae1b126-9861-4150-b9fa-b829b223e102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:24.218376 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1b126-9861-4150-b9fa-b829b223e102 admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:24.218659 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1b126-9861-4150-b9fa-b829b223e102 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:24.219137 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1b126-9861-4150-b9fa-b829b223e102 admin admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:24.219622 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae1b126-9861-4150-b9fa-b829b223e102 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:24.221543 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae1b126-9861-4150-b9fa-b829b223e102 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:24.250860 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1317/2638] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 09:23:24 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:23:24.252575 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6afc1f-90ea-4d4d-91bf-8b5b88e2a55d admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:24.265454 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6afc1f-90ea-4d4d-91bf-8b5b88e2a55d admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:24.309812 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:23:24.330176 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1957e1-5e48-4cf9-a436-be7224c130f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:24.330855 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1957e1-5e48-4cf9-a436-be7224c130f5 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:24.331142 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1957e1-5e48-4cf9-a436-be7224c130f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:24.331423 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1957e1-5e48-4cf9-a436-be7224c130f5 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:24.332125 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1957e1-5e48-4cf9-a436-be7224c130f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:24.334070 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1957e1-5e48-4cf9-a436-be7224c130f5 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:24.358474 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1322/2639] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 09:23:24 2022] POST /identity/v3/users => generated 287 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:23:24.362999 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae1b126-9861-4150-b9fa-b829b223e102 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:24.374245 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae1b126-9861-4150-b9fa-b829b223e102 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:24.380305 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7d38a-e630-4fca-9829-d6d712c2446e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:24.381525 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7d38a-e630-4fca-9829-d6d712c2446e admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:24.381525 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7d38a-e630-4fca-9829-d6d712c2446e admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:24.381525 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7d38a-e630-4fca-9829-d6d712c2446e admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:24.382065 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a7d38a-e630-4fca-9829-d6d712c2446e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:24.383775 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a7d38a-e630-4fca-9829-d6d712c2446e admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:24.396128 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1318/2640] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 09:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:23:24.400107 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1957e1-5e48-4cf9-a436-be7224c130f5 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:24.411894 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1957e1-5e48-4cf9-a436-be7224c130f5 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:24.416666 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d2de70-684a-417f-bc1b-c8f40fbc9405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:24.417352 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d2de70-684a-417f-bc1b-c8f40fbc9405 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:24.417645 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d2de70-684a-417f-bc1b-c8f40fbc9405 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:24.417915 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d2de70-684a-417f-bc1b-c8f40fbc9405 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:24.418692 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d2de70-684a-417f-bc1b-c8f40fbc9405 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:24.420392 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d2de70-684a-417f-bc1b-c8f40fbc9405 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:24.432247 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1323/2641] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 09:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:23:24.436612 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7d38a-e630-4fca-9829-d6d712c2446e admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:24.447043 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7d38a-e630-4fca-9829-d6d712c2446e admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:24.452829 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33138274-d3df-4749-a286-4f73e5ddb1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:24.453726 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33138274-d3df-4749-a286-4f73e5ddb1e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:24.454005 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33138274-d3df-4749-a286-4f73e5ddb1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:24.454320 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33138274-d3df-4749-a286-4f73e5ddb1e9 admin admin] PATH_INFO: `/v3/projects/6f6c6d1808c6474dbef87ac330fc99c8/users/ffc94956ffae481581487dd75f2e05d4/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:24.473840 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33138274-d3df-4749-a286-4f73e5ddb1e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f6c6d1808c6474dbef87ac330fc99c8, user_id=ffc94956ffae481581487dd75f2e05d4, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:24.476556 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33138274-d3df-4749-a286-4f73e5ddb1e9 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:24.490558 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1319/2642] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 09:23:24 2022] PUT /identity/v3/projects/6f6c6d1808c6474dbef87ac330fc99c8/users/ffc94956ffae481581487dd75f2e05d4/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:23:24.502870 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bda95d-880e-4e47-8fda-4b4bf05bf9b3 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:24.503348 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bda95d-880e-4e47-8fda-4b4bf05bf9b3 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:24.503631 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bda95d-880e-4e47-8fda-4b4bf05bf9b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:24.535067 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-30bda95d-880e-4e47-8fda-4b4bf05bf9b3 None None] MFA Rules not processed for user `ffc94956ffae481581487dd75f2e05d4`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:23:24.536294 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-30bda95d-880e-4e47-8fda-4b4bf05bf9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:23:24.607381 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1324/2643] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:23:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:23:24.619334 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33138274-d3df-4749-a286-4f73e5ddb1e9 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:24.621609 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-33138274-d3df-4749-a286-4f73e5ddb1e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:23:24.684122 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33138274-d3df-4749-a286-4f73e5ddb1e9 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:24.688728 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec457d70-aaab-4e4c-874a-b20ad27cca63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:24.689274 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec457d70-aaab-4e4c-874a-b20ad27cca63 service cinder] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:24.689563 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec457d70-aaab-4e4c-874a-b20ad27cca63 service cinder] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:24.689845 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec457d70-aaab-4e4c-874a-b20ad27cca63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:24.700786 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec457d70-aaab-4e4c-874a-b20ad27cca63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:24.702817 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec457d70-aaab-4e4c-874a-b20ad27cca63 service cinder] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:24.720186 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1320/2644] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:23:24 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:23:24.739843 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bda95d-880e-4e47-8fda-4b4bf05bf9b3 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:24.808578 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bda95d-880e-4e47-8fda-4b4bf05bf9b3 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:24.813369 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab06e48-dbaa-45af-add3-b1e8568f7f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:24.814261 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab06e48-dbaa-45af-add3-b1e8568f7f9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:24.814545 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab06e48-dbaa-45af-add3-b1e8568f7f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:24.814819 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab06e48-dbaa-45af-add3-b1e8568f7f9d admin admin] PATH_INFO: `/v3/users/ffc94956ffae481581487dd75f2e05d4` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:24.816031 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab06e48-dbaa-45af-add3-b1e8568f7f9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffc94956ffae481581487dd75f2e05d4)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:24.817946 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab06e48-dbaa-45af-add3-b1e8568f7f9d admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:24.871700 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-0ab06e48-dbaa-45af-add3-b1e8568f7f9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffc94956ffae481581487dd75f2e05d4'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:24.876671 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:23:24.879650 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-0ab06e48-dbaa-45af-add3-b1e8568f7f9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffc94956ffae481581487dd75f2e05d4'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:24.880412 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-0ab06e48-dbaa-45af-add3-b1e8568f7f9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffc94956ffae481581487dd75f2e05d4'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:24.888740 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-0ab06e48-dbaa-45af-add3-b1e8568f7f9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffc94956ffae481581487dd75f2e05d4'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:24.889640 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-0ab06e48-dbaa-45af-add3-b1e8568f7f9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffc94956ffae481581487dd75f2e05d4'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:24.908904 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1325/2645] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 09:23:24 2022] DELETE /identity/v3/users/ffc94956ffae481581487dd75f2e05d4 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:23:24.913613 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd11b85-43d2-4844-8b48-4741de78254f None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:24.913980 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd11b85-43d2-4844-8b48-4741de78254f None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:24.914635 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd11b85-43d2-4844-8b48-4741de78254f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:24.932515 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-4cd11b85-43d2-4844-8b48-4741de78254f None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:23:24.933703 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-4cd11b85-43d2-4844-8b48-4741de78254f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:23:24.992062 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1321/2646] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:23:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:23:25.002055 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab06e48-dbaa-45af-add3-b1e8568f7f9d admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:25.003513 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-0ab06e48-dbaa-45af-add3-b1e8568f7f9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:23:25.060902 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab06e48-dbaa-45af-add3-b1e8568f7f9d admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:25.064569 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e8d63a-e68a-47dd-9f4c-c0c2dcfb1277 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:25.065211 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e8d63a-e68a-47dd-9f4c-c0c2dcfb1277 service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:25.065498 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e8d63a-e68a-47dd-9f4c-c0c2dcfb1277 service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:25.065775 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e8d63a-e68a-47dd-9f4c-c0c2dcfb1277 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:25.075406 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e8d63a-e68a-47dd-9f4c-c0c2dcfb1277 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:25.076837 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e8d63a-e68a-47dd-9f4c-c0c2dcfb1277 service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:25.086277 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1326/2647] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:23:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:23:25.370467 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd11b85-43d2-4844-8b48-4741de78254f None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:25.371922 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-4cd11b85-43d2-4844-8b48-4741de78254f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:23:25.385699 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd11b85-43d2-4844-8b48-4741de78254f None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:25.391120 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664add50-331d-4d31-9c0b-cf782b4bd4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:25.392021 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664add50-331d-4d31-9c0b-cf782b4bd4c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:25.392310 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664add50-331d-4d31-9c0b-cf782b4bd4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:25.392591 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664add50-331d-4d31-9c0b-cf782b4bd4c6 admin admin] PATH_INFO: `/v3/projects/6f6c6d1808c6474dbef87ac330fc99c8` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:25.393799 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664add50-331d-4d31-9c0b-cf782b4bd4c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f6c6d1808c6474dbef87ac330fc99c8)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:25.395788 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664add50-331d-4d31-9c0b-cf782b4bd4c6 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:25.415088 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:23:25.445286 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-664add50-331d-4d31-9c0b-cf782b4bd4c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f6c6d1808c6474dbef87ac330fc99c8', 'request_id': 'req-664add50-331d-4d31-9c0b-cf782b4bd4c6'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:25.450698 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-664add50-331d-4d31-9c0b-cf782b4bd4c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f6c6d1808c6474dbef87ac330fc99c8', 'request_id': 'req-664add50-331d-4d31-9c0b-cf782b4bd4c6'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:25.456829 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-664add50-331d-4d31-9c0b-cf782b4bd4c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f6c6d1808c6474dbef87ac330fc99c8', 'request_id': 'req-664add50-331d-4d31-9c0b-cf782b4bd4c6'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:25.470048 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-664add50-331d-4d31-9c0b-cf782b4bd4c6 admin admin] The token cache is being invalidate because project 6f6c6d1808c6474dbef87ac330fc99c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:23:25.470368 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-664add50-331d-4d31-9c0b-cf782b4bd4c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:25.470982 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-664add50-331d-4d31-9c0b-cf782b4bd4c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:25.472509 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1322/2648] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 09:23:25 2022] DELETE /identity/v3/projects/6f6c6d1808c6474dbef87ac330fc99c8 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:23:25.477405 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4b07b-6189-4291-aa05-0059eff13f59 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:25.477696 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4b07b-6189-4291-aa05-0059eff13f59 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:25.477972 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4b07b-6189-4291-aa05-0059eff13f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:25.496312 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-03c4b07b-6189-4291-aa05-0059eff13f59 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:23:25.497573 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-03c4b07b-6189-4291-aa05-0059eff13f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:23:25.557199 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1327/2649] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:23:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:23:25.565040 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452e15a-0dba-4f8a-b5fe-dccc80a0dcd3 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:25.565334 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452e15a-0dba-4f8a-b5fe-dccc80a0dcd3 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:25.565617 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452e15a-0dba-4f8a-b5fe-dccc80a0dcd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:25.584701 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-f452e15a-0dba-4f8a-b5fe-dccc80a0dcd3 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:23:25.585945 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-f452e15a-0dba-4f8a-b5fe-dccc80a0dcd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:23:25.594443 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1323/2650] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:23:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:23:25.598597 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c4b07b-6189-4291-aa05-0059eff13f59 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:25.608995 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c4b07b-6189-4291-aa05-0059eff13f59 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:25.613577 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a14710-f5a4-4a8a-b2d8-f2ded93060e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:25.614189 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a14710-f5a4-4a8a-b2d8-f2ded93060e6 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:25.614472 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a14710-f5a4-4a8a-b2d8-f2ded93060e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:25.614744 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a14710-f5a4-4a8a-b2d8-f2ded93060e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:25.615461 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a14710-f5a4-4a8a-b2d8-f2ded93060e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:23:25.615767 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a14710-f5a4-4a8a-b2d8-f2ded93060e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:25.617356 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a14710-f5a4-4a8a-b2d8-f2ded93060e6 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:25.629128 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1328/2651] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Jun 22 09:23:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:23:25.633196 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f452e15a-0dba-4f8a-b5fe-dccc80a0dcd3 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:25.642497 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f452e15a-0dba-4f8a-b5fe-dccc80a0dcd3 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:25.647211 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd93034e-8f06-475f-9a35-f2ab294a8404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:25.647852 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93034e-8f06-475f-9a35-f2ab294a8404 admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:25.648138 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93034e-8f06-475f-9a35-f2ab294a8404 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:25.648416 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93034e-8f06-475f-9a35-f2ab294a8404 admin admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:25.649105 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd93034e-8f06-475f-9a35-f2ab294a8404 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:25.651052 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd93034e-8f06-475f-9a35-f2ab294a8404 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:25.677889 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1324/2652] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 09:23:25 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:23:25.682476 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a14710-f5a4-4a8a-b2d8-f2ded93060e6 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:25.693253 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a14710-f5a4-4a8a-b2d8-f2ded93060e6 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:25.759358 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04085fc-fe70-4a1a-ae31-2acd42d06d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:25.760132 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04085fc-fe70-4a1a-ae31-2acd42d06d04 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:25.760421 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04085fc-fe70-4a1a-ae31-2acd42d06d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:25.760697 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04085fc-fe70-4a1a-ae31-2acd42d06d04 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:25.761386 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04085fc-fe70-4a1a-ae31-2acd42d06d04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:25.764093 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04085fc-fe70-4a1a-ae31-2acd42d06d04 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:25.770905 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:23:25.790240 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1329/2653] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 09:23:25 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:23:25.795249 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd93034e-8f06-475f-9a35-f2ab294a8404 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:25.805723 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd93034e-8f06-475f-9a35-f2ab294a8404 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:25.811337 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f595fd8-0d98-4189-a64d-97c4473215b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:25.812005 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f595fd8-0d98-4189-a64d-97c4473215b8 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:25.812318 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f595fd8-0d98-4189-a64d-97c4473215b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:25.812590 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f595fd8-0d98-4189-a64d-97c4473215b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:25.813324 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f595fd8-0d98-4189-a64d-97c4473215b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:25.814944 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f595fd8-0d98-4189-a64d-97c4473215b8 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:25.825959 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1325/2654] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 09:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:23:25.830008 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04085fc-fe70-4a1a-ae31-2acd42d06d04 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:25.840726 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04085fc-fe70-4a1a-ae31-2acd42d06d04 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:25.845557 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e1001-3721-4e2a-b0ee-72932a779f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:25.846266 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e1001-3721-4e2a-b0ee-72932a779f7b admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:25.846555 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e1001-3721-4e2a-b0ee-72932a779f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:25.846836 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e1001-3721-4e2a-b0ee-72932a779f7b admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:25.847575 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86e1001-3721-4e2a-b0ee-72932a779f7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:25.849757 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86e1001-3721-4e2a-b0ee-72932a779f7b admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:25.860675 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1330/2655] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 09:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:23:25.864950 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f595fd8-0d98-4189-a64d-97c4473215b8 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:25.876577 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f595fd8-0d98-4189-a64d-97c4473215b8 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:25.881320 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2859c4f3-5852-4c9d-b72b-fb9f76da4112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:25.882250 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2859c4f3-5852-4c9d-b72b-fb9f76da4112 admin admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:25.882537 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2859c4f3-5852-4c9d-b72b-fb9f76da4112 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:25.882815 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2859c4f3-5852-4c9d-b72b-fb9f76da4112 admin admin] PATH_INFO: `/v3/projects/0ec029e27c8748249fdc88dc47b24d5d/users/730ffa9df73744a7ad258f4351b9fa83/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:25.897970 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2859c4f3-5852-4c9d-b72b-fb9f76da4112 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ec029e27c8748249fdc88dc47b24d5d, user_id=730ffa9df73744a7ad258f4351b9fa83, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:25.900659 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2859c4f3-5852-4c9d-b72b-fb9f76da4112 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:25.914635 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1326/2656] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 09:23:25 2022] PUT /identity/v3/projects/0ec029e27c8748249fdc88dc47b24d5d/users/730ffa9df73744a7ad258f4351b9fa83/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:23:25.926334 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc6352-edab-4f32-a497-ce66a47886e1 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:25.926625 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc6352-edab-4f32-a497-ce66a47886e1 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:25.926906 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc6352-edab-4f32-a497-ce66a47886e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:25.954712 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-9ccc6352-edab-4f32-a497-ce66a47886e1 None None] MFA Rules not processed for user `730ffa9df73744a7ad258f4351b9fa83`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:23:25.955919 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-9ccc6352-edab-4f32-a497-ce66a47886e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:23:26.022442 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1331/2657] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:23:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:23:26.033335 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2859c4f3-5852-4c9d-b72b-fb9f76da4112 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:26.035026 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-2859c4f3-5852-4c9d-b72b-fb9f76da4112 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:23:26.092255 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2859c4f3-5852-4c9d-b72b-fb9f76da4112 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:26.095986 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58615d8-12d5-4278-9d15-74d1aaad3308 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:26.096637 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58615d8-12d5-4278-9d15-74d1aaad3308 service cinder] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:26.096923 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58615d8-12d5-4278-9d15-74d1aaad3308 service cinder] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:26.097205 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58615d8-12d5-4278-9d15-74d1aaad3308 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:26.105858 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58615d8-12d5-4278-9d15-74d1aaad3308 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:26.107973 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58615d8-12d5-4278-9d15-74d1aaad3308 service cinder] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:26.117080 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1327/2658] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:23:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:23:34.553359 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc6352-edab-4f32-a497-ce66a47886e1 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:34.631219 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc6352-edab-4f32-a497-ce66a47886e1 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:34.635978 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1f1e9d-8900-4d37-9269-f1070ad21b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:34.636847 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f1e9d-8900-4d37-9269-f1070ad21b28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:34.637806 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f1e9d-8900-4d37-9269-f1070ad21b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:34.638101 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f1e9d-8900-4d37-9269-f1070ad21b28 admin admin] PATH_INFO: `/v3/users/730ffa9df73744a7ad258f4351b9fa83` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:34.639332 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1f1e9d-8900-4d37-9269-f1070ad21b28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=730ffa9df73744a7ad258f4351b9fa83)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:34.641272 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1f1e9d-8900-4d37-9269-f1070ad21b28 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:34.689115 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-7b1f1e9d-8900-4d37-9269-f1070ad21b28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '730ffa9df73744a7ad258f4351b9fa83'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:34.696085 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-7b1f1e9d-8900-4d37-9269-f1070ad21b28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '730ffa9df73744a7ad258f4351b9fa83'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:34.696928 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-7b1f1e9d-8900-4d37-9269-f1070ad21b28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '730ffa9df73744a7ad258f4351b9fa83'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:34.705854 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-7b1f1e9d-8900-4d37-9269-f1070ad21b28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '730ffa9df73744a7ad258f4351b9fa83'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:34.707649 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-7b1f1e9d-8900-4d37-9269-f1070ad21b28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '730ffa9df73744a7ad258f4351b9fa83'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:34.713918 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:INSERT=4,keystone:SELECT=87,keystone:DELETE=9 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:23:34.728186 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1332/2659] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 09:23:34 2022] DELETE /identity/v3/users/730ffa9df73744a7ad258f4351b9fa83 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:23:34.733434 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee4d0bc-015f-422e-82a7-b4d39b2efe0d None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:34.733920 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee4d0bc-015f-422e-82a7-b4d39b2efe0d None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:34.734011 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee4d0bc-015f-422e-82a7-b4d39b2efe0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:34.752978 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-dee4d0bc-015f-422e-82a7-b4d39b2efe0d None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:23:34.754252 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-dee4d0bc-015f-422e-82a7-b4d39b2efe0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:23:34.796426 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:23:34.817465 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1328/2660] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:23:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:23:34.827989 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1f1e9d-8900-4d37-9269-f1070ad21b28 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:34.830155 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-7b1f1e9d-8900-4d37-9269-f1070ad21b28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:23:34.903091 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1f1e9d-8900-4d37-9269-f1070ad21b28 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:34.906827 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cedcb3-3c9e-45f7-8684-8aac7a315439 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:34.907513 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cedcb3-3c9e-45f7-8684-8aac7a315439 service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:34.907846 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cedcb3-3c9e-45f7-8684-8aac7a315439 service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:34.908124 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cedcb3-3c9e-45f7-8684-8aac7a315439 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:34.918025 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cedcb3-3c9e-45f7-8684-8aac7a315439 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:34.920029 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cedcb3-3c9e-45f7-8684-8aac7a315439 service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:34.930051 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1333/2661] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:23:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:23:35.233244 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee4d0bc-015f-422e-82a7-b4d39b2efe0d None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:35.234764 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-dee4d0bc-015f-422e-82a7-b4d39b2efe0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:23:35.259243 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee4d0bc-015f-422e-82a7-b4d39b2efe0d None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:35.266758 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aa1c7b-ccbf-48cb-8945-ef5ec9835b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:35.267931 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa1c7b-ccbf-48cb-8945-ef5ec9835b09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:35.268303 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa1c7b-ccbf-48cb-8945-ef5ec9835b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:35.268610 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa1c7b-ccbf-48cb-8945-ef5ec9835b09 admin admin] PATH_INFO: `/v3/projects/0ec029e27c8748249fdc88dc47b24d5d` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:35.269982 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aa1c7b-ccbf-48cb-8945-ef5ec9835b09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ec029e27c8748249fdc88dc47b24d5d)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:35.271945 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aa1c7b-ccbf-48cb-8945-ef5ec9835b09 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:35.322303 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-96aa1c7b-ccbf-48cb-8945-ef5ec9835b09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ec029e27c8748249fdc88dc47b24d5d', 'request_id': 'req-96aa1c7b-ccbf-48cb-8945-ef5ec9835b09'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:35.329382 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-96aa1c7b-ccbf-48cb-8945-ef5ec9835b09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ec029e27c8748249fdc88dc47b24d5d', 'request_id': 'req-96aa1c7b-ccbf-48cb-8945-ef5ec9835b09'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:35.335910 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-96aa1c7b-ccbf-48cb-8945-ef5ec9835b09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ec029e27c8748249fdc88dc47b24d5d', 'request_id': 'req-96aa1c7b-ccbf-48cb-8945-ef5ec9835b09'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:35.368831 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-96aa1c7b-ccbf-48cb-8945-ef5ec9835b09 admin admin] The token cache is being invalidate because project 0ec029e27c8748249fdc88dc47b24d5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:23:35.369129 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-96aa1c7b-ccbf-48cb-8945-ef5ec9835b09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:35.370023 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-96aa1c7b-ccbf-48cb-8945-ef5ec9835b09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:35.372036 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1329/2662] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 09:23:35 2022] DELETE /identity/v3/projects/0ec029e27c8748249fdc88dc47b24d5d => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:23:35.377247 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063cdd2-ecb8-4c88-81e1-a82aeedb1245 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:35.377537 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063cdd2-ecb8-4c88-81e1-a82aeedb1245 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:35.377814 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063cdd2-ecb8-4c88-81e1-a82aeedb1245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:35.397676 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-4063cdd2-ecb8-4c88-81e1-a82aeedb1245 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:23:35.398925 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-4063cdd2-ecb8-4c88-81e1-a82aeedb1245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:23:35.465071 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1334/2663] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:23:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:23:35.473105 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d55d7-24b3-4fb7-b28d-4c0960d3ff2d None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:35.473392 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d55d7-24b3-4fb7-b28d-4c0960d3ff2d None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:35.473670 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d55d7-24b3-4fb7-b28d-4c0960d3ff2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:35.493785 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-e62d55d7-24b3-4fb7-b28d-4c0960d3ff2d None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:23:35.495058 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-e62d55d7-24b3-4fb7-b28d-4c0960d3ff2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:23:35.504103 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1330/2664] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:23:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:23:35.508386 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4063cdd2-ecb8-4c88-81e1-a82aeedb1245 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:35.518408 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4063cdd2-ecb8-4c88-81e1-a82aeedb1245 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:35.523042 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68dd2cc-d687-42c8-80ac-5de3dab7fc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:35.523703 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68dd2cc-d687-42c8-80ac-5de3dab7fc00 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:35.523987 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68dd2cc-d687-42c8-80ac-5de3dab7fc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:35.524264 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68dd2cc-d687-42c8-80ac-5de3dab7fc00 admin admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:35.525001 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68dd2cc-d687-42c8-80ac-5de3dab7fc00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:23:35.525308 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68dd2cc-d687-42c8-80ac-5de3dab7fc00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:35.526963 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68dd2cc-d687-42c8-80ac-5de3dab7fc00 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:35.540056 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1335/2665] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Jun 22 09:23:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:23:35.545052 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d55d7-24b3-4fb7-b28d-4c0960d3ff2d None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:35.554655 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d55d7-24b3-4fb7-b28d-4c0960d3ff2d None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:35.560077 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f5bfa8-c6b1-43ae-84e6-099feaf19358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:35.560734 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f5bfa8-c6b1-43ae-84e6-099feaf19358 admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:35.561016 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f5bfa8-c6b1-43ae-84e6-099feaf19358 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:35.561290 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f5bfa8-c6b1-43ae-84e6-099feaf19358 admin admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:35.561986 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f5bfa8-c6b1-43ae-84e6-099feaf19358 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:35.563925 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f5bfa8-c6b1-43ae-84e6-099feaf19358 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:35.590889 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1331/2666] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 09:23:35 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:23:35.595073 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68dd2cc-d687-42c8-80ac-5de3dab7fc00 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:35.605228 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68dd2cc-d687-42c8-80ac-5de3dab7fc00 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:35.667758 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbcfa17-1122-4b0e-9169-ef63a9a93f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:35.668986 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbcfa17-1122-4b0e-9169-ef63a9a93f7b admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:35.669264 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbcfa17-1122-4b0e-9169-ef63a9a93f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:35.669540 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbcfa17-1122-4b0e-9169-ef63a9a93f7b admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:35.670261 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbcfa17-1122-4b0e-9169-ef63a9a93f7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:35.672248 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbcfa17-1122-4b0e-9169-ef63a9a93f7b admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:35.693416 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1336/2667] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 09:23:35 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:23:35.697936 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f5bfa8-c6b1-43ae-84e6-099feaf19358 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:35.709263 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f5bfa8-c6b1-43ae-84e6-099feaf19358 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:35.713871 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd6e1a-ee37-4383-901d-14eeaf1fb430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:35.714575 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd6e1a-ee37-4383-901d-14eeaf1fb430 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:35.714872 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd6e1a-ee37-4383-901d-14eeaf1fb430 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:35.715815 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd6e1a-ee37-4383-901d-14eeaf1fb430 admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:35.716556 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbd6e1a-ee37-4383-901d-14eeaf1fb430 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:35.718183 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbd6e1a-ee37-4383-901d-14eeaf1fb430 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:35.731811 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1332/2668] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 09:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:23:35.735988 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbcfa17-1122-4b0e-9169-ef63a9a93f7b admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:35.746744 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbcfa17-1122-4b0e-9169-ef63a9a93f7b admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:35.751711 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d2015-8633-4e96-8a2f-c49ca06c0bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:35.752385 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d2015-8633-4e96-8a2f-c49ca06c0bbb admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:35.752674 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d2015-8633-4e96-8a2f-c49ca06c0bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:35.752952 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d2015-8633-4e96-8a2f-c49ca06c0bbb admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:35.753688 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578d2015-8633-4e96-8a2f-c49ca06c0bbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:35.755352 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578d2015-8633-4e96-8a2f-c49ca06c0bbb admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:35.756844 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:23:35.769139 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1337/2669] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 09:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:23:35.773461 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd6e1a-ee37-4383-901d-14eeaf1fb430 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:35.784573 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd6e1a-ee37-4383-901d-14eeaf1fb430 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:35.789246 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f648491-f583-4135-9b5d-774e4f718725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:35.790162 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f648491-f583-4135-9b5d-774e4f718725 admin admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:35.790448 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f648491-f583-4135-9b5d-774e4f718725 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:35.790728 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f648491-f583-4135-9b5d-774e4f718725 admin admin] PATH_INFO: `/v3/projects/3b14569992fb4ca6a4ec2d60d34f007e/users/005e9669d7b14ebd81fe9e394311e031/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:35.805799 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f648491-f583-4135-9b5d-774e4f718725 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b14569992fb4ca6a4ec2d60d34f007e, user_id=005e9669d7b14ebd81fe9e394311e031, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:35.808453 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f648491-f583-4135-9b5d-774e4f718725 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:35.823912 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1333/2670] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 09:23:35 2022] PUT /identity/v3/projects/3b14569992fb4ca6a4ec2d60d34f007e/users/005e9669d7b14ebd81fe9e394311e031/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:23:35.835928 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00efe2df-7f4d-4ec3-8342-7c8c15d1d4f3 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:35.836220 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00efe2df-7f4d-4ec3-8342-7c8c15d1d4f3 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:35.836528 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00efe2df-7f4d-4ec3-8342-7c8c15d1d4f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:35.864830 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-00efe2df-7f4d-4ec3-8342-7c8c15d1d4f3 None None] MFA Rules not processed for user `005e9669d7b14ebd81fe9e394311e031`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:23:35.865994 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-00efe2df-7f4d-4ec3-8342-7c8c15d1d4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:23:35.935157 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1338/2671] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:23:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:23:35.939791 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f648491-f583-4135-9b5d-774e4f718725 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:36.006887 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f648491-f583-4135-9b5d-774e4f718725 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:36.012496 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2cf6d-55d5-4fcf-a705-80a9d7d59070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:36.013198 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2cf6d-55d5-4fcf-a705-80a9d7d59070 admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:36.013490 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2cf6d-55d5-4fcf-a705-80a9d7d59070 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:36.013772 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2cf6d-55d5-4fcf-a705-80a9d7d59070 admin admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:36.014528 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a2cf6d-55d5-4fcf-a705-80a9d7d59070 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:36.016477 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a2cf6d-55d5-4fcf-a705-80a9d7d59070 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:36.025770 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:23:36.049878 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1334/2672] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 09:23:35 2022] POST /identity/v3/projects => generated 377 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:23:36.055539 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00efe2df-7f4d-4ec3-8342-7c8c15d1d4f3 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:36.066910 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00efe2df-7f4d-4ec3-8342-7c8c15d1d4f3 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:36.127361 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922fb713-e34e-4e56-b363-a372c2ec0ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:36.128044 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922fb713-e34e-4e56-b363-a372c2ec0ba6 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:36.128327 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922fb713-e34e-4e56-b363-a372c2ec0ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:36.128866 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922fb713-e34e-4e56-b363-a372c2ec0ba6 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:36.129358 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922fb713-e34e-4e56-b363-a372c2ec0ba6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:36.131320 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922fb713-e34e-4e56-b363-a372c2ec0ba6 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:36.160193 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1339/2673] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 09:23:36 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:23:36.161682 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2cf6d-55d5-4fcf-a705-80a9d7d59070 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:36.172563 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2cf6d-55d5-4fcf-a705-80a9d7d59070 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:36.177481 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa697b-9760-4a63-9f9a-17421d27cb5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:36.178198 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa697b-9760-4a63-9f9a-17421d27cb5e admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:36.178481 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa697b-9760-4a63-9f9a-17421d27cb5e admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:36.178757 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa697b-9760-4a63-9f9a-17421d27cb5e admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:36.179489 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aa697b-9760-4a63-9f9a-17421d27cb5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:36.181088 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aa697b-9760-4a63-9f9a-17421d27cb5e admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:36.193198 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1335/2674] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 09:23:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:23:36.197257 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922fb713-e34e-4e56-b363-a372c2ec0ba6 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:36.208829 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922fb713-e34e-4e56-b363-a372c2ec0ba6 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:36.213677 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9da5f6-bf5a-4e5f-be41-896f9d9e8cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:36.214377 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9da5f6-bf5a-4e5f-be41-896f9d9e8cdc admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:36.214665 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9da5f6-bf5a-4e5f-be41-896f9d9e8cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:36.214939 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9da5f6-bf5a-4e5f-be41-896f9d9e8cdc admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:36.215678 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9da5f6-bf5a-4e5f-be41-896f9d9e8cdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:36.217362 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9da5f6-bf5a-4e5f-be41-896f9d9e8cdc admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:36.228007 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1340/2675] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 09:23:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:23:36.232953 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa697b-9760-4a63-9f9a-17421d27cb5e admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:36.244194 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa697b-9760-4a63-9f9a-17421d27cb5e admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:36.250367 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b9daa-5cd1-4547-9cae-82028847b9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:36.251285 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b9daa-5cd1-4547-9cae-82028847b9ca admin admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:36.251594 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b9daa-5cd1-4547-9cae-82028847b9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:36.251876 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b9daa-5cd1-4547-9cae-82028847b9ca admin admin] PATH_INFO: `/v3/projects/350448512b614f279b5a1cf11b0497a6/users/c62cbd629d40412b93805bc9c0ade9a2/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:36.275013 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8b9daa-5cd1-4547-9cae-82028847b9ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=350448512b614f279b5a1cf11b0497a6, user_id=c62cbd629d40412b93805bc9c0ade9a2, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:36.277686 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8b9daa-5cd1-4547-9cae-82028847b9ca admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:36.291480 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1336/2676] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 09:23:36 2022] PUT /identity/v3/projects/350448512b614f279b5a1cf11b0497a6/users/c62cbd629d40412b93805bc9c0ade9a2/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:23:36.302975 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a24a4-6bdf-4fde-b417-25acbb655ec7 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:36.303271 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a24a4-6bdf-4fde-b417-25acbb655ec7 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:36.303559 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a24a4-6bdf-4fde-b417-25acbb655ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:36.334738 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-738a24a4-6bdf-4fde-b417-25acbb655ec7 None None] MFA Rules not processed for user `c62cbd629d40412b93805bc9c0ade9a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:23:36.335955 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-738a24a4-6bdf-4fde-b417-25acbb655ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:23:36.396767 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:23:36.410225 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1341/2677] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:23:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:23:36.414822 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b9daa-5cd1-4547-9cae-82028847b9ca admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:36.483107 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b9daa-5cd1-4547-9cae-82028847b9ca admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:36.488188 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa2e305-d418-4016-bcbf-edeeaa105bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:36.488859 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2e305-d418-4016-bcbf-edeeaa105bec admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:36.489196 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2e305-d418-4016-bcbf-edeeaa105bec admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:36.489421 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2e305-d418-4016-bcbf-edeeaa105bec admin admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:36.490165 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa2e305-d418-4016-bcbf-edeeaa105bec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:36.492110 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa2e305-d418-4016-bcbf-edeeaa105bec admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:36.519967 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1337/2678] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 09:23:36 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:23:36.524151 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738a24a4-6bdf-4fde-b417-25acbb655ec7 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:36.536376 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738a24a4-6bdf-4fde-b417-25acbb655ec7 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:36.594802 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb757d9-4ba9-4ac2-9d8d-51909542789a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:36.595483 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb757d9-4ba9-4ac2-9d8d-51909542789a admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:36.596044 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb757d9-4ba9-4ac2-9d8d-51909542789a admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:36.596044 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb757d9-4ba9-4ac2-9d8d-51909542789a admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:36.596713 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb757d9-4ba9-4ac2-9d8d-51909542789a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:36.598712 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb757d9-4ba9-4ac2-9d8d-51909542789a admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:36.627699 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1342/2679] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 09:23:36 2022] POST /identity/v3/users => generated 295 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:23:36.631751 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa2e305-d418-4016-bcbf-edeeaa105bec admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:36.642522 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa2e305-d418-4016-bcbf-edeeaa105bec admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:36.647336 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788f2be7-004f-4742-aa7a-36d94b3951d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:36.647951 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f2be7-004f-4742-aa7a-36d94b3951d4 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:36.648237 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f2be7-004f-4742-aa7a-36d94b3951d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:36.648517 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f2be7-004f-4742-aa7a-36d94b3951d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:36.649252 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788f2be7-004f-4742-aa7a-36d94b3951d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:36.650897 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788f2be7-004f-4742-aa7a-36d94b3951d4 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:36.662951 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1338/2680] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 09:23:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:23:36.667183 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb757d9-4ba9-4ac2-9d8d-51909542789a admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:36.677613 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb757d9-4ba9-4ac2-9d8d-51909542789a admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:36.682551 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5be594-0982-4769-9e09-c6c24d8b984a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:36.683459 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5be594-0982-4769-9e09-c6c24d8b984a admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:36.684272 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5be594-0982-4769-9e09-c6c24d8b984a admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:36.684554 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5be594-0982-4769-9e09-c6c24d8b984a admin admin] PATH_INFO: `/v3/projects/78f8ff8c211b4bbaa098b3f105231f01/users/35bc3f8ded5f4fff86f54fc34cd5660c/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:36.704779 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5be594-0982-4769-9e09-c6c24d8b984a admin admin] RBAC: Authorizing `identity:create_grant(project_id=78f8ff8c211b4bbaa098b3f105231f01, user_id=35bc3f8ded5f4fff86f54fc34cd5660c, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:36.707800 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5be594-0982-4769-9e09-c6c24d8b984a admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:36.722170 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1343/2681] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 09:23:36 2022] PUT /identity/v3/projects/78f8ff8c211b4bbaa098b3f105231f01/users/35bc3f8ded5f4fff86f54fc34cd5660c/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:23:36.726172 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788f2be7-004f-4742-aa7a-36d94b3951d4 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:36.736795 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788f2be7-004f-4742-aa7a-36d94b3951d4 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:36.797994 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b35d1f1-93a8-4878-9689-c37adbd7ad71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:36.798682 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b35d1f1-93a8-4878-9689-c37adbd7ad71 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:36.798966 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b35d1f1-93a8-4878-9689-c37adbd7ad71 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:36.799238 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b35d1f1-93a8-4878-9689-c37adbd7ad71 admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:36.799961 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b35d1f1-93a8-4878-9689-c37adbd7ad71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:36.801542 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b35d1f1-93a8-4878-9689-c37adbd7ad71 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:36.814611 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1339/2682] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 09:23:36 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:23:36.819374 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5be594-0982-4769-9e09-c6c24d8b984a admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:36.835873 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5be594-0982-4769-9e09-c6c24d8b984a admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:36.840568 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd349ea5-a226-4fbe-9c8b-bd62252e3202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:36.841466 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd349ea5-a226-4fbe-9c8b-bd62252e3202 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:36.841759 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd349ea5-a226-4fbe-9c8b-bd62252e3202 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:36.842039 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd349ea5-a226-4fbe-9c8b-bd62252e3202 admin admin] PATH_INFO: `/v3/projects/78f8ff8c211b4bbaa098b3f105231f01/users/35bc3f8ded5f4fff86f54fc34cd5660c/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:36.844078 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd349ea5-a226-4fbe-9c8b-bd62252e3202 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78f8ff8c211b4bbaa098b3f105231f01, user_id=35bc3f8ded5f4fff86f54fc34cd5660c, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:36.846762 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd349ea5-a226-4fbe-9c8b-bd62252e3202 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:36.858064 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1344/2683] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 09:23:36 2022] PUT /identity/v3/projects/78f8ff8c211b4bbaa098b3f105231f01/users/35bc3f8ded5f4fff86f54fc34cd5660c/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:23:36.868593 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19aabbc-0b9f-4415-a81e-8ae4d0dca82d None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:36.868884 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19aabbc-0b9f-4415-a81e-8ae4d0dca82d None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:36.869162 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19aabbc-0b9f-4415-a81e-8ae4d0dca82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:36.898474 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-d19aabbc-0b9f-4415-a81e-8ae4d0dca82d None None] MFA Rules not processed for user `35bc3f8ded5f4fff86f54fc34cd5660c`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:23:36.899611 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-d19aabbc-0b9f-4415-a81e-8ae4d0dca82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:23:36.911749 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:23:36.982346 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1340/2684] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:23:36 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:23:36.993621 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd349ea5-a226-4fbe-9c8b-bd62252e3202 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:36.995505 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-dd349ea5-a226-4fbe-9c8b-bd62252e3202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:23:37.055854 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd349ea5-a226-4fbe-9c8b-bd62252e3202 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:37.060154 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06675daa-7dc6-4250-8450-11c64b49ec46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:37.060809 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06675daa-7dc6-4250-8450-11c64b49ec46 service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:37.061099 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06675daa-7dc6-4250-8450-11c64b49ec46 service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:37.061382 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06675daa-7dc6-4250-8450-11c64b49ec46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:37.122868 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06675daa-7dc6-4250-8450-11c64b49ec46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:37.124281 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06675daa-7dc6-4250-8450-11c64b49ec46 service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:37.129256 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:23:37.135576 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1345/2685] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:23:36 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:23:38.675930 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19aabbc-0b9f-4415-a81e-8ae4d0dca82d None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:38.677347 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-d19aabbc-0b9f-4415-a81e-8ae4d0dca82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:23:38.689526 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19aabbc-0b9f-4415-a81e-8ae4d0dca82d None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:38.693607 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4eed4-ab85-4f60-80cf-853ade7cc9ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:38.694283 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4eed4-ab85-4f60-80cf-853ade7cc9ff service cinder] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:38.694566 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4eed4-ab85-4f60-80cf-853ade7cc9ff service cinder] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:38.694847 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4eed4-ab85-4f60-80cf-853ade7cc9ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:38.754475 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d4eed4-ab85-4f60-80cf-853ade7cc9ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:38.755853 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d4eed4-ab85-4f60-80cf-853ade7cc9ff service cinder] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:38.765949 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1341/2686] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:23:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:23:39.325173 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06675daa-7dc6-4250-8450-11c64b49ec46 service cinder] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:39.334223 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06675daa-7dc6-4250-8450-11c64b49ec46 service cinder] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:39.337809 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce77c67-9c0a-49dc-b8f7-945e9a3c14e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:39.338486 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce77c67-9c0a-49dc-b8f7-945e9a3c14e8 service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:39.338767 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce77c67-9c0a-49dc-b8f7-945e9a3c14e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:39.339040 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce77c67-9c0a-49dc-b8f7-945e9a3c14e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:39.348490 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce77c67-9c0a-49dc-b8f7-945e9a3c14e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:39.349923 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce77c67-9c0a-49dc-b8f7-945e9a3c14e8 service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:39.360161 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1346/2687] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:23:39 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:23:43.347737 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4eed4-ab85-4f60-80cf-853ade7cc9ff service cinder] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:43.416560 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4eed4-ab85-4f60-80cf-853ade7cc9ff service cinder] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:43.421892 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c36e724-02f1-4899-9cf2-3f91e2884081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:43.422848 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36e724-02f1-4899-9cf2-3f91e2884081 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:43.423128 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36e724-02f1-4899-9cf2-3f91e2884081 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:43.423403 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36e724-02f1-4899-9cf2-3f91e2884081 admin admin] PATH_INFO: `/v3/users/005e9669d7b14ebd81fe9e394311e031` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:43.424628 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c36e724-02f1-4899-9cf2-3f91e2884081 admin admin] RBAC: Authorizing `identity:delete_user(user_id=005e9669d7b14ebd81fe9e394311e031)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:43.426613 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c36e724-02f1-4899-9cf2-3f91e2884081 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:43.484556 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-2c36e724-02f1-4899-9cf2-3f91e2884081 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '005e9669d7b14ebd81fe9e394311e031'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:43.486557 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:23:43.493448 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-2c36e724-02f1-4899-9cf2-3f91e2884081 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '005e9669d7b14ebd81fe9e394311e031'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:43.494167 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-2c36e724-02f1-4899-9cf2-3f91e2884081 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '005e9669d7b14ebd81fe9e394311e031'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:43.503211 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-2c36e724-02f1-4899-9cf2-3f91e2884081 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '005e9669d7b14ebd81fe9e394311e031'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:43.503927 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-2c36e724-02f1-4899-9cf2-3f91e2884081 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '005e9669d7b14ebd81fe9e394311e031'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:43.521694 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1342/2688] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 09:23:43 2022] DELETE /identity/v3/users/005e9669d7b14ebd81fe9e394311e031 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:23:43.526067 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb701178-1a48-4f28-972d-59c4736bc71b None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:43.526583 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb701178-1a48-4f28-972d-59c4736bc71b None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:43.526842 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb701178-1a48-4f28-972d-59c4736bc71b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:43.544595 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-eb701178-1a48-4f28-972d-59c4736bc71b None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:23:43.545950 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-eb701178-1a48-4f28-972d-59c4736bc71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:23:43.612603 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1347/2689] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:23:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:23:43.622921 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c36e724-02f1-4899-9cf2-3f91e2884081 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:43.624364 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-2c36e724-02f1-4899-9cf2-3f91e2884081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:23:43.682013 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c36e724-02f1-4899-9cf2-3f91e2884081 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:43.685867 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2da17e-8612-480a-9a16-8942947ef080 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:43.686649 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2da17e-8612-480a-9a16-8942947ef080 service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:43.687035 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2da17e-8612-480a-9a16-8942947ef080 service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:43.687436 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2da17e-8612-480a-9a16-8942947ef080 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:43.697636 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2da17e-8612-480a-9a16-8942947ef080 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:43.699610 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2da17e-8612-480a-9a16-8942947ef080 service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:43.709210 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1343/2690] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:23:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:23:43.991415 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb701178-1a48-4f28-972d-59c4736bc71b None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:43.994318 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-eb701178-1a48-4f28-972d-59c4736bc71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:23:44.020464 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb701178-1a48-4f28-972d-59c4736bc71b None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:44.029207 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd14ee77-f17d-425f-9987-3fca5bf53214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:44.030745 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14ee77-f17d-425f-9987-3fca5bf53214 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:44.031219 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14ee77-f17d-425f-9987-3fca5bf53214 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:44.031755 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14ee77-f17d-425f-9987-3fca5bf53214 admin admin] PATH_INFO: `/v3/projects/3b14569992fb4ca6a4ec2d60d34f007e` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:44.033814 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd14ee77-f17d-425f-9987-3fca5bf53214 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b14569992fb4ca6a4ec2d60d34f007e)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:44.037520 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd14ee77-f17d-425f-9987-3fca5bf53214 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:44.105789 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-cd14ee77-f17d-425f-9987-3fca5bf53214 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b14569992fb4ca6a4ec2d60d34f007e', 'request_id': 'req-cd14ee77-f17d-425f-9987-3fca5bf53214'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:44.114668 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-cd14ee77-f17d-425f-9987-3fca5bf53214 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b14569992fb4ca6a4ec2d60d34f007e', 'request_id': 'req-cd14ee77-f17d-425f-9987-3fca5bf53214'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:44.122939 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-cd14ee77-f17d-425f-9987-3fca5bf53214 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b14569992fb4ca6a4ec2d60d34f007e', 'request_id': 'req-cd14ee77-f17d-425f-9987-3fca5bf53214'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:44.137974 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-cd14ee77-f17d-425f-9987-3fca5bf53214 admin admin] The token cache is being invalidate because project 3b14569992fb4ca6a4ec2d60d34f007e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:23:44.138439 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-cd14ee77-f17d-425f-9987-3fca5bf53214 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:44.139109 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-cd14ee77-f17d-425f-9987-3fca5bf53214 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:44.140911 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1348/2691] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 09:23:43 2022] DELETE /identity/v3/projects/3b14569992fb4ca6a4ec2d60d34f007e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:23:44.144798 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2da17e-8612-480a-9a16-8942947ef080 service neutron] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:44.154767 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2da17e-8612-480a-9a16-8942947ef080 service neutron] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:44.210295 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc18c8-5d78-4a89-8842-e6b918b04095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:44.211168 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc18c8-5d78-4a89-8842-e6b918b04095 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:44.211451 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc18c8-5d78-4a89-8842-e6b918b04095 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:44.211726 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc18c8-5d78-4a89-8842-e6b918b04095 admin admin] PATH_INFO: `/v3/users/c62cbd629d40412b93805bc9c0ade9a2` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:44.212926 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bc18c8-5d78-4a89-8842-e6b918b04095 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c62cbd629d40412b93805bc9c0ade9a2)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:44.214927 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bc18c8-5d78-4a89-8842-e6b918b04095 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:44.263812 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-31bc18c8-5d78-4a89-8842-e6b918b04095 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c62cbd629d40412b93805bc9c0ade9a2'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:44.271051 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-31bc18c8-5d78-4a89-8842-e6b918b04095 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c62cbd629d40412b93805bc9c0ade9a2'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:44.271726 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-31bc18c8-5d78-4a89-8842-e6b918b04095 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c62cbd629d40412b93805bc9c0ade9a2'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:44.279502 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-31bc18c8-5d78-4a89-8842-e6b918b04095 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c62cbd629d40412b93805bc9c0ade9a2'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:44.280271 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-31bc18c8-5d78-4a89-8842-e6b918b04095 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c62cbd629d40412b93805bc9c0ade9a2'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:44.287681 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:23:44.300788 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1344/2692] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 09:23:44 2022] DELETE /identity/v3/users/c62cbd629d40412b93805bc9c0ade9a2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:23:44.608825 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd14ee77-f17d-425f-9987-3fca5bf53214 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:44.611042 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-cd14ee77-f17d-425f-9987-3fca5bf53214 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:23:44.633843 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd14ee77-f17d-425f-9987-3fca5bf53214 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:44.700533 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034678a3-845d-45b9-8563-11639424c022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:44.701288 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034678a3-845d-45b9-8563-11639424c022 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:44.701601 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034678a3-845d-45b9-8563-11639424c022 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:44.701878 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034678a3-845d-45b9-8563-11639424c022 admin admin] PATH_INFO: `/v3/projects/350448512b614f279b5a1cf11b0497a6` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:44.703111 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034678a3-845d-45b9-8563-11639424c022 admin admin] RBAC: Authorizing `identity:delete_project(project_id=350448512b614f279b5a1cf11b0497a6)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:44.705168 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034678a3-845d-45b9-8563-11639424c022 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:44.717836 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:23:44.769751 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-034678a3-845d-45b9-8563-11639424c022 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '350448512b614f279b5a1cf11b0497a6', 'request_id': 'req-034678a3-845d-45b9-8563-11639424c022'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:44.776134 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-034678a3-845d-45b9-8563-11639424c022 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '350448512b614f279b5a1cf11b0497a6', 'request_id': 'req-034678a3-845d-45b9-8563-11639424c022'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:44.783321 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-034678a3-845d-45b9-8563-11639424c022 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '350448512b614f279b5a1cf11b0497a6', 'request_id': 'req-034678a3-845d-45b9-8563-11639424c022'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:44.802309 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-034678a3-845d-45b9-8563-11639424c022 admin admin] The token cache is being invalidate because project 350448512b614f279b5a1cf11b0497a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:23:44.802640 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-034678a3-845d-45b9-8563-11639424c022 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:44.803230 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-034678a3-845d-45b9-8563-11639424c022 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:44.804948 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1349/2693] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 09:23:44 2022] DELETE /identity/v3/projects/350448512b614f279b5a1cf11b0497a6 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:23:44.809049 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc18c8-5d78-4a89-8842-e6b918b04095 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:44.810595 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-31bc18c8-5d78-4a89-8842-e6b918b04095 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:23:44.823829 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc18c8-5d78-4a89-8842-e6b918b04095 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:44.891713 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72022a50-2ef7-424a-a045-ae782a30f1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:44.893377 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72022a50-2ef7-424a-a045-ae782a30f1bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:44.893665 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72022a50-2ef7-424a-a045-ae782a30f1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:44.893950 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72022a50-2ef7-424a-a045-ae782a30f1bb admin admin] PATH_INFO: `/v3/users/35bc3f8ded5f4fff86f54fc34cd5660c` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:44.895697 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72022a50-2ef7-424a-a045-ae782a30f1bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=35bc3f8ded5f4fff86f54fc34cd5660c)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:44.897640 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72022a50-2ef7-424a-a045-ae782a30f1bb admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:44.954229 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-72022a50-2ef7-424a-a045-ae782a30f1bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35bc3f8ded5f4fff86f54fc34cd5660c'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:44.961311 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-72022a50-2ef7-424a-a045-ae782a30f1bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35bc3f8ded5f4fff86f54fc34cd5660c'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:44.962016 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-72022a50-2ef7-424a-a045-ae782a30f1bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35bc3f8ded5f4fff86f54fc34cd5660c'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:44.971836 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-72022a50-2ef7-424a-a045-ae782a30f1bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35bc3f8ded5f4fff86f54fc34cd5660c'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:44.972469 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-72022a50-2ef7-424a-a045-ae782a30f1bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35bc3f8ded5f4fff86f54fc34cd5660c'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:44.991967 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1345/2694] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 09:23:44 2022] DELETE /identity/v3/users/35bc3f8ded5f4fff86f54fc34cd5660c => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:23:45.271049 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034678a3-845d-45b9-8563-11639424c022 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:45.272617 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-034678a3-845d-45b9-8563-11639424c022 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:23:45.287010 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034678a3-845d-45b9-8563-11639424c022 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:45.347993 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab7bba-a3e7-4fa2-a6ef-6676e56a7ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:45.348881 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab7bba-a3e7-4fa2-a6ef-6676e56a7ac3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:45.349164 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab7bba-a3e7-4fa2-a6ef-6676e56a7ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:45.349439 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab7bba-a3e7-4fa2-a6ef-6676e56a7ac3 admin admin] PATH_INFO: `/v3/projects/78f8ff8c211b4bbaa098b3f105231f01` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:45.350660 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ab7bba-a3e7-4fa2-a6ef-6676e56a7ac3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78f8ff8c211b4bbaa098b3f105231f01)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:45.352584 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ab7bba-a3e7-4fa2-a6ef-6676e56a7ac3 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:45.398963 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-88ab7bba-a3e7-4fa2-a6ef-6676e56a7ac3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78f8ff8c211b4bbaa098b3f105231f01', 'request_id': 'req-88ab7bba-a3e7-4fa2-a6ef-6676e56a7ac3'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:45.404903 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-88ab7bba-a3e7-4fa2-a6ef-6676e56a7ac3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78f8ff8c211b4bbaa098b3f105231f01', 'request_id': 'req-88ab7bba-a3e7-4fa2-a6ef-6676e56a7ac3'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:45.411076 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-88ab7bba-a3e7-4fa2-a6ef-6676e56a7ac3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78f8ff8c211b4bbaa098b3f105231f01', 'request_id': 'req-88ab7bba-a3e7-4fa2-a6ef-6676e56a7ac3'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:45.424023 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-88ab7bba-a3e7-4fa2-a6ef-6676e56a7ac3 admin admin] The token cache is being invalidate because project 78f8ff8c211b4bbaa098b3f105231f01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:23:45.424309 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-88ab7bba-a3e7-4fa2-a6ef-6676e56a7ac3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:45.424967 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-88ab7bba-a3e7-4fa2-a6ef-6676e56a7ac3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:45.426556 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1350/2695] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 09:23:45 2022] DELETE /identity/v3/projects/78f8ff8c211b4bbaa098b3f105231f01 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:23:52.690496 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72022a50-2ef7-424a-a045-ae782a30f1bb admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:52.691915 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-72022a50-2ef7-424a-a045-ae782a30f1bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:23:52.748422 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72022a50-2ef7-424a-a045-ae782a30f1bb admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:52.768143 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:23:52.799576 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1432e091-a386-42a7-91cb-96c84529974a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:52.800596 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432e091-a386-42a7-91cb-96c84529974a service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:52.801006 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432e091-a386-42a7-91cb-96c84529974a service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:52.801456 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432e091-a386-42a7-91cb-96c84529974a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:52.803995 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-1432e091-a386-42a7-91cb-96c84529974a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:23:52.882325 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1432e091-a386-42a7-91cb-96c84529974a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:52.883781 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1432e091-a386-42a7-91cb-96c84529974a service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:52.897209 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1346/2696] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:23:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:23:55.420962 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=70,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:23:56.237616 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab7bba-a3e7-4fa2-a6ef-6676e56a7ac3 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:56.239125 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-88ab7bba-a3e7-4fa2-a6ef-6676e56a7ac3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:23:56.257868 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab7bba-a3e7-4fa2-a6ef-6676e56a7ac3 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:56.264361 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d269ab-98f0-4483-adb9-5b1c0ee9363c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:56.265269 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d269ab-98f0-4483-adb9-5b1c0ee9363c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:56.265553 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d269ab-98f0-4483-adb9-5b1c0ee9363c admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:56.265828 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d269ab-98f0-4483-adb9-5b1c0ee9363c admin admin] PATH_INFO: `/v3/users/a19792e478a748268d63974aeed96b3a` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:56.267097 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d269ab-98f0-4483-adb9-5b1c0ee9363c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a19792e478a748268d63974aeed96b3a)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:56.269026 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d269ab-98f0-4483-adb9-5b1c0ee9363c admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:56.318098 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-80d269ab-98f0-4483-adb9-5b1c0ee9363c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a19792e478a748268d63974aeed96b3a'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:56.325110 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-80d269ab-98f0-4483-adb9-5b1c0ee9363c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a19792e478a748268d63974aeed96b3a'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:56.325721 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-80d269ab-98f0-4483-adb9-5b1c0ee9363c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a19792e478a748268d63974aeed96b3a'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:56.332902 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-80d269ab-98f0-4483-adb9-5b1c0ee9363c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a19792e478a748268d63974aeed96b3a'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:56.333520 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-80d269ab-98f0-4483-adb9-5b1c0ee9363c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a19792e478a748268d63974aeed96b3a'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:56.350657 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1351/2697] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 09:23:56 2022] DELETE /identity/v3/users/a19792e478a748268d63974aeed96b3a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:23:56.526566 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1432e091-a386-42a7-91cb-96c84529974a service neutron] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:56.537103 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1432e091-a386-42a7-91cb-96c84529974a service neutron] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:56.593020 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d8e198-8042-4cd5-91d6-0f0c11b62b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:56.593804 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d8e198-8042-4cd5-91d6-0f0c11b62b9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:56.594121 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d8e198-8042-4cd5-91d6-0f0c11b62b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:56.594411 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d8e198-8042-4cd5-91d6-0f0c11b62b9a admin admin] PATH_INFO: `/v3/projects/03bde12ba982486497997b5f04e23ae2` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:56.595609 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d8e198-8042-4cd5-91d6-0f0c11b62b9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=03bde12ba982486497997b5f04e23ae2)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:56.597519 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d8e198-8042-4cd5-91d6-0f0c11b62b9a admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:56.644330 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-08d8e198-8042-4cd5-91d6-0f0c11b62b9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03bde12ba982486497997b5f04e23ae2', 'request_id': 'req-08d8e198-8042-4cd5-91d6-0f0c11b62b9a'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:56.650066 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-08d8e198-8042-4cd5-91d6-0f0c11b62b9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03bde12ba982486497997b5f04e23ae2', 'request_id': 'req-08d8e198-8042-4cd5-91d6-0f0c11b62b9a'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:56.656432 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-08d8e198-8042-4cd5-91d6-0f0c11b62b9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03bde12ba982486497997b5f04e23ae2', 'request_id': 'req-08d8e198-8042-4cd5-91d6-0f0c11b62b9a'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:56.669047 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-08d8e198-8042-4cd5-91d6-0f0c11b62b9a admin admin] The token cache is being invalidate because project 03bde12ba982486497997b5f04e23ae2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:23:56.669335 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-08d8e198-8042-4cd5-91d6-0f0c11b62b9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:56.669968 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-08d8e198-8042-4cd5-91d6-0f0c11b62b9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:23:56.671544 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1347/2698] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 09:23:56 2022] DELETE /identity/v3/projects/03bde12ba982486497997b5f04e23ae2 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:23:56.676423 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35ff6c-e335-4dff-9c04-d5c9c9f72409 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:56.676903 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35ff6c-e335-4dff-9c04-d5c9c9f72409 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:56.676995 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35ff6c-e335-4dff-9c04-d5c9c9f72409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:56.694722 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-6f35ff6c-e335-4dff-9c04-d5c9c9f72409 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:23:56.695989 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-6f35ff6c-e335-4dff-9c04-d5c9c9f72409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:23:56.758611 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1352/2699] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:23:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:23:56.766878 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67416476-4017-453a-95ed-0e334feae5f1 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:56.767176 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67416476-4017-453a-95ed-0e334feae5f1 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:56.767463 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67416476-4017-453a-95ed-0e334feae5f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:56.774860 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:23:56.786574 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-67416476-4017-453a-95ed-0e334feae5f1 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:23:56.787794 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-67416476-4017-453a-95ed-0e334feae5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:23:56.795880 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1348/2700] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:23:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:23:56.800264 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f35ff6c-e335-4dff-9c04-d5c9c9f72409 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:56.810716 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f35ff6c-e335-4dff-9c04-d5c9c9f72409 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:56.815278 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106d8c8-a7cf-4346-bc13-26a6e650ae21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:56.815925 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106d8c8-a7cf-4346-bc13-26a6e650ae21 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:56.816211 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106d8c8-a7cf-4346-bc13-26a6e650ae21 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:56.816490 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106d8c8-a7cf-4346-bc13-26a6e650ae21 admin admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:56.817217 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b106d8c8-a7cf-4346-bc13-26a6e650ae21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:23:56.817531 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b106d8c8-a7cf-4346-bc13-26a6e650ae21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:56.819163 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b106d8c8-a7cf-4346-bc13-26a6e650ae21 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:56.831253 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1353/2701] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Jun 22 09:23:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:23:56.835419 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67416476-4017-453a-95ed-0e334feae5f1 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:56.845282 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67416476-4017-453a-95ed-0e334feae5f1 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:56.849971 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f88af51-db91-4db1-8792-7fca29986bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:56.850650 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88af51-db91-4db1-8792-7fca29986bff admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:56.850935 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88af51-db91-4db1-8792-7fca29986bff admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:56.851215 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88af51-db91-4db1-8792-7fca29986bff admin admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:56.851911 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f88af51-db91-4db1-8792-7fca29986bff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:56.853804 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f88af51-db91-4db1-8792-7fca29986bff admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:56.884842 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1349/2702] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 09:23:56 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:23:56.889682 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106d8c8-a7cf-4346-bc13-26a6e650ae21 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:56.900109 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106d8c8-a7cf-4346-bc13-26a6e650ae21 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:56.960880 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d77abe5-b1ca-43d4-814f-fe4bf18fe5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:56.961561 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77abe5-b1ca-43d4-814f-fe4bf18fe5b1 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:56.961849 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77abe5-b1ca-43d4-814f-fe4bf18fe5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:56.962161 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77abe5-b1ca-43d4-814f-fe4bf18fe5b1 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:56.963065 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d77abe5-b1ca-43d4-814f-fe4bf18fe5b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:56.965023 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d77abe5-b1ca-43d4-814f-fe4bf18fe5b1 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:56.972516 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:23:56.990094 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1354/2703] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 09:23:56 2022] POST /identity/v3/users => generated 283 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:23:56.994867 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f88af51-db91-4db1-8792-7fca29986bff admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:57.006848 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f88af51-db91-4db1-8792-7fca29986bff admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:57.011567 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589fc80-5e2d-44ae-8f3e-3241a4da6c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:57.012261 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589fc80-5e2d-44ae-8f3e-3241a4da6c63 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:57.012544 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589fc80-5e2d-44ae-8f3e-3241a4da6c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:57.012826 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589fc80-5e2d-44ae-8f3e-3241a4da6c63 admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:57.013562 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7589fc80-5e2d-44ae-8f3e-3241a4da6c63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:57.015228 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7589fc80-5e2d-44ae-8f3e-3241a4da6c63 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:57.025849 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1350/2704] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 09:23:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:23:57.029894 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d77abe5-b1ca-43d4-814f-fe4bf18fe5b1 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:57.039972 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d77abe5-b1ca-43d4-814f-fe4bf18fe5b1 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:57.045150 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b1512-341f-4c90-95fe-2bc2990b374c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:57.045803 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b1512-341f-4c90-95fe-2bc2990b374c admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:57.046108 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b1512-341f-4c90-95fe-2bc2990b374c admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:57.046398 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b1512-341f-4c90-95fe-2bc2990b374c admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:57.047123 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681b1512-341f-4c90-95fe-2bc2990b374c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:57.048744 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681b1512-341f-4c90-95fe-2bc2990b374c admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:57.059754 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1355/2705] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 09:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:23:57.064146 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589fc80-5e2d-44ae-8f3e-3241a4da6c63 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:57.074304 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589fc80-5e2d-44ae-8f3e-3241a4da6c63 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:57.078942 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4556198-56cf-4a27-a732-6bfacb8f7bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:57.079818 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4556198-56cf-4a27-a732-6bfacb8f7bee admin admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:57.080106 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4556198-56cf-4a27-a732-6bfacb8f7bee admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:57.080390 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4556198-56cf-4a27-a732-6bfacb8f7bee admin admin] PATH_INFO: `/v3/projects/44ebb70fff6b4d268ec9cb1f986e9df9/users/b8c1b6c1d5254cc2b3436f83e0cca058/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:57.095117 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4556198-56cf-4a27-a732-6bfacb8f7bee admin admin] RBAC: Authorizing `identity:create_grant(project_id=44ebb70fff6b4d268ec9cb1f986e9df9, user_id=b8c1b6c1d5254cc2b3436f83e0cca058, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:57.097930 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4556198-56cf-4a27-a732-6bfacb8f7bee admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:57.113638 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1351/2706] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 09:23:57 2022] PUT /identity/v3/projects/44ebb70fff6b4d268ec9cb1f986e9df9/users/b8c1b6c1d5254cc2b3436f83e0cca058/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:23:57.124317 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f456a-a4d8-43da-918d-c4e9c12402db None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:57.124867 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f456a-a4d8-43da-918d-c4e9c12402db None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:57.125154 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f456a-a4d8-43da-918d-c4e9c12402db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:57.151775 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-b79f456a-a4d8-43da-918d-c4e9c12402db None None] MFA Rules not processed for user `b8c1b6c1d5254cc2b3436f83e0cca058`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:23:57.153025 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-b79f456a-a4d8-43da-918d-c4e9c12402db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:23:57.216198 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1356/2707] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:23:57 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:23:57.220739 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4556198-56cf-4a27-a732-6bfacb8f7bee admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:57.287231 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4556198-56cf-4a27-a732-6bfacb8f7bee admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:57.291947 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a1e22-d1de-42a5-8de1-fb3d8200290a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:57.292608 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a1e22-d1de-42a5-8de1-fb3d8200290a admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:57.292895 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a1e22-d1de-42a5-8de1-fb3d8200290a admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:57.293751 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a1e22-d1de-42a5-8de1-fb3d8200290a admin admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:57.294491 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79a1e22-d1de-42a5-8de1-fb3d8200290a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:57.296397 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79a1e22-d1de-42a5-8de1-fb3d8200290a admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:57.320946 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1352/2708] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 09:23:57 2022] POST /identity/v3/projects => generated 363 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:23:57.325152 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79f456a-a4d8-43da-918d-c4e9c12402db None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:57.335743 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79f456a-a4d8-43da-918d-c4e9c12402db None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:57.397793 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5703aa9c-3876-4cad-b36a-e45c6b38c8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:57.398498 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703aa9c-3876-4cad-b36a-e45c6b38c8ed admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:57.398782 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703aa9c-3876-4cad-b36a-e45c6b38c8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:57.399075 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703aa9c-3876-4cad-b36a-e45c6b38c8ed admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:57.399759 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5703aa9c-3876-4cad-b36a-e45c6b38c8ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:57.401666 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5703aa9c-3876-4cad-b36a-e45c6b38c8ed admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:57.423191 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1357/2709] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 09:23:57 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:23:57.427432 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a1e22-d1de-42a5-8de1-fb3d8200290a admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:57.438265 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a1e22-d1de-42a5-8de1-fb3d8200290a admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:57.443723 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cafbfd0-9b2b-4ed8-a6b0-6aae92fa3f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:57.444389 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafbfd0-9b2b-4ed8-a6b0-6aae92fa3f79 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:57.444675 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafbfd0-9b2b-4ed8-a6b0-6aae92fa3f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:57.444960 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafbfd0-9b2b-4ed8-a6b0-6aae92fa3f79 admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:57.445743 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cafbfd0-9b2b-4ed8-a6b0-6aae92fa3f79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:57.447496 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cafbfd0-9b2b-4ed8-a6b0-6aae92fa3f79 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:57.458427 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1353/2710] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 09:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:23:57.462610 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5703aa9c-3876-4cad-b36a-e45c6b38c8ed admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:57.473599 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5703aa9c-3876-4cad-b36a-e45c6b38c8ed admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:57.478633 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67438260-b242-4b25-b788-512d0568b148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:57.479514 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67438260-b242-4b25-b788-512d0568b148 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:57.479801 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67438260-b242-4b25-b788-512d0568b148 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:57.480083 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67438260-b242-4b25-b788-512d0568b148 admin admin] PATH_INFO: `/v3/projects/b3e7fe4b57464b0cb908b2ea65dfb18f/users/c444f5c0f4c44008b212a07fc811c507/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:57.496913 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67438260-b242-4b25-b788-512d0568b148 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3e7fe4b57464b0cb908b2ea65dfb18f, user_id=c444f5c0f4c44008b212a07fc811c507, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:57.500073 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67438260-b242-4b25-b788-512d0568b148 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:57.513506 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1358/2711] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 09:23:57 2022] PUT /identity/v3/projects/b3e7fe4b57464b0cb908b2ea65dfb18f/users/c444f5c0f4c44008b212a07fc811c507/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:23:57.517638 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cafbfd0-9b2b-4ed8-a6b0-6aae92fa3f79 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:57.528474 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cafbfd0-9b2b-4ed8-a6b0-6aae92fa3f79 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:57.595716 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce88933b-5aa6-49a9-b85a-7cc8e1df9f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:57.596381 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88933b-5aa6-49a9-b85a-7cc8e1df9f13 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:57.596664 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88933b-5aa6-49a9-b85a-7cc8e1df9f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:57.596946 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88933b-5aa6-49a9-b85a-7cc8e1df9f13 admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:57.597662 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce88933b-5aa6-49a9-b85a-7cc8e1df9f13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:57.599664 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce88933b-5aa6-49a9-b85a-7cc8e1df9f13 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:57.609843 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1354/2712] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 09:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:23:57.614233 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67438260-b242-4b25-b788-512d0568b148 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:57.626243 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67438260-b242-4b25-b788-512d0568b148 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:57.630943 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9331b8bb-5c66-4ca9-92e0-88e4405a1ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:57.631800 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331b8bb-5c66-4ca9-92e0-88e4405a1ec6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:57.632080 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331b8bb-5c66-4ca9-92e0-88e4405a1ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:57.632352 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331b8bb-5c66-4ca9-92e0-88e4405a1ec6 admin admin] PATH_INFO: `/v3/projects/b3e7fe4b57464b0cb908b2ea65dfb18f/users/c444f5c0f4c44008b212a07fc811c507/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:57.634373 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9331b8bb-5c66-4ca9-92e0-88e4405a1ec6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3e7fe4b57464b0cb908b2ea65dfb18f, user_id=c444f5c0f4c44008b212a07fc811c507, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:57.637506 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9331b8bb-5c66-4ca9-92e0-88e4405a1ec6 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:57.648421 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1359/2713] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 09:23:57 2022] PUT /identity/v3/projects/b3e7fe4b57464b0cb908b2ea65dfb18f/users/c444f5c0f4c44008b212a07fc811c507/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:23:57.660081 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93101fe8-a411-4161-afa0-7ef305bd2538 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:57.660311 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93101fe8-a411-4161-afa0-7ef305bd2538 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:57.660613 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93101fe8-a411-4161-afa0-7ef305bd2538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:57.680739 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:23:57.691666 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-93101fe8-a411-4161-afa0-7ef305bd2538 None None] MFA Rules not processed for user `c444f5c0f4c44008b212a07fc811c507`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:23:57.693188 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-93101fe8-a411-4161-afa0-7ef305bd2538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:23:57.765361 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1355/2714] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:23:57 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:23:57.776622 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9331b8bb-5c66-4ca9-92e0-88e4405a1ec6 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:57.779062 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-9331b8bb-5c66-4ca9-92e0-88e4405a1ec6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:23:57.801570 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:23:57.838994 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9331b8bb-5c66-4ca9-92e0-88e4405a1ec6 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:57.843223 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a0d52-0ea2-4cd9-9bc7-067f9db29ed6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:57.843864 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a0d52-0ea2-4cd9-9bc7-067f9db29ed6 service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:57.844148 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a0d52-0ea2-4cd9-9bc7-067f9db29ed6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:57.844424 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a0d52-0ea2-4cd9-9bc7-067f9db29ed6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:57.853366 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4a0d52-0ea2-4cd9-9bc7-067f9db29ed6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:57.854830 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4a0d52-0ea2-4cd9-9bc7-067f9db29ed6 service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:57.864257 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1360/2715] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:23:57 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:23:57.939519 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93101fe8-a411-4161-afa0-7ef305bd2538 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:57.950528 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93101fe8-a411-4161-afa0-7ef305bd2538 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:57.954148 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a076af-06ed-481e-9b13-7df864c61350 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:57.954793 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a076af-06ed-481e-9b13-7df864c61350 service cinder] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:57.955074 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a076af-06ed-481e-9b13-7df864c61350 service cinder] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:57.955350 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a076af-06ed-481e-9b13-7df864c61350 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:58.016141 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a076af-06ed-481e-9b13-7df864c61350 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:58.017591 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a076af-06ed-481e-9b13-7df864c61350 service cinder] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:58.026543 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1356/2716] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:23:57 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:24:00.735811 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a0d52-0ea2-4cd9-9bc7-067f9db29ed6 service cinder] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:24:00.799544 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a0d52-0ea2-4cd9-9bc7-067f9db29ed6 service cinder] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:24:00.804038 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef6f47d-63fa-4340-8c0a-34c077323ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:24:00.804892 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6f47d-63fa-4340-8c0a-34c077323ee5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:24:00.805172 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6f47d-63fa-4340-8c0a-34c077323ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:24:00.805439 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6f47d-63fa-4340-8c0a-34c077323ee5 admin admin] PATH_INFO: `/v3/users/b8c1b6c1d5254cc2b3436f83e0cca058` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:24:00.806642 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef6f47d-63fa-4340-8c0a-34c077323ee5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8c1b6c1d5254cc2b3436f83e0cca058)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:24:00.808639 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef6f47d-63fa-4340-8c0a-34c077323ee5 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:24:00.857428 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-eef6f47d-63fa-4340-8c0a-34c077323ee5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8c1b6c1d5254cc2b3436f83e0cca058'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:00.864626 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-eef6f47d-63fa-4340-8c0a-34c077323ee5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8c1b6c1d5254cc2b3436f83e0cca058'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:00.865267 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-eef6f47d-63fa-4340-8c0a-34c077323ee5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8c1b6c1d5254cc2b3436f83e0cca058'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:00.875487 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-eef6f47d-63fa-4340-8c0a-34c077323ee5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8c1b6c1d5254cc2b3436f83e0cca058'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:00.876338 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-eef6f47d-63fa-4340-8c0a-34c077323ee5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8c1b6c1d5254cc2b3436f83e0cca058'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:00.895355 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1361/2717] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 09:24:00 2022] DELETE /identity/v3/users/b8c1b6c1d5254cc2b3436f83e0cca058 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:24:00.900019 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e107ff-1f65-4530-aca7-e3f72a11baa1 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:24:00.900482 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e107ff-1f65-4530-aca7-e3f72a11baa1 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:24:00.900586 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e107ff-1f65-4530-aca7-e3f72a11baa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:24:00.919353 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-84e107ff-1f65-4530-aca7-e3f72a11baa1 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:24:00.920583 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-84e107ff-1f65-4530-aca7-e3f72a11baa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:24:00.982973 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1357/2718] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:24:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:24:00.992543 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef6f47d-63fa-4340-8c0a-34c077323ee5 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:24:00.993930 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-eef6f47d-63fa-4340-8c0a-34c077323ee5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:24:01.040008 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:24:01.053127 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef6f47d-63fa-4340-8c0a-34c077323ee5 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:24:01.056819 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06326be0-be87-4a58-b015-2fad83216d2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:24:01.057469 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06326be0-be87-4a58-b015-2fad83216d2b service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:24:01.057750 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06326be0-be87-4a58-b015-2fad83216d2b service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:24:01.058024 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06326be0-be87-4a58-b015-2fad83216d2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:24:01.067670 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06326be0-be87-4a58-b015-2fad83216d2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:24:01.069108 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06326be0-be87-4a58-b015-2fad83216d2b service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:24:01.079809 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1362/2719] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:24:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:24:01.353399 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e107ff-1f65-4530-aca7-e3f72a11baa1 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:24:01.355167 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-84e107ff-1f65-4530-aca7-e3f72a11baa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:24:01.374156 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e107ff-1f65-4530-aca7-e3f72a11baa1 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:24:01.379863 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8212f1c0-72fe-478b-8018-0e49cc5e337b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:24:01.380768 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212f1c0-72fe-478b-8018-0e49cc5e337b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:24:01.380996 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212f1c0-72fe-478b-8018-0e49cc5e337b admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:24:01.381307 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212f1c0-72fe-478b-8018-0e49cc5e337b admin admin] PATH_INFO: `/v3/projects/44ebb70fff6b4d268ec9cb1f986e9df9` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:24:01.382519 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8212f1c0-72fe-478b-8018-0e49cc5e337b admin admin] RBAC: Authorizing `identity:delete_project(project_id=44ebb70fff6b4d268ec9cb1f986e9df9)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:24:01.384673 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8212f1c0-72fe-478b-8018-0e49cc5e337b admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:24:01.420503 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:24:01.434168 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-8212f1c0-72fe-478b-8018-0e49cc5e337b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44ebb70fff6b4d268ec9cb1f986e9df9', 'request_id': 'req-8212f1c0-72fe-478b-8018-0e49cc5e337b'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:01.439527 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-8212f1c0-72fe-478b-8018-0e49cc5e337b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44ebb70fff6b4d268ec9cb1f986e9df9', 'request_id': 'req-8212f1c0-72fe-478b-8018-0e49cc5e337b'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:01.445720 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-8212f1c0-72fe-478b-8018-0e49cc5e337b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44ebb70fff6b4d268ec9cb1f986e9df9', 'request_id': 'req-8212f1c0-72fe-478b-8018-0e49cc5e337b'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:01.459025 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-8212f1c0-72fe-478b-8018-0e49cc5e337b admin admin] The token cache is being invalidate because project 44ebb70fff6b4d268ec9cb1f986e9df9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:24:01.459336 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-8212f1c0-72fe-478b-8018-0e49cc5e337b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:01.459957 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-8212f1c0-72fe-478b-8018-0e49cc5e337b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:01.461486 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1358/2720] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 09:24:01 2022] DELETE /identity/v3/projects/44ebb70fff6b4d268ec9cb1f986e9df9 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:24:01.466019 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06326be0-be87-4a58-b015-2fad83216d2b service neutron] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:24:01.475834 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06326be0-be87-4a58-b015-2fad83216d2b service neutron] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:24:01.531807 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7306b947-1956-43fa-9dc4-2d0ce6a44ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:24:01.532672 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7306b947-1956-43fa-9dc4-2d0ce6a44ef6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:24:01.532952 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7306b947-1956-43fa-9dc4-2d0ce6a44ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:24:01.533223 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7306b947-1956-43fa-9dc4-2d0ce6a44ef6 admin admin] PATH_INFO: `/v3/users/c444f5c0f4c44008b212a07fc811c507` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:24:01.534446 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7306b947-1956-43fa-9dc4-2d0ce6a44ef6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c444f5c0f4c44008b212a07fc811c507)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:24:01.536364 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7306b947-1956-43fa-9dc4-2d0ce6a44ef6 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:24:01.580998 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-7306b947-1956-43fa-9dc4-2d0ce6a44ef6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c444f5c0f4c44008b212a07fc811c507'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:01.587839 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-7306b947-1956-43fa-9dc4-2d0ce6a44ef6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c444f5c0f4c44008b212a07fc811c507'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:01.588520 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-7306b947-1956-43fa-9dc4-2d0ce6a44ef6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c444f5c0f4c44008b212a07fc811c507'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:01.596733 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-7306b947-1956-43fa-9dc4-2d0ce6a44ef6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c444f5c0f4c44008b212a07fc811c507'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:01.597494 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-7306b947-1956-43fa-9dc4-2d0ce6a44ef6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c444f5c0f4c44008b212a07fc811c507'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:01.615930 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1363/2721] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 09:24:01 2022] DELETE /identity/v3/users/c444f5c0f4c44008b212a07fc811c507 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:24:01.896212 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8212f1c0-72fe-478b-8018-0e49cc5e337b admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:24:01.897681 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-8212f1c0-72fe-478b-8018-0e49cc5e337b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:24:01.911034 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8212f1c0-72fe-478b-8018-0e49cc5e337b admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:24:01.972180 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ada13-e0a8-4ae9-ab40-d72e8508e426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:24:01.973073 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ada13-e0a8-4ae9-ab40-d72e8508e426 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:24:01.973357 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ada13-e0a8-4ae9-ab40-d72e8508e426 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:24:01.973687 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ada13-e0a8-4ae9-ab40-d72e8508e426 admin admin] PATH_INFO: `/v3/projects/b3e7fe4b57464b0cb908b2ea65dfb18f` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:24:01.974977 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902ada13-e0a8-4ae9-ab40-d72e8508e426 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3e7fe4b57464b0cb908b2ea65dfb18f)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:24:01.976873 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902ada13-e0a8-4ae9-ab40-d72e8508e426 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:24:02.028983 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-902ada13-e0a8-4ae9-ab40-d72e8508e426 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3e7fe4b57464b0cb908b2ea65dfb18f', 'request_id': 'req-902ada13-e0a8-4ae9-ab40-d72e8508e426'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:02.034918 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-902ada13-e0a8-4ae9-ab40-d72e8508e426 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3e7fe4b57464b0cb908b2ea65dfb18f', 'request_id': 'req-902ada13-e0a8-4ae9-ab40-d72e8508e426'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:02.041303 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-902ada13-e0a8-4ae9-ab40-d72e8508e426 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3e7fe4b57464b0cb908b2ea65dfb18f', 'request_id': 'req-902ada13-e0a8-4ae9-ab40-d72e8508e426'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:02.053665 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-902ada13-e0a8-4ae9-ab40-d72e8508e426 admin admin] The token cache is being invalidate because project b3e7fe4b57464b0cb908b2ea65dfb18f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:24:02.053951 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-902ada13-e0a8-4ae9-ab40-d72e8508e426 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:02.054780 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-902ada13-e0a8-4ae9-ab40-d72e8508e426 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:02.056600 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1359/2722] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 09:24:01 2022] DELETE /identity/v3/projects/b3e7fe4b57464b0cb908b2ea65dfb18f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:24:02.063444 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45115a-e21b-4d3c-9656-0133148bf5b7 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:24:02.064365 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45115a-e21b-4d3c-9656-0133148bf5b7 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:24:02.064365 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45115a-e21b-4d3c-9656-0133148bf5b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:24:02.091229 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-4e45115a-e21b-4d3c-9656-0133148bf5b7 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:24:02.092463 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-4e45115a-e21b-4d3c-9656-0133148bf5b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:24:02.153921 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1364/2723] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:24:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:24:02.161839 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4025a-c1e5-4ec8-aa30-37e14288f22f None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:24:02.162146 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4025a-c1e5-4ec8-aa30-37e14288f22f None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:24:02.162426 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4025a-c1e5-4ec8-aa30-37e14288f22f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:24:02.180824 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-b7a4025a-c1e5-4ec8-aa30-37e14288f22f None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:24:02.182047 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-b7a4025a-c1e5-4ec8-aa30-37e14288f22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:24:02.194822 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1360/2724] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:24:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:24:02.199145 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45115a-e21b-4d3c-9656-0133148bf5b7 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:24:02.205786 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:24:02.213487 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45115a-e21b-4d3c-9656-0133148bf5b7 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:24:02.220522 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48848060-a9a1-4b12-9c8f-45507e5d080e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:24:02.221388 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48848060-a9a1-4b12-9c8f-45507e5d080e admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:24:02.221841 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48848060-a9a1-4b12-9c8f-45507e5d080e admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:24:02.222145 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48848060-a9a1-4b12-9c8f-45507e5d080e admin admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:24:02.222885 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48848060-a9a1-4b12-9c8f-45507e5d080e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:24:02.223196 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48848060-a9a1-4b12-9c8f-45507e5d080e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:24:02.224872 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48848060-a9a1-4b12-9c8f-45507e5d080e admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:24:02.238127 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1365/2725] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Jun 22 09:24:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:24:02.242140 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4025a-c1e5-4ec8-aa30-37e14288f22f None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:24:02.252559 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4025a-c1e5-4ec8-aa30-37e14288f22f None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:24:02.257473 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f6d662-f5bd-4ee0-a157-9ea36ad731f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:24:02.258342 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f6d662-f5bd-4ee0-a157-9ea36ad731f3 admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:24:02.258520 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f6d662-f5bd-4ee0-a157-9ea36ad731f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:24:02.259463 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f6d662-f5bd-4ee0-a157-9ea36ad731f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:24:02.259598 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f6d662-f5bd-4ee0-a157-9ea36ad731f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:24:02.261467 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f6d662-f5bd-4ee0-a157-9ea36ad731f3 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:24:02.289595 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1361/2726] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 09:24:02 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:24:02.293560 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48848060-a9a1-4b12-9c8f-45507e5d080e admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:24:02.304555 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48848060-a9a1-4b12-9c8f-45507e5d080e admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:24:02.366215 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa104f-03cf-4ff5-b207-a1396e03390d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:24:02.366890 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa104f-03cf-4ff5-b207-a1396e03390d admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:24:02.367174 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa104f-03cf-4ff5-b207-a1396e03390d admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:24:02.367446 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa104f-03cf-4ff5-b207-a1396e03390d admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:24:02.368161 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafa104f-03cf-4ff5-b207-a1396e03390d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:24:02.370122 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafa104f-03cf-4ff5-b207-a1396e03390d admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:24:02.392382 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1366/2727] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 09:24:02 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:24:02.396184 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f6d662-f5bd-4ee0-a157-9ea36ad731f3 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:24:02.410959 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f6d662-f5bd-4ee0-a157-9ea36ad731f3 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:24:02.416700 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41b426-e6b5-49d2-b2c2-3970bcfb8583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:24:02.417388 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41b426-e6b5-49d2-b2c2-3970bcfb8583 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:24:02.417676 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41b426-e6b5-49d2-b2c2-3970bcfb8583 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:24:02.418475 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41b426-e6b5-49d2-b2c2-3970bcfb8583 admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:24:02.419253 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e41b426-e6b5-49d2-b2c2-3970bcfb8583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:24:02.422992 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e41b426-e6b5-49d2-b2c2-3970bcfb8583 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:24:02.432825 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1362/2728] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 09:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:24:02.438614 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa104f-03cf-4ff5-b207-a1396e03390d admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:24:02.449744 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa104f-03cf-4ff5-b207-a1396e03390d admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:24:02.454649 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e3d592-9504-432e-8aed-9d678c6a9cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:24:02.455336 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3d592-9504-432e-8aed-9d678c6a9cbd admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:24:02.455643 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3d592-9504-432e-8aed-9d678c6a9cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:24:02.455924 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3d592-9504-432e-8aed-9d678c6a9cbd admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:24:02.456657 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e3d592-9504-432e-8aed-9d678c6a9cbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:24:02.458502 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e3d592-9504-432e-8aed-9d678c6a9cbd admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:24:02.469233 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1367/2729] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 09:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:24:02.473624 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41b426-e6b5-49d2-b2c2-3970bcfb8583 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:24:02.484873 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41b426-e6b5-49d2-b2c2-3970bcfb8583 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:24:02.489582 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac9d78-e9b6-4842-bf07-09e77de152c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:24:02.490491 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac9d78-e9b6-4842-bf07-09e77de152c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:24:02.490777 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac9d78-e9b6-4842-bf07-09e77de152c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:24:02.491062 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac9d78-e9b6-4842-bf07-09e77de152c9 admin admin] PATH_INFO: `/v3/projects/b2feade4ba914dc19bd1747fb348c360/users/0c2d7bffb5314846ac880cf5dd93f3db/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:24:02.494534 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:24:02.512213 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ac9d78-e9b6-4842-bf07-09e77de152c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2feade4ba914dc19bd1747fb348c360, user_id=0c2d7bffb5314846ac880cf5dd93f3db, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:24:02.514903 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ac9d78-e9b6-4842-bf07-09e77de152c9 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:24:02.527842 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1363/2730] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 09:24:02 2022] PUT /identity/v3/projects/b2feade4ba914dc19bd1747fb348c360/users/0c2d7bffb5314846ac880cf5dd93f3db/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:24:02.539313 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082cd6f-0bef-4331-962a-d58ea37e2194 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:24:02.539605 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082cd6f-0bef-4331-962a-d58ea37e2194 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:24:02.539883 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082cd6f-0bef-4331-962a-d58ea37e2194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:24:02.567747 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-d082cd6f-0bef-4331-962a-d58ea37e2194 None None] MFA Rules not processed for user `0c2d7bffb5314846ac880cf5dd93f3db`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:24:02.568957 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-d082cd6f-0bef-4331-962a-d58ea37e2194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:24:02.633561 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1368/2731] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:24:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:24:02.638139 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac9d78-e9b6-4842-bf07-09e77de152c9 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:24:02.699836 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac9d78-e9b6-4842-bf07-09e77de152c9 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:24:02.704729 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b140e65-1454-40ad-bb95-041c6efb0799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:24:02.705379 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b140e65-1454-40ad-bb95-041c6efb0799 admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:24:02.705661 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b140e65-1454-40ad-bb95-041c6efb0799 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:24:02.705937 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b140e65-1454-40ad-bb95-041c6efb0799 admin admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:24:02.706655 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b140e65-1454-40ad-bb95-041c6efb0799 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:24:02.708531 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b140e65-1454-40ad-bb95-041c6efb0799 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:24:02.734497 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1364/2732] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 09:24:02 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:24:02.738456 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d082cd6f-0bef-4331-962a-d58ea37e2194 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:24:02.749434 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d082cd6f-0bef-4331-962a-d58ea37e2194 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:24:02.805574 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790a0818-8af8-4c21-b4e7-8dbe235e7076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:24:02.806267 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a0818-8af8-4c21-b4e7-8dbe235e7076 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:24:02.806555 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a0818-8af8-4c21-b4e7-8dbe235e7076 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:24:02.806834 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a0818-8af8-4c21-b4e7-8dbe235e7076 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:24:02.807533 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790a0818-8af8-4c21-b4e7-8dbe235e7076 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:24:02.810016 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790a0818-8af8-4c21-b4e7-8dbe235e7076 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:24:02.816526 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:24:02.831326 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1369/2733] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 09:24:02 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:24:02.835309 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b140e65-1454-40ad-bb95-041c6efb0799 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:24:02.845684 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b140e65-1454-40ad-bb95-041c6efb0799 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:24:02.850310 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea031b7e-dd80-41ef-b9d9-aa84ba940c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:24:02.850966 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea031b7e-dd80-41ef-b9d9-aa84ba940c91 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:24:02.851246 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea031b7e-dd80-41ef-b9d9-aa84ba940c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:24:02.851521 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea031b7e-dd80-41ef-b9d9-aa84ba940c91 admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:24:02.852241 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea031b7e-dd80-41ef-b9d9-aa84ba940c91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:24:02.853858 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea031b7e-dd80-41ef-b9d9-aa84ba940c91 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:24:02.865217 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1365/2734] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 09:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:24:02.869420 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790a0818-8af8-4c21-b4e7-8dbe235e7076 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:24:02.880734 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790a0818-8af8-4c21-b4e7-8dbe235e7076 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:24:02.885317 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae709f-8bbc-4af2-9e55-e939b5b37f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:24:02.885976 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae709f-8bbc-4af2-9e55-e939b5b37f3d admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:24:02.886293 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae709f-8bbc-4af2-9e55-e939b5b37f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:24:02.886578 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae709f-8bbc-4af2-9e55-e939b5b37f3d admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:24:02.887309 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ae709f-8bbc-4af2-9e55-e939b5b37f3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:24:02.888899 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ae709f-8bbc-4af2-9e55-e939b5b37f3d admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:24:02.898919 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1370/2735] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 09:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:24:02.902997 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea031b7e-dd80-41ef-b9d9-aa84ba940c91 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:24:02.913189 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea031b7e-dd80-41ef-b9d9-aa84ba940c91 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:24:02.918592 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622cef1-5437-4cb4-9025-be370269b224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:24:02.919508 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622cef1-5437-4cb4-9025-be370269b224 admin admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:24:02.919825 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622cef1-5437-4cb4-9025-be370269b224 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:24:02.920069 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622cef1-5437-4cb4-9025-be370269b224 admin admin] PATH_INFO: `/v3/projects/7624481ddf3c440c8c621357c68fd985/users/36b0c3e6cc534acbbfc14bcc73c09d18/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:24:02.935370 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2622cef1-5437-4cb4-9025-be370269b224 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7624481ddf3c440c8c621357c68fd985, user_id=36b0c3e6cc534acbbfc14bcc73c09d18, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:24:02.937997 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2622cef1-5437-4cb4-9025-be370269b224 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:24:02.950930 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1366/2736] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 09:24:02 2022] PUT /identity/v3/projects/7624481ddf3c440c8c621357c68fd985/users/36b0c3e6cc534acbbfc14bcc73c09d18/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:24:03.008964 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa4de45-2319-4ee0-90c9-a49aeec44782 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:24:03.009166 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa4de45-2319-4ee0-90c9-a49aeec44782 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:24:03.009439 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa4de45-2319-4ee0-90c9-a49aeec44782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:24:03.038959 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-9aa4de45-2319-4ee0-90c9-a49aeec44782 None None] MFA Rules not processed for user `36b0c3e6cc534acbbfc14bcc73c09d18`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:24:03.040202 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-9aa4de45-2319-4ee0-90c9-a49aeec44782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:24:03.106070 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1371/2737] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:24:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:24:03.110732 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622cef1-5437-4cb4-9025-be370269b224 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:24:03.172238 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622cef1-5437-4cb4-9025-be370269b224 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:24:03.176905 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b450a-ea7f-4de2-a9a7-5e7c4773b051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:24:03.177563 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b450a-ea7f-4de2-a9a7-5e7c4773b051 admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:24:03.177853 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b450a-ea7f-4de2-a9a7-5e7c4773b051 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:24:03.178165 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b450a-ea7f-4de2-a9a7-5e7c4773b051 admin admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:24:03.178864 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703b450a-ea7f-4de2-a9a7-5e7c4773b051 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:24:03.180767 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703b450a-ea7f-4de2-a9a7-5e7c4773b051 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:24:03.206352 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1367/2738] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 09:24:03 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:24:03.210556 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa4de45-2319-4ee0-90c9-a49aeec44782 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:24:03.221988 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa4de45-2319-4ee0-90c9-a49aeec44782 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:24:03.285723 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f03ad1-78f9-477b-9dd3-26bea594decd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:24:03.286331 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f03ad1-78f9-477b-9dd3-26bea594decd admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:24:03.286620 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f03ad1-78f9-477b-9dd3-26bea594decd admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:24:03.286898 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f03ad1-78f9-477b-9dd3-26bea594decd admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:24:03.287584 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f03ad1-78f9-477b-9dd3-26bea594decd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:24:03.289513 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f03ad1-78f9-477b-9dd3-26bea594decd admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:24:03.309983 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1372/2739] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 09:24:03 2022] POST /identity/v3/users => generated 299 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:24:03.314432 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b450a-ea7f-4de2-a9a7-5e7c4773b051 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:24:03.325536 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b450a-ea7f-4de2-a9a7-5e7c4773b051 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:24:03.330126 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e56a25-1667-4dea-8a96-83d91d9dd5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:24:03.330785 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e56a25-1667-4dea-8a96-83d91d9dd5c9 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:24:03.331066 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e56a25-1667-4dea-8a96-83d91d9dd5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:24:03.331343 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e56a25-1667-4dea-8a96-83d91d9dd5c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:24:03.332061 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e56a25-1667-4dea-8a96-83d91d9dd5c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:24:03.333671 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e56a25-1667-4dea-8a96-83d91d9dd5c9 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:24:03.344744 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1368/2740] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 09:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:24:03.349031 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f03ad1-78f9-477b-9dd3-26bea594decd admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:24:03.359921 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f03ad1-78f9-477b-9dd3-26bea594decd admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:24:03.364679 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f53f6-e30b-4b08-975b-8f7c51ef5435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:24:03.365559 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f53f6-e30b-4b08-975b-8f7c51ef5435 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:24:03.365837 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f53f6-e30b-4b08-975b-8f7c51ef5435 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:24:03.366138 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f53f6-e30b-4b08-975b-8f7c51ef5435 admin admin] PATH_INFO: `/v3/projects/871c3c85b04140d496ce6669265870d3/users/d4a719d37d524cd590b0755ce303cd17/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:24:03.381418 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2f53f6-e30b-4b08-975b-8f7c51ef5435 admin admin] RBAC: Authorizing `identity:create_grant(project_id=871c3c85b04140d496ce6669265870d3, user_id=d4a719d37d524cd590b0755ce303cd17, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:24:03.384101 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2f53f6-e30b-4b08-975b-8f7c51ef5435 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:24:03.398595 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1373/2741] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 09:24:03 2022] PUT /identity/v3/projects/871c3c85b04140d496ce6669265870d3/users/d4a719d37d524cd590b0755ce303cd17/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:24:03.403207 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e56a25-1667-4dea-8a96-83d91d9dd5c9 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:24:03.413428 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e56a25-1667-4dea-8a96-83d91d9dd5c9 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:24:03.418776 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:24:03.478350 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb5338-86b6-4b31-8138-389753becbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:24:03.479017 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb5338-86b6-4b31-8138-389753becbcd admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:24:03.479305 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb5338-86b6-4b31-8138-389753becbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:24:03.479602 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb5338-86b6-4b31-8138-389753becbcd admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:24:03.480307 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeb5338-86b6-4b31-8138-389753becbcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:24:03.482517 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeb5338-86b6-4b31-8138-389753becbcd admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:24:03.492406 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1369/2742] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 09:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:24:03.496808 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f53f6-e30b-4b08-975b-8f7c51ef5435 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:24:03.508765 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f53f6-e30b-4b08-975b-8f7c51ef5435 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:24:03.513752 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9d8ec4-54a8-4aa4-8f99-72f67d1ad355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:24:03.514677 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d8ec4-54a8-4aa4-8f99-72f67d1ad355 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:24:03.514959 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d8ec4-54a8-4aa4-8f99-72f67d1ad355 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:24:03.515266 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d8ec4-54a8-4aa4-8f99-72f67d1ad355 admin admin] PATH_INFO: `/v3/projects/871c3c85b04140d496ce6669265870d3/users/d4a719d37d524cd590b0755ce303cd17/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:24:03.517270 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9d8ec4-54a8-4aa4-8f99-72f67d1ad355 admin admin] RBAC: Authorizing `identity:create_grant(project_id=871c3c85b04140d496ce6669265870d3, user_id=d4a719d37d524cd590b0755ce303cd17, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:24:03.519960 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9d8ec4-54a8-4aa4-8f99-72f67d1ad355 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:24:03.531241 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1374/2743] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 09:24:03 2022] PUT /identity/v3/projects/871c3c85b04140d496ce6669265870d3/users/d4a719d37d524cd590b0755ce303cd17/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:24:03.541687 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ffd07-2492-4f99-8459-520daa5b5a84 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:24:03.541909 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ffd07-2492-4f99-8459-520daa5b5a84 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:24:03.542241 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ffd07-2492-4f99-8459-520daa5b5a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:24:03.569692 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-1b7ffd07-2492-4f99-8459-520daa5b5a84 None None] MFA Rules not processed for user `d4a719d37d524cd590b0755ce303cd17`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:24:03.570960 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-1b7ffd07-2492-4f99-8459-520daa5b5a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:24:03.641550 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1370/2744] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:24:03 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:24:03.653859 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9d8ec4-54a8-4aa4-8f99-72f67d1ad355 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:24:03.655658 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-2d9d8ec4-54a8-4aa4-8f99-72f67d1ad355 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:24:03.680046 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:24:03.719512 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9d8ec4-54a8-4aa4-8f99-72f67d1ad355 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:24:03.723243 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2210151-47f6-453c-bced-c104ac5ab5ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:24:03.723891 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2210151-47f6-453c-bced-c104ac5ab5ad service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:24:03.724176 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2210151-47f6-453c-bced-c104ac5ab5ad service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:24:03.724451 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2210151-47f6-453c-bced-c104ac5ab5ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:24:03.786410 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2210151-47f6-453c-bced-c104ac5ab5ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:24:03.787866 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2210151-47f6-453c-bced-c104ac5ab5ad service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:24:03.797574 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1375/2745] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:24:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:24:05.332138 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ffd07-2492-4f99-8459-520daa5b5a84 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:24:05.342944 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ffd07-2492-4f99-8459-520daa5b5a84 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:24:05.346625 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f052f3-255e-47e8-bb9d-07c17875360f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:24:05.347282 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f052f3-255e-47e8-bb9d-07c17875360f service cinder] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:24:05.347588 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f052f3-255e-47e8-bb9d-07c17875360f service cinder] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:24:05.347856 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f052f3-255e-47e8-bb9d-07c17875360f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:24:05.415857 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f052f3-255e-47e8-bb9d-07c17875360f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:24:05.417299 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f052f3-255e-47e8-bb9d-07c17875360f service cinder] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:24:05.427917 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1371/2746] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:24:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:24:06.010236 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2210151-47f6-453c-bced-c104ac5ab5ad service cinder] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:24:06.019929 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2210151-47f6-453c-bced-c104ac5ab5ad service cinder] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:24:06.023607 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9194c0d6-830e-4459-9dc3-cdbfd4f2b4c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:24:06.024896 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194c0d6-830e-4459-9dc3-cdbfd4f2b4c9 service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:24:06.024896 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194c0d6-830e-4459-9dc3-cdbfd4f2b4c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:24:06.024896 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194c0d6-830e-4459-9dc3-cdbfd4f2b4c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:24:06.036839 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9194c0d6-830e-4459-9dc3-cdbfd4f2b4c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:24:06.038537 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9194c0d6-830e-4459-9dc3-cdbfd4f2b4c9 service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:24:06.051619 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1376/2747] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:24:06 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:24:09.951769 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f052f3-255e-47e8-bb9d-07c17875360f service cinder] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:24:09.983098 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:24:10.021355 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f052f3-255e-47e8-bb9d-07c17875360f service cinder] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:24:10.025842 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184b8f0d-bd72-4500-aef2-7d585ae61179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:24:10.026738 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b8f0d-bd72-4500-aef2-7d585ae61179 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:24:10.027588 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b8f0d-bd72-4500-aef2-7d585ae61179 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:24:10.027865 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b8f0d-bd72-4500-aef2-7d585ae61179 admin admin] PATH_INFO: `/v3/users/0c2d7bffb5314846ac880cf5dd93f3db` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:24:10.029045 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184b8f0d-bd72-4500-aef2-7d585ae61179 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c2d7bffb5314846ac880cf5dd93f3db)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:24:10.030997 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184b8f0d-bd72-4500-aef2-7d585ae61179 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:24:10.080213 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-184b8f0d-bd72-4500-aef2-7d585ae61179 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c2d7bffb5314846ac880cf5dd93f3db'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:10.087946 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-184b8f0d-bd72-4500-aef2-7d585ae61179 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c2d7bffb5314846ac880cf5dd93f3db'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:10.088697 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-184b8f0d-bd72-4500-aef2-7d585ae61179 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c2d7bffb5314846ac880cf5dd93f3db'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:10.096735 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-184b8f0d-bd72-4500-aef2-7d585ae61179 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c2d7bffb5314846ac880cf5dd93f3db'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:10.097355 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-184b8f0d-bd72-4500-aef2-7d585ae61179 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c2d7bffb5314846ac880cf5dd93f3db'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:10.115439 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1372/2748] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 09:24:09 2022] DELETE /identity/v3/users/0c2d7bffb5314846ac880cf5dd93f3db => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:24:10.120138 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a93c67-ce1f-4f0d-b729-7f204252d94c None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:24:10.120631 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a93c67-ce1f-4f0d-b729-7f204252d94c None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:24:10.120725 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a93c67-ce1f-4f0d-b729-7f204252d94c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:24:10.138227 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-04a93c67-ce1f-4f0d-b729-7f204252d94c None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:24:10.139349 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-04a93c67-ce1f-4f0d-b729-7f204252d94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:24:10.203340 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1377/2749] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:24:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:24:10.213514 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184b8f0d-bd72-4500-aef2-7d585ae61179 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:24:10.215539 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-184b8f0d-bd72-4500-aef2-7d585ae61179 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:24:10.280968 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184b8f0d-bd72-4500-aef2-7d585ae61179 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:24:10.284741 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0afc4e-0ef9-40a7-8c9a-402b9a92e660 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:24:10.285399 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0afc4e-0ef9-40a7-8c9a-402b9a92e660 service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:24:10.285686 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0afc4e-0ef9-40a7-8c9a-402b9a92e660 service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:24:10.285967 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0afc4e-0ef9-40a7-8c9a-402b9a92e660 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:24:10.299321 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0afc4e-0ef9-40a7-8c9a-402b9a92e660 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:24:10.300784 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0afc4e-0ef9-40a7-8c9a-402b9a92e660 service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:24:10.312834 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1373/2750] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:24:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:24:10.609524 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a93c67-ce1f-4f0d-b729-7f204252d94c None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:24:10.611075 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-04a93c67-ce1f-4f0d-b729-7f204252d94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:24:10.624145 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a93c67-ce1f-4f0d-b729-7f204252d94c None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:24:10.629131 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff45306-49fd-40cf-83e9-418e2859b2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:24:10.630197 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff45306-49fd-40cf-83e9-418e2859b2c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:24:10.630481 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff45306-49fd-40cf-83e9-418e2859b2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:24:10.630753 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff45306-49fd-40cf-83e9-418e2859b2c6 admin admin] PATH_INFO: `/v3/projects/b2feade4ba914dc19bd1747fb348c360` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:24:10.631967 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff45306-49fd-40cf-83e9-418e2859b2c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2feade4ba914dc19bd1747fb348c360)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:24:10.633894 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff45306-49fd-40cf-83e9-418e2859b2c6 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:24:10.682868 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-2ff45306-49fd-40cf-83e9-418e2859b2c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2feade4ba914dc19bd1747fb348c360', 'request_id': 'req-2ff45306-49fd-40cf-83e9-418e2859b2c6'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:10.687959 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:24:10.689220 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-2ff45306-49fd-40cf-83e9-418e2859b2c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2feade4ba914dc19bd1747fb348c360', 'request_id': 'req-2ff45306-49fd-40cf-83e9-418e2859b2c6'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:10.696427 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-2ff45306-49fd-40cf-83e9-418e2859b2c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2feade4ba914dc19bd1747fb348c360', 'request_id': 'req-2ff45306-49fd-40cf-83e9-418e2859b2c6'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:10.709565 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-2ff45306-49fd-40cf-83e9-418e2859b2c6 admin admin] The token cache is being invalidate because project b2feade4ba914dc19bd1747fb348c360 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:24:10.709846 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-2ff45306-49fd-40cf-83e9-418e2859b2c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:10.710549 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-2ff45306-49fd-40cf-83e9-418e2859b2c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:10.712193 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1378/2751] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 09:24:10 2022] DELETE /identity/v3/projects/b2feade4ba914dc19bd1747fb348c360 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:24:10.717586 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0afc4e-0ef9-40a7-8c9a-402b9a92e660 service neutron] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:24:10.727870 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0afc4e-0ef9-40a7-8c9a-402b9a92e660 service neutron] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:24:10.779511 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:24:10.790847 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc22eac3-0411-482d-a4a4-5ba0fcb84f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:24:10.791721 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22eac3-0411-482d-a4a4-5ba0fcb84f47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:24:10.792170 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22eac3-0411-482d-a4a4-5ba0fcb84f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:24:10.793132 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22eac3-0411-482d-a4a4-5ba0fcb84f47 admin admin] PATH_INFO: `/v3/users/36b0c3e6cc534acbbfc14bcc73c09d18` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:24:10.794483 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc22eac3-0411-482d-a4a4-5ba0fcb84f47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36b0c3e6cc534acbbfc14bcc73c09d18)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:24:10.796822 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc22eac3-0411-482d-a4a4-5ba0fcb84f47 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:24:10.844707 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-fc22eac3-0411-482d-a4a4-5ba0fcb84f47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36b0c3e6cc534acbbfc14bcc73c09d18'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:10.852372 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-fc22eac3-0411-482d-a4a4-5ba0fcb84f47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36b0c3e6cc534acbbfc14bcc73c09d18'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:10.853295 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-fc22eac3-0411-482d-a4a4-5ba0fcb84f47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36b0c3e6cc534acbbfc14bcc73c09d18'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:10.862744 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-fc22eac3-0411-482d-a4a4-5ba0fcb84f47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36b0c3e6cc534acbbfc14bcc73c09d18'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:10.863488 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-fc22eac3-0411-482d-a4a4-5ba0fcb84f47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36b0c3e6cc534acbbfc14bcc73c09d18'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:10.883954 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1374/2752] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 09:24:10 2022] DELETE /identity/v3/users/36b0c3e6cc534acbbfc14bcc73c09d18 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:24:11.162557 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff45306-49fd-40cf-83e9-418e2859b2c6 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:24:11.164015 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-2ff45306-49fd-40cf-83e9-418e2859b2c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:24:11.180143 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff45306-49fd-40cf-83e9-418e2859b2c6 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:24:11.242314 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa2903-49aa-4d3c-889c-fd458e9b193a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:24:11.243084 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa2903-49aa-4d3c-889c-fd458e9b193a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:24:11.243364 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa2903-49aa-4d3c-889c-fd458e9b193a admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:24:11.243637 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa2903-49aa-4d3c-889c-fd458e9b193a admin admin] PATH_INFO: `/v3/projects/7624481ddf3c440c8c621357c68fd985` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:24:11.244923 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befa2903-49aa-4d3c-889c-fd458e9b193a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7624481ddf3c440c8c621357c68fd985)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:24:11.246938 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befa2903-49aa-4d3c-889c-fd458e9b193a admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:24:11.301315 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-befa2903-49aa-4d3c-889c-fd458e9b193a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7624481ddf3c440c8c621357c68fd985', 'request_id': 'req-befa2903-49aa-4d3c-889c-fd458e9b193a'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:11.306993 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-befa2903-49aa-4d3c-889c-fd458e9b193a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7624481ddf3c440c8c621357c68fd985', 'request_id': 'req-befa2903-49aa-4d3c-889c-fd458e9b193a'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:11.313920 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-befa2903-49aa-4d3c-889c-fd458e9b193a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7624481ddf3c440c8c621357c68fd985', 'request_id': 'req-befa2903-49aa-4d3c-889c-fd458e9b193a'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:11.327647 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-befa2903-49aa-4d3c-889c-fd458e9b193a admin admin] The token cache is being invalidate because project 7624481ddf3c440c8c621357c68fd985 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:24:11.327978 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-befa2903-49aa-4d3c-889c-fd458e9b193a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:11.328578 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-befa2903-49aa-4d3c-889c-fd458e9b193a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:11.330173 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1379/2753] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 09:24:11 2022] DELETE /identity/v3/projects/7624481ddf3c440c8c621357c68fd985 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:24:11.334258 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc22eac3-0411-482d-a4a4-5ba0fcb84f47 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:24:11.335758 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-fc22eac3-0411-482d-a4a4-5ba0fcb84f47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:24:11.349364 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc22eac3-0411-482d-a4a4-5ba0fcb84f47 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:24:11.409696 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa7ecf5-e170-491e-9c16-eb7c5a79d0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:24:11.410599 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa7ecf5-e170-491e-9c16-eb7c5a79d0c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:24:11.410877 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa7ecf5-e170-491e-9c16-eb7c5a79d0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:24:11.411619 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa7ecf5-e170-491e-9c16-eb7c5a79d0c0 admin admin] PATH_INFO: `/v3/users/d4a719d37d524cd590b0755ce303cd17` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:24:11.412857 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa7ecf5-e170-491e-9c16-eb7c5a79d0c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4a719d37d524cd590b0755ce303cd17)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:24:11.414963 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa7ecf5-e170-491e-9c16-eb7c5a79d0c0 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:24:11.461952 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-9aa7ecf5-e170-491e-9c16-eb7c5a79d0c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4a719d37d524cd590b0755ce303cd17'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:11.469910 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-9aa7ecf5-e170-491e-9c16-eb7c5a79d0c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4a719d37d524cd590b0755ce303cd17'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:11.470619 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-9aa7ecf5-e170-491e-9c16-eb7c5a79d0c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4a719d37d524cd590b0755ce303cd17'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:11.478359 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-9aa7ecf5-e170-491e-9c16-eb7c5a79d0c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4a719d37d524cd590b0755ce303cd17'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:11.479000 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-9aa7ecf5-e170-491e-9c16-eb7c5a79d0c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4a719d37d524cd590b0755ce303cd17'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:11.486717 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:24:11.502722 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1375/2754] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 09:24:11 2022] DELETE /identity/v3/users/d4a719d37d524cd590b0755ce303cd17 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:24:11.790248 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa2903-49aa-4d3c-889c-fd458e9b193a admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:24:11.791789 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-befa2903-49aa-4d3c-889c-fd458e9b193a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:24:11.805974 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa2903-49aa-4d3c-889c-fd458e9b193a admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:24:11.867777 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1349d9f5-731c-4088-bf8d-8c2dbd02ed22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:24:11.868757 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349d9f5-731c-4088-bf8d-8c2dbd02ed22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:24:11.869072 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349d9f5-731c-4088-bf8d-8c2dbd02ed22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:24:11.869450 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349d9f5-731c-4088-bf8d-8c2dbd02ed22 admin admin] PATH_INFO: `/v3/projects/871c3c85b04140d496ce6669265870d3` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:24:11.871346 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1349d9f5-731c-4088-bf8d-8c2dbd02ed22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=871c3c85b04140d496ce6669265870d3)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:24:11.873474 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1349d9f5-731c-4088-bf8d-8c2dbd02ed22 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:24:11.891850 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:24:11.923814 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-1349d9f5-731c-4088-bf8d-8c2dbd02ed22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '871c3c85b04140d496ce6669265870d3', 'request_id': 'req-1349d9f5-731c-4088-bf8d-8c2dbd02ed22'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:11.929279 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-1349d9f5-731c-4088-bf8d-8c2dbd02ed22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '871c3c85b04140d496ce6669265870d3', 'request_id': 'req-1349d9f5-731c-4088-bf8d-8c2dbd02ed22'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:11.936247 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-1349d9f5-731c-4088-bf8d-8c2dbd02ed22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '871c3c85b04140d496ce6669265870d3', 'request_id': 'req-1349d9f5-731c-4088-bf8d-8c2dbd02ed22'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:11.949368 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-1349d9f5-731c-4088-bf8d-8c2dbd02ed22 admin admin] The token cache is being invalidate because project 871c3c85b04140d496ce6669265870d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:24:11.949654 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-1349d9f5-731c-4088-bf8d-8c2dbd02ed22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:11.950320 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-1349d9f5-731c-4088-bf8d-8c2dbd02ed22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:11.952115 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1380/2755] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 09:24:11 2022] DELETE /identity/v3/projects/871c3c85b04140d496ce6669265870d3 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:24:11.957305 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f1da7-1c52-4b21-8c93-b50639b1d3fb None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:24:11.957597 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f1da7-1c52-4b21-8c93-b50639b1d3fb None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:24:11.957875 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f1da7-1c52-4b21-8c93-b50639b1d3fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:24:11.976489 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-044f1da7-1c52-4b21-8c93-b50639b1d3fb None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:24:11.977762 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-044f1da7-1c52-4b21-8c93-b50639b1d3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:24:12.042387 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1376/2756] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:24:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:24:12.052567 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a18e0c-63c2-4e84-834c-2d6f4b747409 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:24:12.052885 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a18e0c-63c2-4e84-834c-2d6f4b747409 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:24:12.053111 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a18e0c-63c2-4e84-834c-2d6f4b747409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:24:12.073734 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-75a18e0c-63c2-4e84-834c-2d6f4b747409 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:24:12.075154 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-75a18e0c-63c2-4e84-834c-2d6f4b747409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:24:12.084550 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1381/2757] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:24:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:24:12.088799 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044f1da7-1c52-4b21-8c93-b50639b1d3fb None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:24:12.098761 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044f1da7-1c52-4b21-8c93-b50639b1d3fb None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:24:12.103407 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c6fdd2-5cc2-4b26-838c-7a4e9f7e6530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:24:12.104065 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6fdd2-5cc2-4b26-838c-7a4e9f7e6530 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:24:12.104348 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6fdd2-5cc2-4b26-838c-7a4e9f7e6530 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:24:12.104627 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6fdd2-5cc2-4b26-838c-7a4e9f7e6530 admin admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:24:12.105904 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c6fdd2-5cc2-4b26-838c-7a4e9f7e6530 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:24:12.106248 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c6fdd2-5cc2-4b26-838c-7a4e9f7e6530 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:24:12.107882 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c6fdd2-5cc2-4b26-838c-7a4e9f7e6530 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:24:12.120068 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1377/2758] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Jun 22 09:24:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:24:12.125281 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a18e0c-63c2-4e84-834c-2d6f4b747409 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:24:12.134680 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a18e0c-63c2-4e84-834c-2d6f4b747409 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:24:12.139359 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1140b9c2-b7fe-40fc-9fc5-67c5948fa49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:24:12.140004 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1140b9c2-b7fe-40fc-9fc5-67c5948fa49a admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:24:12.140289 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1140b9c2-b7fe-40fc-9fc5-67c5948fa49a admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:24:12.140567 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1140b9c2-b7fe-40fc-9fc5-67c5948fa49a admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:24:12.141256 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1140b9c2-b7fe-40fc-9fc5-67c5948fa49a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:24:12.143198 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1140b9c2-b7fe-40fc-9fc5-67c5948fa49a admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:24:12.170317 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1382/2759] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 09:24:12 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:24:12.174564 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c6fdd2-5cc2-4b26-838c-7a4e9f7e6530 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:24:12.185250 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c6fdd2-5cc2-4b26-838c-7a4e9f7e6530 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:24:12.242180 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f871e11-cc6c-4d17-9462-299da58a0e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:24:12.242854 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f871e11-cc6c-4d17-9462-299da58a0e7a admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:24:12.243134 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f871e11-cc6c-4d17-9462-299da58a0e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:24:12.243407 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f871e11-cc6c-4d17-9462-299da58a0e7a admin admin] PATH_INFO: `/v3/users` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:24:12.244109 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f871e11-cc6c-4d17-9462-299da58a0e7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:24:12.246611 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f871e11-cc6c-4d17-9462-299da58a0e7a admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:24:12.268150 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1378/2760] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 09:24:12 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:24:12.272281 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1140b9c2-b7fe-40fc-9fc5-67c5948fa49a admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:24:12.283373 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1140b9c2-b7fe-40fc-9fc5-67c5948fa49a admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:24:12.288074 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd74191a-1175-4dc3-a4bb-8926540af3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:24:12.288734 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74191a-1175-4dc3-a4bb-8926540af3b1 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:24:12.289019 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74191a-1175-4dc3-a4bb-8926540af3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:24:12.289295 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74191a-1175-4dc3-a4bb-8926540af3b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:24:12.290025 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd74191a-1175-4dc3-a4bb-8926540af3b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:24:12.291658 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd74191a-1175-4dc3-a4bb-8926540af3b1 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:24:12.303131 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1383/2761] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 09:24:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:24:12.307079 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f871e11-cc6c-4d17-9462-299da58a0e7a admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:24:12.317363 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f871e11-cc6c-4d17-9462-299da58a0e7a admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:24:12.322039 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1423e2-e3c4-4aa8-aff6-9ac170bf7eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:24:12.322738 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1423e2-e3c4-4aa8-aff6-9ac170bf7eda admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:24:12.323028 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1423e2-e3c4-4aa8-aff6-9ac170bf7eda admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:24:12.323313 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1423e2-e3c4-4aa8-aff6-9ac170bf7eda admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:24:12.324055 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1423e2-e3c4-4aa8-aff6-9ac170bf7eda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:24:12.325663 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1423e2-e3c4-4aa8-aff6-9ac170bf7eda admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:24:12.336338 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1379/2762] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 09:24:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:24:12.340939 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd74191a-1175-4dc3-a4bb-8926540af3b1 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:24:12.351061 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd74191a-1175-4dc3-a4bb-8926540af3b1 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:24:12.356262 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e554407-0c76-4be0-91bf-a6dd8b7a1d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:24:12.357138 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e554407-0c76-4be0-91bf-a6dd8b7a1d25 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:24:12.357433 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e554407-0c76-4be0-91bf-a6dd8b7a1d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:24:12.357683 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e554407-0c76-4be0-91bf-a6dd8b7a1d25 admin admin] PATH_INFO: `/v3/projects/f2d4b585f44047d0b7394f99bb342476/users/9e3852cd9f374a4286e76a78e8a699df/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:24:12.373020 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e554407-0c76-4be0-91bf-a6dd8b7a1d25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2d4b585f44047d0b7394f99bb342476, user_id=9e3852cd9f374a4286e76a78e8a699df, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:24:12.376084 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e554407-0c76-4be0-91bf-a6dd8b7a1d25 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:24:12.390504 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1384/2763] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 09:24:12 2022] PUT /identity/v3/projects/f2d4b585f44047d0b7394f99bb342476/users/9e3852cd9f374a4286e76a78e8a699df/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:24:12.396364 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599751fa-204d-408a-85a8-a236f776a9c6 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:24:12.396703 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599751fa-204d-408a-85a8-a236f776a9c6 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:24:12.397037 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599751fa-204d-408a-85a8-a236f776a9c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:24:12.415038 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-599751fa-204d-408a-85a8-a236f776a9c6 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:24:12.416251 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-599751fa-204d-408a-85a8-a236f776a9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:24:12.465199 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:24:12.478068 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1380/2764] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:24:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:24:12.487770 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e554407-0c76-4be0-91bf-a6dd8b7a1d25 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:24:12.489651 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-8e554407-0c76-4be0-91bf-a6dd8b7a1d25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:24:12.549043 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e554407-0c76-4be0-91bf-a6dd8b7a1d25 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:24:12.552770 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06addffa-ed96-4e4a-a062-554a68bb7bda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:24:12.553546 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06addffa-ed96-4e4a-a062-554a68bb7bda service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:24:12.553691 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06addffa-ed96-4e4a-a062-554a68bb7bda service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:24:12.553969 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06addffa-ed96-4e4a-a062-554a68bb7bda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:24:12.564246 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06addffa-ed96-4e4a-a062-554a68bb7bda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:24:12.565727 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06addffa-ed96-4e4a-a062-554a68bb7bda service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:24:12.576849 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1385/2765] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:24:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:24:13.187227 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106a1286-9a43-4ca8-ae3b-6e229fdc1c23 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:24:13.187522 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106a1286-9a43-4ca8-ae3b-6e229fdc1c23 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:24:13.187807 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106a1286-9a43-4ca8-ae3b-6e229fdc1c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:24:13.215553 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-106a1286-9a43-4ca8-ae3b-6e229fdc1c23 None None] MFA Rules not processed for user `9e3852cd9f374a4286e76a78e8a699df`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:24:13.216784 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-106a1286-9a43-4ca8-ae3b-6e229fdc1c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:24:13.293207 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1381/2766] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:24:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:24:13.303892 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06addffa-ed96-4e4a-a062-554a68bb7bda service neutron] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:24:13.305320 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-06addffa-ed96-4e4a-a062-554a68bb7bda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:24:13.354349 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:24:13.367549 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06addffa-ed96-4e4a-a062-554a68bb7bda service neutron] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:24:13.372010 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc77712-42ec-417d-bcdf-e2dff582666b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:24:13.372663 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc77712-42ec-417d-bcdf-e2dff582666b service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:24:13.372947 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc77712-42ec-417d-bcdf-e2dff582666b service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:24:13.373220 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc77712-42ec-417d-bcdf-e2dff582666b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:24:13.382540 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc77712-42ec-417d-bcdf-e2dff582666b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:24:13.384003 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc77712-42ec-417d-bcdf-e2dff582666b service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:24:13.393524 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1386/2767] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:24:13 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:24:14.761740 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad50246-d155-4d60-86fb-7b7331fa7299 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:24:14.762336 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad50246-d155-4d60-86fb-7b7331fa7299 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:24:14.762448 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad50246-d155-4d60-86fb-7b7331fa7299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:24:14.781095 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-cad50246-d155-4d60-86fb-7b7331fa7299 None None] MFA Rules not processed for user `9e3852cd9f374a4286e76a78e8a699df`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:24:14.782357 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-cad50246-d155-4d60-86fb-7b7331fa7299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:24:14.791039 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1382/2768] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:24:14 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:24:23.389180 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=6 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:24:24.775048 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=37 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:24:29.190736 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4bd9a9-d6d9-4a04-9d47-a5aba6006a7a None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:24:29.191340 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4bd9a9-d6d9-4a04-9d47-a5aba6006a7a None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:24:29.191340 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4bd9a9-d6d9-4a04-9d47-a5aba6006a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:24:29.210096 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-5b4bd9a9-d6d9-4a04-9d47-a5aba6006a7a None None] MFA Rules not processed for user `9e3852cd9f374a4286e76a78e8a699df`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:24:29.211329 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-5b4bd9a9-d6d9-4a04-9d47-a5aba6006a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:24:29.219267 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1387/2769] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:24:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:24:29.460733 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad50246-d155-4d60-86fb-7b7331fa7299 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:24:29.462180 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-cad50246-d155-4d60-86fb-7b7331fa7299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:24:29.475394 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad50246-d155-4d60-86fb-7b7331fa7299 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:24:29.479251 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2253ae-b45e-483c-bae9-e7f7c41c68ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:24:29.480071 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2253ae-b45e-483c-bae9-e7f7c41c68ef service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:24:29.480361 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2253ae-b45e-483c-bae9-e7f7c41c68ef service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:24:29.480643 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2253ae-b45e-483c-bae9-e7f7c41c68ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:24:29.482489 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-1c2253ae-b45e-483c-bae9-e7f7c41c68ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:24:29.492877 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2253ae-b45e-483c-bae9-e7f7c41c68ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:24:29.494354 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2253ae-b45e-483c-bae9-e7f7c41c68ef service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:24:29.504287 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1383/2770] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:24:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:24:39.207487 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:24:39.500029 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=6 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:24:49.837556 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59d84e-5a28-487e-bc83-e381c20e486e None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:24:49.838139 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59d84e-5a28-487e-bc83-e381c20e486e None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:24:49.838139 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59d84e-5a28-487e-bc83-e381c20e486e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:24:49.897179 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-4f59d84e-5a28-487e-bc83-e381c20e486e None None] MFA Rules not processed for user `2bf91272d78b4e8f854c760622465af9`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:24:49.898441 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-4f59d84e-5a28-487e-bc83-e381c20e486e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:24:49.965244 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1388/2771] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Jun 22 09:24:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:24:50.024936 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2253ae-b45e-483c-bae9-e7f7c41c68ef service neutron] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:24:50.026931 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-1c2253ae-b45e-483c-bae9-e7f7c41c68ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:24:50.119744 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2253ae-b45e-483c-bae9-e7f7c41c68ef service neutron] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:24:50.125237 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9f21fd-6af4-4c39-aeb6-ca6c9b61274a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4403cea84ff646b88cdb785975b20346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:24:50.125887 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f21fd-6af4-4c39-aeb6-ca6c9b61274a service swift] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:24:50.126210 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f21fd-6af4-4c39-aeb6-ca6c9b61274a service swift] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:24:50.126493 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f21fd-6af4-4c39-aeb6-ca6c9b61274a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:24:50.136169 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9f21fd-6af4-4c39-aeb6-ca6c9b61274a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:24:50.139132 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9f21fd-6af4-4c39-aeb6-ca6c9b61274a service swift] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:24:50.149478 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1384/2772] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Jun 22 09:24:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 22 09:24:59.962126 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=44 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:25:00.146091 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=41 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:25:05.228611 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e541f4-bbec-4182-8779-aa29f2b33106 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:25:05.229072 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e541f4-bbec-4182-8779-aa29f2b33106 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:25:05.229173 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e541f4-bbec-4182-8779-aa29f2b33106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:25:05.247564 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-c2e541f4-bbec-4182-8779-aa29f2b33106 None None] MFA Rules not processed for user `2bf91272d78b4e8f854c760622465af9`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:25:05.249046 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-c2e541f4-bbec-4182-8779-aa29f2b33106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:25:05.256442 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1389/2773] 10.222.0.42 () {58 vars in 967 bytes} [Wed Jun 22 09:25:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:25:05.269263 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9f21fd-6af4-4c39-aeb6-ca6c9b61274a service swift] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:25:05.280645 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9f21fd-6af4-4c39-aeb6-ca6c9b61274a service swift] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:25:05.285896 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa46075-ad06-4d7b-8ad8-bc5b4371aa7f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4403cea84ff646b88cdb785975b20346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:25:05.286603 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa46075-ad06-4d7b-8ad8-bc5b4371aa7f service swift] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:25:05.286882 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa46075-ad06-4d7b-8ad8-bc5b4371aa7f service swift] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:25:05.287162 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa46075-ad06-4d7b-8ad8-bc5b4371aa7f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:25:05.295499 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa46075-ad06-4d7b-8ad8-bc5b4371aa7f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:25:05.297104 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa46075-ad06-4d7b-8ad8-bc5b4371aa7f service swift] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:25:05.305390 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1385/2774] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Jun 22 09:25:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 09:25:07.237717 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e541f4-bbec-4182-8779-aa29f2b33106 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:25:07.250192 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e541f4-bbec-4182-8779-aa29f2b33106 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:25:07.255383 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae525ad2-2bea-41b2-a483-eb4d621667c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:25:07.256511 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae525ad2-2bea-41b2-a483-eb4d621667c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:25:07.256975 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae525ad2-2bea-41b2-a483-eb4d621667c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:25:07.258034 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae525ad2-2bea-41b2-a483-eb4d621667c4 admin admin] PATH_INFO: `/v3/users/9e3852cd9f374a4286e76a78e8a699df` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:25:07.260147 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae525ad2-2bea-41b2-a483-eb4d621667c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e3852cd9f374a4286e76a78e8a699df)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:25:07.262352 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae525ad2-2bea-41b2-a483-eb4d621667c4 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:25:07.309554 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-ae525ad2-2bea-41b2-a483-eb4d621667c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e3852cd9f374a4286e76a78e8a699df'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:25:07.317508 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-ae525ad2-2bea-41b2-a483-eb4d621667c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e3852cd9f374a4286e76a78e8a699df'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:25:07.317779 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-ae525ad2-2bea-41b2-a483-eb4d621667c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e3852cd9f374a4286e76a78e8a699df'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:25:07.325582 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-ae525ad2-2bea-41b2-a483-eb4d621667c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e3852cd9f374a4286e76a78e8a699df'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:25:07.326246 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-ae525ad2-2bea-41b2-a483-eb4d621667c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e3852cd9f374a4286e76a78e8a699df'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:25:07.345343 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1390/2775] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 09:25:07 2022] DELETE /identity/v3/users/9e3852cd9f374a4286e76a78e8a699df => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:25:07.522839 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa46075-ad06-4d7b-8ad8-bc5b4371aa7f service swift] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:25:07.534209 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa46075-ad06-4d7b-8ad8-bc5b4371aa7f service swift] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:25:07.629816 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec97e4a-19ea-40bb-86c8-e29c7b8491d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:25:07.631357 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec97e4a-19ea-40bb-86c8-e29c7b8491d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:25:07.631846 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec97e4a-19ea-40bb-86c8-e29c7b8491d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:25:07.632325 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec97e4a-19ea-40bb-86c8-e29c7b8491d2 admin admin] PATH_INFO: `/v3/projects/f2d4b585f44047d0b7394f99bb342476` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:25:07.634915 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec97e4a-19ea-40bb-86c8-e29c7b8491d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2d4b585f44047d0b7394f99bb342476)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:25:07.638610 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec97e4a-19ea-40bb-86c8-e29c7b8491d2 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:25:07.703947 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-4ec97e4a-19ea-40bb-86c8-e29c7b8491d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2d4b585f44047d0b7394f99bb342476', 'request_id': 'req-4ec97e4a-19ea-40bb-86c8-e29c7b8491d2'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:25:07.709549 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-4ec97e4a-19ea-40bb-86c8-e29c7b8491d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2d4b585f44047d0b7394f99bb342476', 'request_id': 'req-4ec97e4a-19ea-40bb-86c8-e29c7b8491d2'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:25:07.716894 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-4ec97e4a-19ea-40bb-86c8-e29c7b8491d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2d4b585f44047d0b7394f99bb342476', 'request_id': 'req-4ec97e4a-19ea-40bb-86c8-e29c7b8491d2'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:25:07.729543 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-4ec97e4a-19ea-40bb-86c8-e29c7b8491d2 admin admin] The token cache is being invalidate because project f2d4b585f44047d0b7394f99bb342476 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:25:07.729843 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-4ec97e4a-19ea-40bb-86c8-e29c7b8491d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:25:07.730548 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-4ec97e4a-19ea-40bb-86c8-e29c7b8491d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:25:07.732141 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1386/2776] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 09:25:07 2022] DELETE /identity/v3/projects/f2d4b585f44047d0b7394f99bb342476 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:25:07.738486 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d1ebd2-2c4b-46c1-8fd9-c8941dd43815 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:25:07.738782 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d1ebd2-2c4b-46c1-8fd9-c8941dd43815 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:25:07.739064 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d1ebd2-2c4b-46c1-8fd9-c8941dd43815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:25:07.759341 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-17d1ebd2-2c4b-46c1-8fd9-c8941dd43815 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:25:07.760596 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-17d1ebd2-2c4b-46c1-8fd9-c8941dd43815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:25:07.821136 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1391/2777] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:25:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:25:07.828915 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0f4dfb-a29e-4501-9d8a-d26df4ecd383 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:25:07.829209 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0f4dfb-a29e-4501-9d8a-d26df4ecd383 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:25:07.829493 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0f4dfb-a29e-4501-9d8a-d26df4ecd383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:25:07.853661 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-7a0f4dfb-a29e-4501-9d8a-d26df4ecd383 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:25:07.854995 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-7a0f4dfb-a29e-4501-9d8a-d26df4ecd383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:25:07.865242 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1387/2778] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:25:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:25:07.869492 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d1ebd2-2c4b-46c1-8fd9-c8941dd43815 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:25:07.879671 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d1ebd2-2c4b-46c1-8fd9-c8941dd43815 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:25:07.884250 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2c6f47-a5dd-4ea1-979a-502aa9cdbc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:25:07.884903 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c6f47-a5dd-4ea1-979a-502aa9cdbc40 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:25:07.885191 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c6f47-a5dd-4ea1-979a-502aa9cdbc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:25:07.885468 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c6f47-a5dd-4ea1-979a-502aa9cdbc40 admin admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:25:07.886249 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2c6f47-a5dd-4ea1-979a-502aa9cdbc40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:25:07.886562 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2c6f47-a5dd-4ea1-979a-502aa9cdbc40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:25:07.888167 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2c6f47-a5dd-4ea1-979a-502aa9cdbc40 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:25:07.900372 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1392/2779] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Jun 22 09:25:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:25:07.905186 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0f4dfb-a29e-4501-9d8a-d26df4ecd383 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:25:07.915429 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0f4dfb-a29e-4501-9d8a-d26df4ecd383 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:25:07.920174 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c8b25d-39c5-4592-9d2a-813934408148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:25:07.920824 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c8b25d-39c5-4592-9d2a-813934408148 admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:25:07.921114 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c8b25d-39c5-4592-9d2a-813934408148 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:25:07.921395 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c8b25d-39c5-4592-9d2a-813934408148 admin admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:25:07.922117 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c8b25d-39c5-4592-9d2a-813934408148 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:25:07.924024 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c8b25d-39c5-4592-9d2a-813934408148 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:25:07.951830 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1388/2780] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 09:25:07 2022] POST /identity/v3/projects => generated 397 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:25:07.960395 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2c6f47-a5dd-4ea1-979a-502aa9cdbc40 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:25:07.973379 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2c6f47-a5dd-4ea1-979a-502aa9cdbc40 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:25:08.024348 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:25:08.036029 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9c60dd-c7cb-45d9-96a3-25723c8fbdc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:25:08.036706 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c60dd-c7cb-45d9-96a3-25723c8fbdc5 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:25:08.036987 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c60dd-c7cb-45d9-96a3-25723c8fbdc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:25:08.037261 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c60dd-c7cb-45d9-96a3-25723c8fbdc5 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:25:08.038058 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9c60dd-c7cb-45d9-96a3-25723c8fbdc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:25:08.040058 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9c60dd-c7cb-45d9-96a3-25723c8fbdc5 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:25:08.064347 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1393/2781] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 09:25:07 2022] POST /identity/v3/users => generated 299 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:25:08.069336 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c8b25d-39c5-4592-9d2a-813934408148 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:25:08.083364 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c8b25d-39c5-4592-9d2a-813934408148 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:25:08.089111 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee66305-c736-4684-a026-0f2dac5a0664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:25:08.089943 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee66305-c736-4684-a026-0f2dac5a0664 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:25:08.090395 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee66305-c736-4684-a026-0f2dac5a0664 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:25:08.090811 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee66305-c736-4684-a026-0f2dac5a0664 admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:25:08.091726 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee66305-c736-4684-a026-0f2dac5a0664 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:25:08.093832 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee66305-c736-4684-a026-0f2dac5a0664 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:25:08.107809 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1389/2782] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 09:25:08 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:25:08.111782 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9c60dd-c7cb-45d9-96a3-25723c8fbdc5 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:25:08.122914 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9c60dd-c7cb-45d9-96a3-25723c8fbdc5 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:25:08.127946 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d468cb-15a8-4f77-b722-b780606df6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:25:08.128610 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d468cb-15a8-4f77-b722-b780606df6ad admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:25:08.128957 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d468cb-15a8-4f77-b722-b780606df6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:25:08.129236 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d468cb-15a8-4f77-b722-b780606df6ad admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:25:08.129971 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d468cb-15a8-4f77-b722-b780606df6ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:25:08.131611 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d468cb-15a8-4f77-b722-b780606df6ad admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:25:08.142049 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1394/2783] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 09:25:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:25:08.146661 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee66305-c736-4684-a026-0f2dac5a0664 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:25:08.159595 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee66305-c736-4684-a026-0f2dac5a0664 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:25:08.165764 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51222dae-53a5-482a-a570-6eb8732ea369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:25:08.166914 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51222dae-53a5-482a-a570-6eb8732ea369 admin admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:25:08.167277 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51222dae-53a5-482a-a570-6eb8732ea369 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:25:08.167654 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51222dae-53a5-482a-a570-6eb8732ea369 admin admin] PATH_INFO: `/v3/projects/97dafd9c8bcf46e6a9d7f8e4c3291efe/users/857a3da0b4ec450fbb274f4e7a86055e/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:25:08.186255 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51222dae-53a5-482a-a570-6eb8732ea369 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97dafd9c8bcf46e6a9d7f8e4c3291efe, user_id=857a3da0b4ec450fbb274f4e7a86055e, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:25:08.189596 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51222dae-53a5-482a-a570-6eb8732ea369 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:25:08.205453 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1390/2784] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 09:25:08 2022] PUT /identity/v3/projects/97dafd9c8bcf46e6a9d7f8e4c3291efe/users/857a3da0b4ec450fbb274f4e7a86055e/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:25:08.216172 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d204e0-2eb0-4e58-a9e5-cea0f973915e None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:25:08.216458 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d204e0-2eb0-4e58-a9e5-cea0f973915e None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:25:08.216735 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d204e0-2eb0-4e58-a9e5-cea0f973915e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:25:08.245027 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-70d204e0-2eb0-4e58-a9e5-cea0f973915e None None] MFA Rules not processed for user `857a3da0b4ec450fbb274f4e7a86055e`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:25:08.246297 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-70d204e0-2eb0-4e58-a9e5-cea0f973915e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:25:08.316685 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1395/2785] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:25:08 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:25:08.330752 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51222dae-53a5-482a-a570-6eb8732ea369 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:25:08.332790 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-51222dae-53a5-482a-a570-6eb8732ea369 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:25:08.349680 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:25:08.397358 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51222dae-53a5-482a-a570-6eb8732ea369 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:25:08.401711 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b33c4d-3d82-4e52-b2f2-0ad61d19dc66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:25:08.402402 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b33c4d-3d82-4e52-b2f2-0ad61d19dc66 service cinder] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:25:08.402687 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b33c4d-3d82-4e52-b2f2-0ad61d19dc66 service cinder] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:25:08.402966 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b33c4d-3d82-4e52-b2f2-0ad61d19dc66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:25:08.414336 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b33c4d-3d82-4e52-b2f2-0ad61d19dc66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:25:08.416634 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b33c4d-3d82-4e52-b2f2-0ad61d19dc66 service cinder] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:25:08.427706 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1391/2786] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:25:08 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:25:16.486061 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d204e0-2eb0-4e58-a9e5-cea0f973915e None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:25:16.550384 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d204e0-2eb0-4e58-a9e5-cea0f973915e None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:25:16.554874 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ad01a-e06b-4a9b-af3e-9dea552b45c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:25:16.555743 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ad01a-e06b-4a9b-af3e-9dea552b45c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:25:16.556027 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ad01a-e06b-4a9b-af3e-9dea552b45c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:25:16.556301 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ad01a-e06b-4a9b-af3e-9dea552b45c3 admin admin] PATH_INFO: `/v3/users/857a3da0b4ec450fbb274f4e7a86055e` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:25:16.557490 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ad01a-e06b-4a9b-af3e-9dea552b45c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=857a3da0b4ec450fbb274f4e7a86055e)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:25:16.559440 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ad01a-e06b-4a9b-af3e-9dea552b45c3 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:25:16.607567 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-948ad01a-e06b-4a9b-af3e-9dea552b45c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '857a3da0b4ec450fbb274f4e7a86055e'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:25:16.615541 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-948ad01a-e06b-4a9b-af3e-9dea552b45c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '857a3da0b4ec450fbb274f4e7a86055e'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:25:16.616264 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-948ad01a-e06b-4a9b-af3e-9dea552b45c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '857a3da0b4ec450fbb274f4e7a86055e'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:25:16.624792 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-948ad01a-e06b-4a9b-af3e-9dea552b45c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '857a3da0b4ec450fbb274f4e7a86055e'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:25:16.625571 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-948ad01a-e06b-4a9b-af3e-9dea552b45c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '857a3da0b4ec450fbb274f4e7a86055e'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:25:16.626846 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:25:16.648013 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1396/2787] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 09:25:16 2022] DELETE /identity/v3/users/857a3da0b4ec450fbb274f4e7a86055e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:25:16.653287 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59f7f5-c933-4dbd-9163-e835c73e3026 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:25:16.653796 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59f7f5-c933-4dbd-9163-e835c73e3026 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:25:16.653919 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59f7f5-c933-4dbd-9163-e835c73e3026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:25:16.671868 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-3e59f7f5-c933-4dbd-9163-e835c73e3026 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:25:16.673079 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-3e59f7f5-c933-4dbd-9163-e835c73e3026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:25:16.742248 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1392/2788] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:25:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:25:16.753758 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ad01a-e06b-4a9b-af3e-9dea552b45c3 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:25:16.755377 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-948ad01a-e06b-4a9b-af3e-9dea552b45c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:25:16.835970 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ad01a-e06b-4a9b-af3e-9dea552b45c3 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:25:16.839590 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb4e8b-a4d9-4a33-8b1b-ae3d96ed0d7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:25:16.840238 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb4e8b-a4d9-4a33-8b1b-ae3d96ed0d7a service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:25:16.840521 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb4e8b-a4d9-4a33-8b1b-ae3d96ed0d7a service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:25:16.840795 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb4e8b-a4d9-4a33-8b1b-ae3d96ed0d7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:25:16.850379 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cb4e8b-a4d9-4a33-8b1b-ae3d96ed0d7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:25:16.851865 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cb4e8b-a4d9-4a33-8b1b-ae3d96ed0d7a service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:25:16.861688 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1397/2789] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:25:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:25:17.165660 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59f7f5-c933-4dbd-9163-e835c73e3026 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:25:17.167456 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-3e59f7f5-c933-4dbd-9163-e835c73e3026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:25:17.188175 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59f7f5-c933-4dbd-9163-e835c73e3026 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:25:17.193496 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84d77f-4889-4a57-a7b5-50d29fb5342e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:25:17.199853 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84d77f-4889-4a57-a7b5-50d29fb5342e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:25:17.199853 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84d77f-4889-4a57-a7b5-50d29fb5342e admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:25:17.199853 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84d77f-4889-4a57-a7b5-50d29fb5342e admin admin] PATH_INFO: `/v3/projects/97dafd9c8bcf46e6a9d7f8e4c3291efe` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:25:17.199853 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c84d77f-4889-4a57-a7b5-50d29fb5342e admin admin] RBAC: Authorizing `identity:delete_project(project_id=97dafd9c8bcf46e6a9d7f8e4c3291efe)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:25:17.199853 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c84d77f-4889-4a57-a7b5-50d29fb5342e admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:25:17.248023 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-9c84d77f-4889-4a57-a7b5-50d29fb5342e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97dafd9c8bcf46e6a9d7f8e4c3291efe', 'request_id': 'req-9c84d77f-4889-4a57-a7b5-50d29fb5342e'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:25:17.258662 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-9c84d77f-4889-4a57-a7b5-50d29fb5342e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97dafd9c8bcf46e6a9d7f8e4c3291efe', 'request_id': 'req-9c84d77f-4889-4a57-a7b5-50d29fb5342e'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:25:17.265317 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-9c84d77f-4889-4a57-a7b5-50d29fb5342e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97dafd9c8bcf46e6a9d7f8e4c3291efe', 'request_id': 'req-9c84d77f-4889-4a57-a7b5-50d29fb5342e'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:25:17.279024 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-9c84d77f-4889-4a57-a7b5-50d29fb5342e admin admin] The token cache is being invalidate because project 97dafd9c8bcf46e6a9d7f8e4c3291efe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:25:17.279310 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-9c84d77f-4889-4a57-a7b5-50d29fb5342e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:25:17.279949 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-9c84d77f-4889-4a57-a7b5-50d29fb5342e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:25:17.281535 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1393/2790] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 09:25:17 2022] DELETE /identity/v3/projects/97dafd9c8bcf46e6a9d7f8e4c3291efe => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:25:17.286757 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c5ff9-0db0-48ee-aa31-08eec2182329 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:25:17.287047 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c5ff9-0db0-48ee-aa31-08eec2182329 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:25:17.287324 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c5ff9-0db0-48ee-aa31-08eec2182329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:25:17.306730 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-119c5ff9-0db0-48ee-aa31-08eec2182329 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:25:17.307947 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-119c5ff9-0db0-48ee-aa31-08eec2182329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:25:17.377902 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1398/2791] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:25:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:25:17.386090 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7f78c-c2ac-46c8-bd07-3209e0a0e2ce None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:25:17.386406 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7f78c-c2ac-46c8-bd07-3209e0a0e2ce None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:25:17.386696 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7f78c-c2ac-46c8-bd07-3209e0a0e2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:25:17.405425 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-ebd7f78c-c2ac-46c8-bd07-3209e0a0e2ce None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:25:17.406680 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-ebd7f78c-c2ac-46c8-bd07-3209e0a0e2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:25:17.415501 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1394/2792] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:25:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:25:17.419972 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119c5ff9-0db0-48ee-aa31-08eec2182329 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:25:17.430670 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119c5ff9-0db0-48ee-aa31-08eec2182329 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:25:17.435328 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305dadb0-f48b-4fa1-b71d-b2663ba841db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:25:17.435983 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305dadb0-f48b-4fa1-b71d-b2663ba841db admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:25:17.436263 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305dadb0-f48b-4fa1-b71d-b2663ba841db admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:25:17.436540 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305dadb0-f48b-4fa1-b71d-b2663ba841db admin admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:25:17.437269 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305dadb0-f48b-4fa1-b71d-b2663ba841db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:25:17.437576 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305dadb0-f48b-4fa1-b71d-b2663ba841db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:25:17.439205 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305dadb0-f48b-4fa1-b71d-b2663ba841db admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:25:17.451359 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1399/2793] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Jun 22 09:25:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:25:17.455888 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd7f78c-c2ac-46c8-bd07-3209e0a0e2ce None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:25:17.466296 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd7f78c-c2ac-46c8-bd07-3209e0a0e2ce None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:25:17.471191 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456819a3-4ce7-4bc6-b67a-28c838b502a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:25:17.471855 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456819a3-4ce7-4bc6-b67a-28c838b502a7 admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:25:17.472139 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456819a3-4ce7-4bc6-b67a-28c838b502a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:25:17.472413 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456819a3-4ce7-4bc6-b67a-28c838b502a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:25:17.473113 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456819a3-4ce7-4bc6-b67a-28c838b502a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:25:17.475124 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456819a3-4ce7-4bc6-b67a-28c838b502a7 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:25:17.502378 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1395/2794] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 09:25:17 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:25:17.506563 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305dadb0-f48b-4fa1-b71d-b2663ba841db admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:25:17.517115 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305dadb0-f48b-4fa1-b71d-b2663ba841db admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:25:17.568371 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:25:17.579223 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a3c19d-c4b7-4eb9-853b-2629c74528b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:25:17.579905 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3c19d-c4b7-4eb9-853b-2629c74528b4 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:25:17.580196 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3c19d-c4b7-4eb9-853b-2629c74528b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:25:17.580480 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3c19d-c4b7-4eb9-853b-2629c74528b4 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:25:17.581192 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a3c19d-c4b7-4eb9-853b-2629c74528b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:25:17.583184 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a3c19d-c4b7-4eb9-853b-2629c74528b4 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:25:17.605185 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1400/2795] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 09:25:17 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:25:17.609295 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456819a3-4ce7-4bc6-b67a-28c838b502a7 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:25:17.620409 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456819a3-4ce7-4bc6-b67a-28c838b502a7 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:25:17.625347 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198f412-7fd5-412d-b45a-a90b36f58568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:25:17.626032 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198f412-7fd5-412d-b45a-a90b36f58568 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:25:17.626330 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198f412-7fd5-412d-b45a-a90b36f58568 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:25:17.626629 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198f412-7fd5-412d-b45a-a90b36f58568 admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:25:17.627356 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4198f412-7fd5-412d-b45a-a90b36f58568 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:25:17.628998 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4198f412-7fd5-412d-b45a-a90b36f58568 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:25:17.635100 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:25:17.645301 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1396/2796] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 09:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:25:17.649148 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a3c19d-c4b7-4eb9-853b-2629c74528b4 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:25:17.659341 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a3c19d-c4b7-4eb9-853b-2629c74528b4 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:25:17.663987 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86b4cff-22db-4327-9459-4d0c3622a160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:25:17.664655 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b4cff-22db-4327-9459-4d0c3622a160 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:25:17.664942 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b4cff-22db-4327-9459-4d0c3622a160 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:25:17.665225 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b4cff-22db-4327-9459-4d0c3622a160 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:25:17.665961 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86b4cff-22db-4327-9459-4d0c3622a160 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:25:17.667606 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86b4cff-22db-4327-9459-4d0c3622a160 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:25:17.677942 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1401/2797] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 09:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:25:17.682791 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198f412-7fd5-412d-b45a-a90b36f58568 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:25:17.693028 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198f412-7fd5-412d-b45a-a90b36f58568 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:25:17.698339 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e881f572-ab22-4235-a8b9-1caecbac714f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:25:17.699225 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881f572-ab22-4235-a8b9-1caecbac714f admin admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:25:17.699507 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881f572-ab22-4235-a8b9-1caecbac714f admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:25:17.699785 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881f572-ab22-4235-a8b9-1caecbac714f admin admin] PATH_INFO: `/v3/projects/45a2a5a4107140a9a17ddf196a1f2b95/users/b49bd088bb264263a6735365e880611b/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:25:17.719333 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e881f572-ab22-4235-a8b9-1caecbac714f admin admin] RBAC: Authorizing `identity:create_grant(project_id=45a2a5a4107140a9a17ddf196a1f2b95, user_id=b49bd088bb264263a6735365e880611b, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:25:17.721986 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e881f572-ab22-4235-a8b9-1caecbac714f admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:25:17.744565 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1397/2798] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 09:25:17 2022] PUT /identity/v3/projects/45a2a5a4107140a9a17ddf196a1f2b95/users/b49bd088bb264263a6735365e880611b/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:25:17.750154 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ea419-f34e-4fac-8267-959520ee8397 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:25:17.750446 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ea419-f34e-4fac-8267-959520ee8397 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:25:17.750727 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ea419-f34e-4fac-8267-959520ee8397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:25:17.770395 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-680ea419-f34e-4fac-8267-959520ee8397 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:25:17.771152 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-680ea419-f34e-4fac-8267-959520ee8397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:25:17.834094 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1402/2799] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:25:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:25:17.844305 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e881f572-ab22-4235-a8b9-1caecbac714f admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:25:17.846040 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-e881f572-ab22-4235-a8b9-1caecbac714f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:25:17.907686 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e881f572-ab22-4235-a8b9-1caecbac714f admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:25:17.911500 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598bf68e-71a4-41cb-9aef-078f76c9c411 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:25:17.912149 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598bf68e-71a4-41cb-9aef-078f76c9c411 service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:25:17.912430 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598bf68e-71a4-41cb-9aef-078f76c9c411 service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:25:17.912704 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598bf68e-71a4-41cb-9aef-078f76c9c411 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:25:17.922569 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598bf68e-71a4-41cb-9aef-078f76c9c411 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:25:17.924047 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598bf68e-71a4-41cb-9aef-078f76c9c411 service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:25:17.934150 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1398/2800] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:25:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:25:22.208118 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881547c0-d25d-4186-9a3e-c578e1b5a3a7 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:25:22.208688 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881547c0-d25d-4186-9a3e-c578e1b5a3a7 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:25:22.208688 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881547c0-d25d-4186-9a3e-c578e1b5a3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:25:22.240093 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-881547c0-d25d-4186-9a3e-c578e1b5a3a7 None None] MFA Rules not processed for user `b49bd088bb264263a6735365e880611b`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:25:22.241969 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-881547c0-d25d-4186-9a3e-c578e1b5a3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:25:22.333083 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1403/2801] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:25:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:25:22.338379 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598bf68e-71a4-41cb-9aef-078f76c9c411 service neutron] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:25:22.348832 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598bf68e-71a4-41cb-9aef-078f76c9c411 service neutron] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:25:22.355564 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b4163-9eca-4803-8e2a-1d367d356578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:25:22.356250 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b4163-9eca-4803-8e2a-1d367d356578 admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:25:22.356536 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b4163-9eca-4803-8e2a-1d367d356578 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:25:22.356817 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b4163-9eca-4803-8e2a-1d367d356578 admin admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:25:22.357523 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48b4163-9eca-4803-8e2a-1d367d356578 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:25:22.359614 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48b4163-9eca-4803-8e2a-1d367d356578 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:25:22.402565 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1399/2802] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 09:25:22 2022] POST /identity/v3/projects => generated 377 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:25:22.404753 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881547c0-d25d-4186-9a3e-c578e1b5a3a7 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:25:22.416653 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881547c0-d25d-4186-9a3e-c578e1b5a3a7 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:25:22.481238 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0314383-879b-4fe7-91b5-7d315f98e128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:25:22.481927 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0314383-879b-4fe7-91b5-7d315f98e128 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:25:22.482242 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0314383-879b-4fe7-91b5-7d315f98e128 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:25:22.482525 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0314383-879b-4fe7-91b5-7d315f98e128 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:25:22.483219 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0314383-879b-4fe7-91b5-7d315f98e128 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:25:22.485267 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0314383-879b-4fe7-91b5-7d315f98e128 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:25:22.492756 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:25:22.511365 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1404/2803] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 09:25:22 2022] POST /identity/v3/users => generated 295 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:25:22.515049 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b4163-9eca-4803-8e2a-1d367d356578 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:25:22.526932 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b4163-9eca-4803-8e2a-1d367d356578 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:25:22.533001 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e190986c-7cf0-4b2a-8efd-a7af8af4f19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:25:22.534323 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190986c-7cf0-4b2a-8efd-a7af8af4f19a admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:25:22.534802 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190986c-7cf0-4b2a-8efd-a7af8af4f19a admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:25:22.535302 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190986c-7cf0-4b2a-8efd-a7af8af4f19a admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:25:22.536570 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e190986c-7cf0-4b2a-8efd-a7af8af4f19a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:25:22.541398 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e190986c-7cf0-4b2a-8efd-a7af8af4f19a admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:25:22.552728 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1400/2804] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 09:25:22 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:25:22.557755 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0314383-879b-4fe7-91b5-7d315f98e128 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:25:22.570781 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0314383-879b-4fe7-91b5-7d315f98e128 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:25:22.575400 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bde4d5-0aa2-4961-8272-d8986e57e2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:25:22.576291 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bde4d5-0aa2-4961-8272-d8986e57e2d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:25:22.576580 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bde4d5-0aa2-4961-8272-d8986e57e2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:25:22.576858 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bde4d5-0aa2-4961-8272-d8986e57e2d8 admin admin] PATH_INFO: `/v3/projects/c0a6002afad64f37b55d524e7a2c91ab/users/694c70cdbbe84ce08be58bb2474b0b18/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:25:22.595365 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bde4d5-0aa2-4961-8272-d8986e57e2d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0a6002afad64f37b55d524e7a2c91ab, user_id=694c70cdbbe84ce08be58bb2474b0b18, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:25:22.598050 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bde4d5-0aa2-4961-8272-d8986e57e2d8 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:25:22.616694 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1405/2805] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 09:25:22 2022] PUT /identity/v3/projects/c0a6002afad64f37b55d524e7a2c91ab/users/694c70cdbbe84ce08be58bb2474b0b18/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:25:22.621659 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e190986c-7cf0-4b2a-8efd-a7af8af4f19a admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:25:22.632323 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e190986c-7cf0-4b2a-8efd-a7af8af4f19a admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:25:22.689514 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee229d-fc22-413b-badf-354b9e7d92df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:25:22.690222 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee229d-fc22-413b-badf-354b9e7d92df admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:25:22.690510 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee229d-fc22-413b-badf-354b9e7d92df admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:25:22.690789 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee229d-fc22-413b-badf-354b9e7d92df admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:25:22.691522 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeee229d-fc22-413b-badf-354b9e7d92df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:25:22.693152 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeee229d-fc22-413b-badf-354b9e7d92df admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:25:22.703797 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1401/2806] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 09:25:22 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:25:22.708055 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bde4d5-0aa2-4961-8272-d8986e57e2d8 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:25:22.718669 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bde4d5-0aa2-4961-8272-d8986e57e2d8 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:25:22.724020 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beea5e1b-f5fc-4fb7-8b06-0cdc0216f84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:25:22.725458 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea5e1b-f5fc-4fb7-8b06-0cdc0216f84c admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:25:22.725910 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea5e1b-f5fc-4fb7-8b06-0cdc0216f84c admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:25:22.726383 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea5e1b-f5fc-4fb7-8b06-0cdc0216f84c admin admin] PATH_INFO: `/v3/projects/c0a6002afad64f37b55d524e7a2c91ab/users/694c70cdbbe84ce08be58bb2474b0b18/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:25:22.730215 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beea5e1b-f5fc-4fb7-8b06-0cdc0216f84c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0a6002afad64f37b55d524e7a2c91ab, user_id=694c70cdbbe84ce08be58bb2474b0b18, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:25:22.732914 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beea5e1b-f5fc-4fb7-8b06-0cdc0216f84c admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:25:22.745667 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1406/2807] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 09:25:22 2022] PUT /identity/v3/projects/c0a6002afad64f37b55d524e7a2c91ab/users/694c70cdbbe84ce08be58bb2474b0b18/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:25:27.650121 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ab6e9-b6cc-4c0e-9972-0e8cae25be16 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:25:27.650589 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ab6e9-b6cc-4c0e-9972-0e8cae25be16 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:25:27.650772 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ab6e9-b6cc-4c0e-9972-0e8cae25be16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:25:27.699384 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-540ab6e9-b6cc-4c0e-9972-0e8cae25be16 None None] MFA Rules not processed for user `694c70cdbbe84ce08be58bb2474b0b18`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:25:27.700899 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-540ab6e9-b6cc-4c0e-9972-0e8cae25be16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:25:27.741554 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:25:27.787210 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1402/2808] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:25:27 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:25:27.805106 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beea5e1b-f5fc-4fb7-8b06-0cdc0216f84c admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:25:27.807957 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-beea5e1b-f5fc-4fb7-8b06-0cdc0216f84c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:25:27.897243 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beea5e1b-f5fc-4fb7-8b06-0cdc0216f84c admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:25:27.903891 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f37180-9efa-43e9-8fb2-9f2b47606744 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f1809a35b244c1db7a185d82859369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:25:27.904554 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f37180-9efa-43e9-8fb2-9f2b47606744 service nova] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:25:27.904838 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f37180-9efa-43e9-8fb2-9f2b47606744 service nova] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:25:27.905116 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f37180-9efa-43e9-8fb2-9f2b47606744 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:25:27.968822 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f37180-9efa-43e9-8fb2-9f2b47606744 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:25:27.970481 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f37180-9efa-43e9-8fb2-9f2b47606744 service nova] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:25:27.985195 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1407/2809] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:25:27 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:25:37.783950 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=15 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:25:37.977740 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:INSERT=5,keystone:SELECT=73 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:25:48.499357 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f9436-5116-4eca-b7fe-e35b3b9cfdb1 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:25:48.499956 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f9436-5116-4eca-b7fe-e35b3b9cfdb1 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:25:48.499956 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f9436-5116-4eca-b7fe-e35b3b9cfdb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:25:48.518407 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-1b1f9436-5116-4eca-b7fe-e35b3b9cfdb1 None None] MFA Rules not processed for user `b49bd088bb264263a6735365e880611b`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:25:48.519648 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-1b1f9436-5116-4eca-b7fe-e35b3b9cfdb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:25:48.527264 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1403/2810] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:25:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:25:48.567582 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f37180-9efa-43e9-8fb2-9f2b47606744 service nova] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:25:48.569079 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-d0f37180-9efa-43e9-8fb2-9f2b47606744 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:25:48.637435 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f37180-9efa-43e9-8fb2-9f2b47606744 service nova] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:25:48.643299 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90690c-7966-45cf-b4f4-512762a68d48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:25:48.644330 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90690c-7966-45cf-b4f4-512762a68d48 service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:25:48.644829 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90690c-7966-45cf-b4f4-512762a68d48 service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:25:48.645348 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90690c-7966-45cf-b4f4-512762a68d48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:25:48.648646 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-3f90690c-7966-45cf-b4f4-512762a68d48 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:25:48.664426 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f90690c-7966-45cf-b4f4-512762a68d48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:25:48.666056 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f90690c-7966-45cf-b4f4-512762a68d48 service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:25:48.679962 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1408/2811] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:25:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:25:49.439284 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f9436-5116-4eca-b7fe-e35b3b9cfdb1 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:25:49.499597 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f9436-5116-4eca-b7fe-e35b3b9cfdb1 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:25:49.503416 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ddcf6-0347-456d-bbdb-242cb90d57cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:25:49.504075 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ddcf6-0347-456d-bbdb-242cb90d57cc service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:25:49.504359 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ddcf6-0347-456d-bbdb-242cb90d57cc service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:25:49.504620 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ddcf6-0347-456d-bbdb-242cb90d57cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:25:49.506486 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-536ddcf6-0347-456d-bbdb-242cb90d57cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:25:49.521549 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536ddcf6-0347-456d-bbdb-242cb90d57cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:25:49.523758 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536ddcf6-0347-456d-bbdb-242cb90d57cc service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:25:49.535859 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1404/2812] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:25:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:25:51.177721 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90690c-7966-45cf-b4f4-512762a68d48 service cinder] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:25:51.188256 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90690c-7966-45cf-b4f4-512762a68d48 service cinder] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:25:51.195876 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0471e-6397-4646-907f-5d49d011701d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:25:51.196544 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0471e-6397-4646-907f-5d49d011701d service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:25:51.196824 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0471e-6397-4646-907f-5d49d011701d service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:25:51.197095 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0471e-6397-4646-907f-5d49d011701d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:25:51.198962 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-e6b0471e-6397-4646-907f-5d49d011701d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:25:51.209765 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b0471e-6397-4646-907f-5d49d011701d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:25:51.211869 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b0471e-6397-4646-907f-5d49d011701d service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:25:51.221912 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1409/2813] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:25:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:25:59.530962 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=29 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:26:01.217084 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=32 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:26:05.229236 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ddcf6-0347-456d-bbdb-242cb90d57cc service neutron] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:05.238330 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ddcf6-0347-456d-bbdb-242cb90d57cc service neutron] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:05.242021 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf12cd6-7915-4746-a371-2f2b49aa72f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:05.243229 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf12cd6-7915-4746-a371-2f2b49aa72f6 service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:05.243512 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf12cd6-7915-4746-a371-2f2b49aa72f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:05.243788 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf12cd6-7915-4746-a371-2f2b49aa72f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:05.254658 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf12cd6-7915-4746-a371-2f2b49aa72f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:05.256966 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf12cd6-7915-4746-a371-2f2b49aa72f6 service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:05.267735 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1405/2814] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:26:05 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:26:15.262764 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=6 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:26:16.315473 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0471e-6397-4646-907f-5d49d011701d service neutron] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:16.325255 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0471e-6397-4646-907f-5d49d011701d service neutron] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:16.328828 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7803bcd5-3f8a-43b0-a00b-999d4cabfbf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:16.329476 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803bcd5-3f8a-43b0-a00b-999d4cabfbf2 service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:16.329761 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803bcd5-3f8a-43b0-a00b-999d4cabfbf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:16.330040 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803bcd5-3f8a-43b0-a00b-999d4cabfbf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:16.331980 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-7803bcd5-3f8a-43b0-a00b-999d4cabfbf2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:26:16.404148 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7803bcd5-3f8a-43b0-a00b-999d4cabfbf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:16.405603 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7803bcd5-3f8a-43b0-a00b-999d4cabfbf2 service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:16.415927 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1410/2815] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:26:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:26:19.664429 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf12cd6-7915-4746-a371-2f2b49aa72f6 service neutron] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:19.666062 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-3bf12cd6-7915-4746-a371-2f2b49aa72f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:26:19.721093 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7803bcd5-3f8a-43b0-a00b-999d4cabfbf2 service neutron] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:19.722655 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-7803bcd5-3f8a-43b0-a00b-999d4cabfbf2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:26:19.737438 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7803bcd5-3f8a-43b0-a00b-999d4cabfbf2 service neutron] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:19.743862 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e000347a-495f-44eb-9938-441762485285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:19.744910 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000347a-495f-44eb-9938-441762485285 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:19.745454 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000347a-495f-44eb-9938-441762485285 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:19.745731 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000347a-495f-44eb-9938-441762485285 admin admin] PATH_INFO: `/v3/users/33edf144fae24c76827b885f0ed7930b` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:19.748150 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e000347a-495f-44eb-9938-441762485285 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33edf144fae24c76827b885f0ed7930b)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:19.750990 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e000347a-495f-44eb-9938-441762485285 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:19.751345 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf12cd6-7915-4746-a371-2f2b49aa72f6 service neutron] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:19.756875 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae653867-9956-4134-afb2-082e7d7b3bc6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec2627e3cdc94ec38d7cc3b1bc670ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:19.757829 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae653867-9956-4134-afb2-082e7d7b3bc6 service placement] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:19.758138 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae653867-9956-4134-afb2-082e7d7b3bc6 service placement] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:19.758527 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae653867-9956-4134-afb2-082e7d7b3bc6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:19.760430 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-ae653867-9956-4134-afb2-082e7d7b3bc6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:26:19.774608 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae653867-9956-4134-afb2-082e7d7b3bc6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:19.776220 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae653867-9956-4134-afb2-082e7d7b3bc6 service placement] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:19.789942 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1406/2816] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:26:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:26:19.812239 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-e000347a-495f-44eb-9938-441762485285 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33edf144fae24c76827b885f0ed7930b'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:19.821279 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-e000347a-495f-44eb-9938-441762485285 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33edf144fae24c76827b885f0ed7930b'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:19.822129 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-e000347a-495f-44eb-9938-441762485285 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33edf144fae24c76827b885f0ed7930b'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:19.832616 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-e000347a-495f-44eb-9938-441762485285 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33edf144fae24c76827b885f0ed7930b'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:19.833313 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-e000347a-495f-44eb-9938-441762485285 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33edf144fae24c76827b885f0ed7930b'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:19.852295 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1411/2817] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 09:26:19 2022] DELETE /identity/v3/users/33edf144fae24c76827b885f0ed7930b => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:26:20.041872 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae653867-9956-4134-afb2-082e7d7b3bc6 service placement] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:20.052923 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae653867-9956-4134-afb2-082e7d7b3bc6 service placement] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:20.120427 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f26700-7c95-4da4-b58a-c38720abd32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:20.121308 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f26700-7c95-4da4-b58a-c38720abd32a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:20.121591 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f26700-7c95-4da4-b58a-c38720abd32a admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:20.121880 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f26700-7c95-4da4-b58a-c38720abd32a admin admin] PATH_INFO: `/v3/projects/3919985a44be447a9bfafddf0a90ccf6` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:20.123419 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f26700-7c95-4da4-b58a-c38720abd32a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3919985a44be447a9bfafddf0a90ccf6)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:20.125391 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f26700-7c95-4da4-b58a-c38720abd32a admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:20.175308 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-68f26700-7c95-4da4-b58a-c38720abd32a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3919985a44be447a9bfafddf0a90ccf6', 'request_id': 'req-68f26700-7c95-4da4-b58a-c38720abd32a'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:20.181674 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-68f26700-7c95-4da4-b58a-c38720abd32a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3919985a44be447a9bfafddf0a90ccf6', 'request_id': 'req-68f26700-7c95-4da4-b58a-c38720abd32a'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:20.191246 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-68f26700-7c95-4da4-b58a-c38720abd32a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3919985a44be447a9bfafddf0a90ccf6', 'request_id': 'req-68f26700-7c95-4da4-b58a-c38720abd32a'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:20.201753 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-68f26700-7c95-4da4-b58a-c38720abd32a admin admin] The token cache is being invalidate because project 3919985a44be447a9bfafddf0a90ccf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:26:20.202042 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-68f26700-7c95-4da4-b58a-c38720abd32a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:20.202737 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-68f26700-7c95-4da4-b58a-c38720abd32a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:20.204327 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1407/2818] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 09:26:20 2022] DELETE /identity/v3/projects/3919985a44be447a9bfafddf0a90ccf6 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:26:20.212190 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca179c65-b4b9-4122-9114-70d9f1329c35 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:20.212705 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca179c65-b4b9-4122-9114-70d9f1329c35 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:20.213187 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca179c65-b4b9-4122-9114-70d9f1329c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:20.232384 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-ca179c65-b4b9-4122-9114-70d9f1329c35 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:26:20.233603 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-ca179c65-b4b9-4122-9114-70d9f1329c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:26:20.298199 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1412/2819] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:26:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:26:20.307586 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1c99d-df5f-45f5-9920-665a6211c6f8 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:20.307879 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1c99d-df5f-45f5-9920-665a6211c6f8 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:20.308155 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1c99d-df5f-45f5-9920-665a6211c6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:20.328077 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-14e1c99d-df5f-45f5-9920-665a6211c6f8 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:26:20.329322 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-14e1c99d-df5f-45f5-9920-665a6211c6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:26:20.337607 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1408/2820] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:26:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:26:20.341778 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca179c65-b4b9-4122-9114-70d9f1329c35 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:20.352296 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca179c65-b4b9-4122-9114-70d9f1329c35 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:20.356953 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b251731-6d54-4ad4-9d88-03de79261a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:20.357616 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b251731-6d54-4ad4-9d88-03de79261a80 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:20.357908 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b251731-6d54-4ad4-9d88-03de79261a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:20.358256 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b251731-6d54-4ad4-9d88-03de79261a80 admin admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:20.358990 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b251731-6d54-4ad4-9d88-03de79261a80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:26:20.359302 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b251731-6d54-4ad4-9d88-03de79261a80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:20.360918 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b251731-6d54-4ad4-9d88-03de79261a80 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:20.362613 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:26:20.379406 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1413/2821] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Jun 22 09:26:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:26:20.380475 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e1c99d-df5f-45f5-9920-665a6211c6f8 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:20.390335 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e1c99d-df5f-45f5-9920-665a6211c6f8 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:20.395216 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84bd9f9-50d7-44c7-b42c-9870af0b23f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:20.395883 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84bd9f9-50d7-44c7-b42c-9870af0b23f9 admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:20.396167 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84bd9f9-50d7-44c7-b42c-9870af0b23f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:20.396446 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84bd9f9-50d7-44c7-b42c-9870af0b23f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:20.397159 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84bd9f9-50d7-44c7-b42c-9870af0b23f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:20.399659 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84bd9f9-50d7-44c7-b42c-9870af0b23f9 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:20.409953 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:26:20.427662 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1409/2822] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 09:26:20 2022] POST /identity/v3/projects => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:26:20.432340 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b251731-6d54-4ad4-9d88-03de79261a80 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:20.442707 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b251731-6d54-4ad4-9d88-03de79261a80 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:20.501865 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2159bb2-0350-4ffc-8a42-e6b46f3d2b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:20.502569 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2159bb2-0350-4ffc-8a42-e6b46f3d2b4c admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:20.502856 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2159bb2-0350-4ffc-8a42-e6b46f3d2b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:20.503131 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2159bb2-0350-4ffc-8a42-e6b46f3d2b4c admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:20.503839 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2159bb2-0350-4ffc-8a42-e6b46f3d2b4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:20.505766 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2159bb2-0350-4ffc-8a42-e6b46f3d2b4c admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:20.527072 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1414/2823] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 09:26:20 2022] POST /identity/v3/users => generated 284 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:26:20.531139 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84bd9f9-50d7-44c7-b42c-9870af0b23f9 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:20.542268 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84bd9f9-50d7-44c7-b42c-9870af0b23f9 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:20.546855 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b1392e-2608-409a-b55c-7ea9e93fe4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:20.547515 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1392e-2608-409a-b55c-7ea9e93fe4c0 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:20.547821 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1392e-2608-409a-b55c-7ea9e93fe4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:20.548098 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1392e-2608-409a-b55c-7ea9e93fe4c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:20.548894 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b1392e-2608-409a-b55c-7ea9e93fe4c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:20.550455 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b1392e-2608-409a-b55c-7ea9e93fe4c0 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:20.561720 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1410/2824] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 09:26:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:26:20.566040 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2159bb2-0350-4ffc-8a42-e6b46f3d2b4c admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:20.576958 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2159bb2-0350-4ffc-8a42-e6b46f3d2b4c admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:20.581641 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae233adc-b195-414b-8a13-48dad79baea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:20.582348 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae233adc-b195-414b-8a13-48dad79baea0 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:20.582633 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae233adc-b195-414b-8a13-48dad79baea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:20.582909 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae233adc-b195-414b-8a13-48dad79baea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:20.583639 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae233adc-b195-414b-8a13-48dad79baea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:20.585746 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae233adc-b195-414b-8a13-48dad79baea0 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:20.596202 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1415/2825] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 09:26:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:26:20.601426 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b1392e-2608-409a-b55c-7ea9e93fe4c0 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:20.611716 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b1392e-2608-409a-b55c-7ea9e93fe4c0 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:20.617134 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff5851-158b-4a7e-979a-ac09ba464cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:20.618012 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff5851-158b-4a7e-979a-ac09ba464cbe admin admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:20.618320 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff5851-158b-4a7e-979a-ac09ba464cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:20.618593 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff5851-158b-4a7e-979a-ac09ba464cbe admin admin] PATH_INFO: `/v3/projects/79020036e67b42e8b302b9d196a763d3/users/e6b24140afb743988d1d8c2d9a9dcc64/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:20.634630 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ff5851-158b-4a7e-979a-ac09ba464cbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=79020036e67b42e8b302b9d196a763d3, user_id=e6b24140afb743988d1d8c2d9a9dcc64, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:20.637256 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ff5851-158b-4a7e-979a-ac09ba464cbe admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:20.650842 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1411/2826] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 09:26:20 2022] PUT /identity/v3/projects/79020036e67b42e8b302b9d196a763d3/users/e6b24140afb743988d1d8c2d9a9dcc64/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:26:20.662032 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c056f-353b-4f93-86ed-8b5b08718c99 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:20.662585 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c056f-353b-4f93-86ed-8b5b08718c99 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:20.663083 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c056f-353b-4f93-86ed-8b5b08718c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:20.693468 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-640c056f-353b-4f93-86ed-8b5b08718c99 None None] MFA Rules not processed for user `e6b24140afb743988d1d8c2d9a9dcc64`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:26:20.695519 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-640c056f-353b-4f93-86ed-8b5b08718c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:26:20.767163 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1416/2827] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:26:20 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:26:20.778305 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff5851-158b-4a7e-979a-ac09ba464cbe admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:20.782163 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-50ff5851-158b-4a7e-979a-ac09ba464cbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:26:20.866706 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff5851-158b-4a7e-979a-ac09ba464cbe admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:20.872448 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db27dafd-0337-48a5-a00e-af6e37fe1696 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f1809a35b244c1db7a185d82859369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:20.873103 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db27dafd-0337-48a5-a00e-af6e37fe1696 service nova] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:20.873392 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db27dafd-0337-48a5-a00e-af6e37fe1696 service nova] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:20.873666 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db27dafd-0337-48a5-a00e-af6e37fe1696 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:20.882644 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db27dafd-0337-48a5-a00e-af6e37fe1696 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:20.884227 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db27dafd-0337-48a5-a00e-af6e37fe1696 service nova] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:20.893657 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1412/2828] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:26:20 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:26:23.592345 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640c056f-353b-4f93-86ed-8b5b08718c99 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:23.655325 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640c056f-353b-4f93-86ed-8b5b08718c99 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:23.660012 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de619d4-2501-4025-8bde-a4641ad4e439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:23.660923 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de619d4-2501-4025-8bde-a4641ad4e439 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:23.661157 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de619d4-2501-4025-8bde-a4641ad4e439 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:23.661427 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de619d4-2501-4025-8bde-a4641ad4e439 admin admin] PATH_INFO: `/v3/users/e6b24140afb743988d1d8c2d9a9dcc64` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:23.662691 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de619d4-2501-4025-8bde-a4641ad4e439 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6b24140afb743988d1d8c2d9a9dcc64)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:23.665253 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de619d4-2501-4025-8bde-a4641ad4e439 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:23.667893 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:26:23.713800 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-8de619d4-2501-4025-8bde-a4641ad4e439 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6b24140afb743988d1d8c2d9a9dcc64'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:23.720911 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-8de619d4-2501-4025-8bde-a4641ad4e439 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6b24140afb743988d1d8c2d9a9dcc64'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:23.721621 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-8de619d4-2501-4025-8bde-a4641ad4e439 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6b24140afb743988d1d8c2d9a9dcc64'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:23.729686 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-8de619d4-2501-4025-8bde-a4641ad4e439 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6b24140afb743988d1d8c2d9a9dcc64'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:23.730400 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-8de619d4-2501-4025-8bde-a4641ad4e439 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6b24140afb743988d1d8c2d9a9dcc64'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:23.748229 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1417/2829] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 09:26:23 2022] DELETE /identity/v3/users/e6b24140afb743988d1d8c2d9a9dcc64 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:26:23.752845 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9909541-64c8-41db-b04c-99e97fa18fd2 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:23.753349 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9909541-64c8-41db-b04c-99e97fa18fd2 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:23.753444 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9909541-64c8-41db-b04c-99e97fa18fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:23.771011 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-e9909541-64c8-41db-b04c-99e97fa18fd2 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:26:23.772238 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-e9909541-64c8-41db-b04c-99e97fa18fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:26:23.838706 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1413/2830] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:26:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:26:23.848399 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de619d4-2501-4025-8bde-a4641ad4e439 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:23.849801 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-8de619d4-2501-4025-8bde-a4641ad4e439 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:26:23.911931 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de619d4-2501-4025-8bde-a4641ad4e439 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:23.916229 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586fab72-af6d-454c-8aff-e919e7a8141f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:23.916878 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586fab72-af6d-454c-8aff-e919e7a8141f service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:23.917160 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586fab72-af6d-454c-8aff-e919e7a8141f service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:23.917434 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586fab72-af6d-454c-8aff-e919e7a8141f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:23.930396 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586fab72-af6d-454c-8aff-e919e7a8141f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:23.932160 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586fab72-af6d-454c-8aff-e919e7a8141f service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:23.942679 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1418/2831] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:26:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:26:24.235121 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9909541-64c8-41db-b04c-99e97fa18fd2 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:24.236646 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-e9909541-64c8-41db-b04c-99e97fa18fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:26:24.250328 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9909541-64c8-41db-b04c-99e97fa18fd2 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:24.256828 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1605a6f7-ec62-4c45-8e6a-1e086da05dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:24.257863 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605a6f7-ec62-4c45-8e6a-1e086da05dc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:24.258283 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605a6f7-ec62-4c45-8e6a-1e086da05dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:24.258515 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605a6f7-ec62-4c45-8e6a-1e086da05dc9 admin admin] PATH_INFO: `/v3/projects/79020036e67b42e8b302b9d196a763d3` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:24.260233 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1605a6f7-ec62-4c45-8e6a-1e086da05dc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79020036e67b42e8b302b9d196a763d3)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:24.262184 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1605a6f7-ec62-4c45-8e6a-1e086da05dc9 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:24.306817 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:26:24.316752 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-1605a6f7-ec62-4c45-8e6a-1e086da05dc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79020036e67b42e8b302b9d196a763d3', 'request_id': 'req-1605a6f7-ec62-4c45-8e6a-1e086da05dc9'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:24.323507 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-1605a6f7-ec62-4c45-8e6a-1e086da05dc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79020036e67b42e8b302b9d196a763d3', 'request_id': 'req-1605a6f7-ec62-4c45-8e6a-1e086da05dc9'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:24.330377 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-1605a6f7-ec62-4c45-8e6a-1e086da05dc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79020036e67b42e8b302b9d196a763d3', 'request_id': 'req-1605a6f7-ec62-4c45-8e6a-1e086da05dc9'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:24.343937 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-1605a6f7-ec62-4c45-8e6a-1e086da05dc9 admin admin] The token cache is being invalidate because project 79020036e67b42e8b302b9d196a763d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:26:24.344140 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-1605a6f7-ec62-4c45-8e6a-1e086da05dc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:24.344766 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-1605a6f7-ec62-4c45-8e6a-1e086da05dc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:24.346362 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1414/2832] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 09:26:24 2022] DELETE /identity/v3/projects/79020036e67b42e8b302b9d196a763d3 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:26:24.352257 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8a4ce-5b70-469d-bf9c-83a6ede037f8 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:24.352549 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8a4ce-5b70-469d-bf9c-83a6ede037f8 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:24.352834 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8a4ce-5b70-469d-bf9c-83a6ede037f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:24.373077 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-06a8a4ce-5b70-469d-bf9c-83a6ede037f8 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:26:24.374371 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-06a8a4ce-5b70-469d-bf9c-83a6ede037f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:26:24.437321 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1419/2833] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:26:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:26:24.446003 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7d14e-47dd-43b2-bef3-2e832ea82c84 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:24.446324 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7d14e-47dd-43b2-bef3-2e832ea82c84 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:24.446604 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7d14e-47dd-43b2-bef3-2e832ea82c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:24.465175 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-0fd7d14e-47dd-43b2-bef3-2e832ea82c84 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:26:24.466494 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-0fd7d14e-47dd-43b2-bef3-2e832ea82c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:26:24.474656 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1415/2834] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:26:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:26:24.479015 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a8a4ce-5b70-469d-bf9c-83a6ede037f8 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:24.488974 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a8a4ce-5b70-469d-bf9c-83a6ede037f8 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:24.494393 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9de35b-6834-45ba-bbbe-6c2df08989cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:24.495061 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9de35b-6834-45ba-bbbe-6c2df08989cb admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:24.495349 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9de35b-6834-45ba-bbbe-6c2df08989cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:24.495632 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9de35b-6834-45ba-bbbe-6c2df08989cb admin admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:24.496379 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9de35b-6834-45ba-bbbe-6c2df08989cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:26:24.496691 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9de35b-6834-45ba-bbbe-6c2df08989cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:24.498603 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9de35b-6834-45ba-bbbe-6c2df08989cb admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:24.515123 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1420/2835] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Jun 22 09:26:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:26:24.519581 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd7d14e-47dd-43b2-bef3-2e832ea82c84 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:24.529737 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd7d14e-47dd-43b2-bef3-2e832ea82c84 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:24.534514 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed01d43-9eb0-4094-9a6b-0acbfd451365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:24.535177 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed01d43-9eb0-4094-9a6b-0acbfd451365 admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:24.535462 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed01d43-9eb0-4094-9a6b-0acbfd451365 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:24.535741 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed01d43-9eb0-4094-9a6b-0acbfd451365 admin admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:24.536449 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed01d43-9eb0-4094-9a6b-0acbfd451365 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:24.538981 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed01d43-9eb0-4094-9a6b-0acbfd451365 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:24.565657 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1416/2836] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 09:26:24 2022] POST /identity/v3/projects => generated 367 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:26:24.570321 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9de35b-6834-45ba-bbbe-6c2df08989cb admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:24.580600 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9de35b-6834-45ba-bbbe-6c2df08989cb admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:24.589231 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:26:24.644735 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaa9fe2-4cc3-4702-be7a-77c939486c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:24.645427 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaa9fe2-4cc3-4702-be7a-77c939486c3f admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:24.645679 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaa9fe2-4cc3-4702-be7a-77c939486c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:24.645956 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaa9fe2-4cc3-4702-be7a-77c939486c3f admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:24.646694 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaa9fe2-4cc3-4702-be7a-77c939486c3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:24.649233 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaa9fe2-4cc3-4702-be7a-77c939486c3f admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:24.668785 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1421/2837] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 09:26:24 2022] POST /identity/v3/users => generated 284 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:26:24.673047 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed01d43-9eb0-4094-9a6b-0acbfd451365 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:24.683556 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed01d43-9eb0-4094-9a6b-0acbfd451365 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:24.693350 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1575987e-f08e-46d2-aefb-f910e22551bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:24.693350 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575987e-f08e-46d2-aefb-f910e22551bc admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:24.693350 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575987e-f08e-46d2-aefb-f910e22551bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:24.693350 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575987e-f08e-46d2-aefb-f910e22551bc admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:24.693951 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1575987e-f08e-46d2-aefb-f910e22551bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:24.693951 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1575987e-f08e-46d2-aefb-f910e22551bc admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:24.703117 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1417/2838] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 09:26:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:26:24.707354 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaa9fe2-4cc3-4702-be7a-77c939486c3f admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:24.718046 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaa9fe2-4cc3-4702-be7a-77c939486c3f admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:24.722858 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a1444-2e66-48fa-99ee-5d5635a8da5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:24.723477 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a1444-2e66-48fa-99ee-5d5635a8da5d admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:24.723763 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a1444-2e66-48fa-99ee-5d5635a8da5d admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:24.724041 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a1444-2e66-48fa-99ee-5d5635a8da5d admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:24.724784 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6a1444-2e66-48fa-99ee-5d5635a8da5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:24.726430 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6a1444-2e66-48fa-99ee-5d5635a8da5d admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:24.736805 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1422/2839] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 09:26:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:26:24.741101 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1575987e-f08e-46d2-aefb-f910e22551bc admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:24.751514 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1575987e-f08e-46d2-aefb-f910e22551bc admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:24.756431 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd461e45-30a6-4122-ae0d-d58d6b8183b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:24.757879 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd461e45-30a6-4122-ae0d-d58d6b8183b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:24.758194 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd461e45-30a6-4122-ae0d-d58d6b8183b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:24.758473 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd461e45-30a6-4122-ae0d-d58d6b8183b7 admin admin] PATH_INFO: `/v3/projects/fb2dcd4e0f064145b31499a84b9fbe22/users/1f4a75af95d445509ce7e741bb568ce1/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:24.777547 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd461e45-30a6-4122-ae0d-d58d6b8183b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb2dcd4e0f064145b31499a84b9fbe22, user_id=1f4a75af95d445509ce7e741bb568ce1, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:24.780281 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd461e45-30a6-4122-ae0d-d58d6b8183b7 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:24.793536 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1418/2840] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 09:26:24 2022] PUT /identity/v3/projects/fb2dcd4e0f064145b31499a84b9fbe22/users/1f4a75af95d445509ce7e741bb568ce1/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:26:24.805025 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422b944a-9b38-4dcc-963a-9de0f1660ac5 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:24.805322 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422b944a-9b38-4dcc-963a-9de0f1660ac5 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:24.805629 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422b944a-9b38-4dcc-963a-9de0f1660ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:24.839363 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-422b944a-9b38-4dcc-963a-9de0f1660ac5 None None] MFA Rules not processed for user `1f4a75af95d445509ce7e741bb568ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:26:24.839836 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-422b944a-9b38-4dcc-963a-9de0f1660ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:26:24.910204 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1423/2841] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:26:24 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:26:24.915065 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd461e45-30a6-4122-ae0d-d58d6b8183b7 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:24.978293 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd461e45-30a6-4122-ae0d-d58d6b8183b7 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:24.983082 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697afb0e-b449-4f33-91f4-1a677f547629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:24.983746 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697afb0e-b449-4f33-91f4-1a677f547629 admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:24.984038 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697afb0e-b449-4f33-91f4-1a677f547629 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:24.984314 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697afb0e-b449-4f33-91f4-1a677f547629 admin admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:24.985008 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697afb0e-b449-4f33-91f4-1a677f547629 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:24.986931 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697afb0e-b449-4f33-91f4-1a677f547629 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:25.013699 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1419/2842] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 09:26:24 2022] POST /identity/v3/projects => generated 369 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:26:25.018220 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422b944a-9b38-4dcc-963a-9de0f1660ac5 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:25.029765 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422b944a-9b38-4dcc-963a-9de0f1660ac5 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:25.088381 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e4b71-fdb7-4fe7-9a44-e05186a6c5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:25.089030 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e4b71-fdb7-4fe7-9a44-e05186a6c5db admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:25.089312 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e4b71-fdb7-4fe7-9a44-e05186a6c5db admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:25.089586 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e4b71-fdb7-4fe7-9a44-e05186a6c5db admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:25.090352 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e4b71-fdb7-4fe7-9a44-e05186a6c5db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:25.092304 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e4b71-fdb7-4fe7-9a44-e05186a6c5db admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:25.114157 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1424/2843] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 09:26:25 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:26:25.118116 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697afb0e-b449-4f33-91f4-1a677f547629 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:25.129461 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697afb0e-b449-4f33-91f4-1a677f547629 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:25.134436 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90e751c-873f-4610-a486-37af9a0a032d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:25.135164 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e751c-873f-4610-a486-37af9a0a032d admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:25.135452 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e751c-873f-4610-a486-37af9a0a032d admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:25.135732 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e751c-873f-4610-a486-37af9a0a032d admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:25.136489 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90e751c-873f-4610-a486-37af9a0a032d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:25.138097 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90e751c-873f-4610-a486-37af9a0a032d admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:25.149961 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1420/2844] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 09:26:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:26:25.154292 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e4b71-fdb7-4fe7-9a44-e05186a6c5db admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:25.166369 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e4b71-fdb7-4fe7-9a44-e05186a6c5db admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:25.171004 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d82faae-bbb0-418a-b78e-ab6fce8abd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:25.171899 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82faae-bbb0-418a-b78e-ab6fce8abd91 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:25.172183 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82faae-bbb0-418a-b78e-ab6fce8abd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:25.172461 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82faae-bbb0-418a-b78e-ab6fce8abd91 admin admin] PATH_INFO: `/v3/projects/ed3ace3494194d57b5346186ee98c9ac/users/33320a8996644645a5a5bcdca619b3a2/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:25.175800 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:26:25.195903 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d82faae-bbb0-418a-b78e-ab6fce8abd91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed3ace3494194d57b5346186ee98c9ac, user_id=33320a8996644645a5a5bcdca619b3a2, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:25.198634 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d82faae-bbb0-418a-b78e-ab6fce8abd91 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:25.213968 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1425/2845] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 09:26:25 2022] PUT /identity/v3/projects/ed3ace3494194d57b5346186ee98c9ac/users/33320a8996644645a5a5bcdca619b3a2/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:26:25.217859 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90e751c-873f-4610-a486-37af9a0a032d admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:25.227919 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90e751c-873f-4610-a486-37af9a0a032d admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:25.265015 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:26:25.292558 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d737e77-690c-48b6-8685-9e0bd94c90da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:25.293236 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d737e77-690c-48b6-8685-9e0bd94c90da admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:25.293522 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d737e77-690c-48b6-8685-9e0bd94c90da admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:25.293803 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d737e77-690c-48b6-8685-9e0bd94c90da admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:25.294575 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d737e77-690c-48b6-8685-9e0bd94c90da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:25.296212 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d737e77-690c-48b6-8685-9e0bd94c90da admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:25.307296 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1421/2846] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 09:26:25 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:26:25.311659 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d82faae-bbb0-418a-b78e-ab6fce8abd91 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:25.324577 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d82faae-bbb0-418a-b78e-ab6fce8abd91 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:25.329384 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8badd2cb-0369-4a19-ae87-9e497adbf4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:25.330303 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8badd2cb-0369-4a19-ae87-9e497adbf4ca admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:25.330588 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8badd2cb-0369-4a19-ae87-9e497adbf4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:25.330869 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8badd2cb-0369-4a19-ae87-9e497adbf4ca admin admin] PATH_INFO: `/v3/projects/ed3ace3494194d57b5346186ee98c9ac/users/33320a8996644645a5a5bcdca619b3a2/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:25.332846 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8badd2cb-0369-4a19-ae87-9e497adbf4ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed3ace3494194d57b5346186ee98c9ac, user_id=33320a8996644645a5a5bcdca619b3a2, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:25.335548 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8badd2cb-0369-4a19-ae87-9e497adbf4ca admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:25.346425 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1426/2847] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 09:26:25 2022] PUT /identity/v3/projects/ed3ace3494194d57b5346186ee98c9ac/users/33320a8996644645a5a5bcdca619b3a2/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:26:25.357196 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93343802-8b9e-46ea-b11d-2acc222cf1ce None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:25.357490 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93343802-8b9e-46ea-b11d-2acc222cf1ce None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:25.357785 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93343802-8b9e-46ea-b11d-2acc222cf1ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:25.386204 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-93343802-8b9e-46ea-b11d-2acc222cf1ce None None] MFA Rules not processed for user `33320a8996644645a5a5bcdca619b3a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:26:25.387429 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-93343802-8b9e-46ea-b11d-2acc222cf1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:26:25.459395 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1422/2848] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:26:25 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:26:25.470754 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8badd2cb-0369-4a19-ae87-9e497adbf4ca admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:25.472514 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-8badd2cb-0369-4a19-ae87-9e497adbf4ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:26:25.555699 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8badd2cb-0369-4a19-ae87-9e497adbf4ca admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:25.559377 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7117d03d-26e2-4dcd-99b1-2b7aad0f7627 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:25.560021 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117d03d-26e2-4dcd-99b1-2b7aad0f7627 service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:25.560306 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117d03d-26e2-4dcd-99b1-2b7aad0f7627 service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:25.560577 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117d03d-26e2-4dcd-99b1-2b7aad0f7627 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:25.570572 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7117d03d-26e2-4dcd-99b1-2b7aad0f7627 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:25.572014 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7117d03d-26e2-4dcd-99b1-2b7aad0f7627 service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:25.581685 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1427/2849] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:26:25 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:26:25.625525 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93343802-8b9e-46ea-b11d-2acc222cf1ce None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:25.626969 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-93343802-8b9e-46ea-b11d-2acc222cf1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:26:25.642174 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93343802-8b9e-46ea-b11d-2acc222cf1ce None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:25.645978 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e33a1-f41b-4d1f-8624-0e6d83cc1670 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:25.646665 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e33a1-f41b-4d1f-8624-0e6d83cc1670 service cinder] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:25.646946 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e33a1-f41b-4d1f-8624-0e6d83cc1670 service cinder] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:25.649787 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e33a1-f41b-4d1f-8624-0e6d83cc1670 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:25.707308 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0e33a1-f41b-4d1f-8624-0e6d83cc1670 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:25.708749 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0e33a1-f41b-4d1f-8624-0e6d83cc1670 service cinder] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:25.718161 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1423/2850] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:26:25 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:26:29.058472 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7117d03d-26e2-4dcd-99b1-2b7aad0f7627 service cinder] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:29.125518 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7117d03d-26e2-4dcd-99b1-2b7aad0f7627 service cinder] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:29.130129 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f95d47d-c835-4475-a00e-886128d7860a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:29.130992 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95d47d-c835-4475-a00e-886128d7860a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:29.131272 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95d47d-c835-4475-a00e-886128d7860a admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:29.132119 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95d47d-c835-4475-a00e-886128d7860a admin admin] PATH_INFO: `/v3/users/1f4a75af95d445509ce7e741bb568ce1` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:29.133306 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f95d47d-c835-4475-a00e-886128d7860a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f4a75af95d445509ce7e741bb568ce1)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:29.135307 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f95d47d-c835-4475-a00e-886128d7860a admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:29.183749 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-8f95d47d-c835-4475-a00e-886128d7860a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f4a75af95d445509ce7e741bb568ce1'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:29.191085 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-8f95d47d-c835-4475-a00e-886128d7860a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f4a75af95d445509ce7e741bb568ce1'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:29.191822 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-8f95d47d-c835-4475-a00e-886128d7860a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f4a75af95d445509ce7e741bb568ce1'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:29.193713 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:26:29.206342 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-8f95d47d-c835-4475-a00e-886128d7860a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f4a75af95d445509ce7e741bb568ce1'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:29.206959 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-8f95d47d-c835-4475-a00e-886128d7860a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f4a75af95d445509ce7e741bb568ce1'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:29.226700 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1428/2851] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 09:26:29 2022] DELETE /identity/v3/users/1f4a75af95d445509ce7e741bb568ce1 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:26:29.231283 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2872560-9723-419d-a3d6-4d3e75872c7f None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:29.231791 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2872560-9723-419d-a3d6-4d3e75872c7f None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:29.231924 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2872560-9723-419d-a3d6-4d3e75872c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:29.251255 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-f2872560-9723-419d-a3d6-4d3e75872c7f None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:26:29.252488 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-f2872560-9723-419d-a3d6-4d3e75872c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:26:29.305968 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:26:29.317710 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1424/2852] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:26:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:26:29.327971 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f95d47d-c835-4475-a00e-886128d7860a admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:29.329437 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-8f95d47d-c835-4475-a00e-886128d7860a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:26:29.389241 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f95d47d-c835-4475-a00e-886128d7860a admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:29.393094 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cbeaa3-73e1-412e-83de-56bc5efa256c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:29.393747 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cbeaa3-73e1-412e-83de-56bc5efa256c service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:29.394033 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cbeaa3-73e1-412e-83de-56bc5efa256c service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:29.394366 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cbeaa3-73e1-412e-83de-56bc5efa256c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:29.404577 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cbeaa3-73e1-412e-83de-56bc5efa256c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:29.406190 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cbeaa3-73e1-412e-83de-56bc5efa256c service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:29.416114 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1429/2853] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:26:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:26:29.688418 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2872560-9723-419d-a3d6-4d3e75872c7f None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:29.690540 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-f2872560-9723-419d-a3d6-4d3e75872c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:26:29.704254 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2872560-9723-419d-a3d6-4d3e75872c7f None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:29.708922 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786399ea-6d21-453a-b521-ca3bf1fca1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:29.710393 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786399ea-6d21-453a-b521-ca3bf1fca1ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:29.710674 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786399ea-6d21-453a-b521-ca3bf1fca1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:29.710947 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786399ea-6d21-453a-b521-ca3bf1fca1ad admin admin] PATH_INFO: `/v3/projects/fb2dcd4e0f064145b31499a84b9fbe22` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:29.712183 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786399ea-6d21-453a-b521-ca3bf1fca1ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb2dcd4e0f064145b31499a84b9fbe22)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:29.714209 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786399ea-6d21-453a-b521-ca3bf1fca1ad admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:29.764664 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-786399ea-6d21-453a-b521-ca3bf1fca1ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb2dcd4e0f064145b31499a84b9fbe22', 'request_id': 'req-786399ea-6d21-453a-b521-ca3bf1fca1ad'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:29.770925 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-786399ea-6d21-453a-b521-ca3bf1fca1ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb2dcd4e0f064145b31499a84b9fbe22', 'request_id': 'req-786399ea-6d21-453a-b521-ca3bf1fca1ad'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:29.777738 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-786399ea-6d21-453a-b521-ca3bf1fca1ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb2dcd4e0f064145b31499a84b9fbe22', 'request_id': 'req-786399ea-6d21-453a-b521-ca3bf1fca1ad'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:29.791947 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-786399ea-6d21-453a-b521-ca3bf1fca1ad admin admin] The token cache is being invalidate because project fb2dcd4e0f064145b31499a84b9fbe22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:26:29.792235 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-786399ea-6d21-453a-b521-ca3bf1fca1ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:29.792873 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-786399ea-6d21-453a-b521-ca3bf1fca1ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:29.794480 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1425/2854] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 09:26:29 2022] DELETE /identity/v3/projects/fb2dcd4e0f064145b31499a84b9fbe22 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:26:29.798457 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cbeaa3-73e1-412e-83de-56bc5efa256c service neutron] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:29.809192 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cbeaa3-73e1-412e-83de-56bc5efa256c service neutron] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:29.872565 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0152142-5ac1-42a6-8bc1-3da3a897b87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:29.873438 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0152142-5ac1-42a6-8bc1-3da3a897b87a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:29.873721 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0152142-5ac1-42a6-8bc1-3da3a897b87a admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:29.873994 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0152142-5ac1-42a6-8bc1-3da3a897b87a admin admin] PATH_INFO: `/v3/users/33320a8996644645a5a5bcdca619b3a2` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:29.875235 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0152142-5ac1-42a6-8bc1-3da3a897b87a admin admin] RBAC: Authorizing `identity:delete_user(user_id=33320a8996644645a5a5bcdca619b3a2)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:29.877174 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0152142-5ac1-42a6-8bc1-3da3a897b87a admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:29.927356 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-e0152142-5ac1-42a6-8bc1-3da3a897b87a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33320a8996644645a5a5bcdca619b3a2'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:29.934917 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-e0152142-5ac1-42a6-8bc1-3da3a897b87a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33320a8996644645a5a5bcdca619b3a2'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:29.935603 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-e0152142-5ac1-42a6-8bc1-3da3a897b87a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33320a8996644645a5a5bcdca619b3a2'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:29.946309 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-e0152142-5ac1-42a6-8bc1-3da3a897b87a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33320a8996644645a5a5bcdca619b3a2'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:29.946976 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-e0152142-5ac1-42a6-8bc1-3da3a897b87a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33320a8996644645a5a5bcdca619b3a2'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:29.958388 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:26:29.966572 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1430/2855] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 09:26:29 2022] DELETE /identity/v3/users/33320a8996644645a5a5bcdca619b3a2 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:26:30.481891 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786399ea-6d21-453a-b521-ca3bf1fca1ad admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:30.483891 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-786399ea-6d21-453a-b521-ca3bf1fca1ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:26:30.499258 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786399ea-6d21-453a-b521-ca3bf1fca1ad admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:30.563866 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb779a-bfee-4d54-b342-b82258541063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:30.564736 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb779a-bfee-4d54-b342-b82258541063 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:30.565018 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb779a-bfee-4d54-b342-b82258541063 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:30.565293 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb779a-bfee-4d54-b342-b82258541063 admin admin] PATH_INFO: `/v3/projects/ed3ace3494194d57b5346186ee98c9ac` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:30.566507 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fb779a-bfee-4d54-b342-b82258541063 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed3ace3494194d57b5346186ee98c9ac)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:30.568410 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fb779a-bfee-4d54-b342-b82258541063 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:30.617278 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-54fb779a-bfee-4d54-b342-b82258541063 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed3ace3494194d57b5346186ee98c9ac', 'request_id': 'req-54fb779a-bfee-4d54-b342-b82258541063'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:30.622973 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-54fb779a-bfee-4d54-b342-b82258541063 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed3ace3494194d57b5346186ee98c9ac', 'request_id': 'req-54fb779a-bfee-4d54-b342-b82258541063'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:30.629343 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-54fb779a-bfee-4d54-b342-b82258541063 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed3ace3494194d57b5346186ee98c9ac', 'request_id': 'req-54fb779a-bfee-4d54-b342-b82258541063'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:30.643419 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-54fb779a-bfee-4d54-b342-b82258541063 admin admin] The token cache is being invalidate because project ed3ace3494194d57b5346186ee98c9ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:26:30.643694 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-54fb779a-bfee-4d54-b342-b82258541063 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:30.644334 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-54fb779a-bfee-4d54-b342-b82258541063 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:30.645982 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1426/2856] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 09:26:30 2022] DELETE /identity/v3/projects/ed3ace3494194d57b5346186ee98c9ac => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:26:30.651724 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa5caf-d991-406b-bdc2-1a9050ea077d None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:30.652215 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa5caf-d991-406b-bdc2-1a9050ea077d None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:30.652330 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa5caf-d991-406b-bdc2-1a9050ea077d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:30.671365 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-57fa5caf-d991-406b-bdc2-1a9050ea077d None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:26:30.672685 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-57fa5caf-d991-406b-bdc2-1a9050ea077d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:26:30.735062 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1431/2857] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:26:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:26:30.744967 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d529c4a1-8d52-4a98-a4dd-4ee6f1ce4a11 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:30.745254 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d529c4a1-8d52-4a98-a4dd-4ee6f1ce4a11 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:30.745532 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d529c4a1-8d52-4a98-a4dd-4ee6f1ce4a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:30.764789 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-d529c4a1-8d52-4a98-a4dd-4ee6f1ce4a11 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:26:30.766013 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-d529c4a1-8d52-4a98-a4dd-4ee6f1ce4a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:26:30.773980 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1427/2858] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:26:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:26:30.778347 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fa5caf-d991-406b-bdc2-1a9050ea077d None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:30.789399 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fa5caf-d991-406b-bdc2-1a9050ea077d None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:30.793965 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b0491-b1c7-42c7-a4a2-97cd237509b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:30.794650 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b0491-b1c7-42c7-a4a2-97cd237509b9 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:30.794932 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b0491-b1c7-42c7-a4a2-97cd237509b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:30.795210 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b0491-b1c7-42c7-a4a2-97cd237509b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:30.795965 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b0491-b1c7-42c7-a4a2-97cd237509b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:26:30.796272 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b0491-b1c7-42c7-a4a2-97cd237509b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:30.797872 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b0491-b1c7-42c7-a4a2-97cd237509b9 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:30.810854 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1432/2859] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Jun 22 09:26:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:26:30.815499 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d529c4a1-8d52-4a98-a4dd-4ee6f1ce4a11 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:30.820029 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:26:30.825996 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d529c4a1-8d52-4a98-a4dd-4ee6f1ce4a11 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:30.832150 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff06fa2-6426-41b2-b631-16799d609978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:30.832891 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff06fa2-6426-41b2-b631-16799d609978 admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:30.833183 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff06fa2-6426-41b2-b631-16799d609978 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:30.833667 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff06fa2-6426-41b2-b631-16799d609978 admin admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:30.834775 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff06fa2-6426-41b2-b631-16799d609978 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:30.836672 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff06fa2-6426-41b2-b631-16799d609978 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:30.863411 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1428/2860] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 09:26:30 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:26:30.868320 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b0491-b1c7-42c7-a4a2-97cd237509b9 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:30.879118 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b0491-b1c7-42c7-a4a2-97cd237509b9 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:30.939939 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633528a6-2f88-4f3b-b1bd-43aad9c8cc19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:30.940615 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633528a6-2f88-4f3b-b1bd-43aad9c8cc19 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:30.940898 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633528a6-2f88-4f3b-b1bd-43aad9c8cc19 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:30.941173 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633528a6-2f88-4f3b-b1bd-43aad9c8cc19 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:30.941865 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633528a6-2f88-4f3b-b1bd-43aad9c8cc19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:30.943837 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633528a6-2f88-4f3b-b1bd-43aad9c8cc19 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:30.965540 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1433/2861] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 09:26:30 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:26:31.018852 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff06fa2-6426-41b2-b631-16799d609978 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:31.029379 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff06fa2-6426-41b2-b631-16799d609978 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:31.034252 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f87488c-c2df-4648-89f4-3a778b3cc2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:31.035291 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87488c-c2df-4648-89f4-3a778b3cc2df admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:31.035291 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87488c-c2df-4648-89f4-3a778b3cc2df admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:31.035514 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87488c-c2df-4648-89f4-3a778b3cc2df admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:31.036203 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f87488c-c2df-4648-89f4-3a778b3cc2df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:31.037819 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f87488c-c2df-4648-89f4-3a778b3cc2df admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:31.049054 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1429/2862] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 09:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:26:31.053161 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633528a6-2f88-4f3b-b1bd-43aad9c8cc19 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:31.063916 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633528a6-2f88-4f3b-b1bd-43aad9c8cc19 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:31.068612 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a3059-ecd3-4558-8dab-01fa1ab64d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:31.069839 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a3059-ecd3-4558-8dab-01fa1ab64d3b admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:31.070149 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a3059-ecd3-4558-8dab-01fa1ab64d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:31.070434 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a3059-ecd3-4558-8dab-01fa1ab64d3b admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:31.071176 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76a3059-ecd3-4558-8dab-01fa1ab64d3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:31.072789 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76a3059-ecd3-4558-8dab-01fa1ab64d3b admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:31.088363 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1434/2863] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 09:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:26:31.093507 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f87488c-c2df-4648-89f4-3a778b3cc2df admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:31.107785 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f87488c-c2df-4648-89f4-3a778b3cc2df admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:31.112761 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecba584-ffc0-4f74-afd6-3fe236b34ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:31.113650 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecba584-ffc0-4f74-afd6-3fe236b34ba9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:31.113931 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecba584-ffc0-4f74-afd6-3fe236b34ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:31.114242 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecba584-ffc0-4f74-afd6-3fe236b34ba9 admin admin] PATH_INFO: `/v3/projects/934e81749b054739b291e18ee976ba7f/users/61b0408f954e4704b7e5159276351584/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:31.130951 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecba584-ffc0-4f74-afd6-3fe236b34ba9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=934e81749b054739b291e18ee976ba7f, user_id=61b0408f954e4704b7e5159276351584, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:31.134529 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecba584-ffc0-4f74-afd6-3fe236b34ba9 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:31.151237 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1430/2864] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 09:26:31 2022] PUT /identity/v3/projects/934e81749b054739b291e18ee976ba7f/users/61b0408f954e4704b7e5159276351584/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:26:31.161897 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadcfe83-f852-4b6c-a507-21a162c6f080 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:31.162262 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadcfe83-f852-4b6c-a507-21a162c6f080 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:31.162633 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadcfe83-f852-4b6c-a507-21a162c6f080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:31.190345 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-fadcfe83-f852-4b6c-a507-21a162c6f080 None None] MFA Rules not processed for user `61b0408f954e4704b7e5159276351584`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:26:31.191564 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-fadcfe83-f852-4b6c-a507-21a162c6f080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:26:31.241547 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:26:31.261090 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1435/2865] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:26:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:26:31.265517 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecba584-ffc0-4f74-afd6-3fe236b34ba9 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:31.337559 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecba584-ffc0-4f74-afd6-3fe236b34ba9 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:31.342522 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c359b9-44f0-4c8d-baaf-b7fe4c2fa8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:31.343192 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c359b9-44f0-4c8d-baaf-b7fe4c2fa8a7 admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:31.343475 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c359b9-44f0-4c8d-baaf-b7fe4c2fa8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:31.343754 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c359b9-44f0-4c8d-baaf-b7fe4c2fa8a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:31.344461 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c359b9-44f0-4c8d-baaf-b7fe4c2fa8a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:31.346438 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c359b9-44f0-4c8d-baaf-b7fe4c2fa8a7 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:31.373821 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1431/2866] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 09:26:31 2022] POST /identity/v3/projects => generated 381 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:26:31.378203 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadcfe83-f852-4b6c-a507-21a162c6f080 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:31.389502 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadcfe83-f852-4b6c-a507-21a162c6f080 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:31.447564 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2671a252-696a-4522-8256-38278864b910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:31.448240 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671a252-696a-4522-8256-38278864b910 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:31.448526 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671a252-696a-4522-8256-38278864b910 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:31.448806 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671a252-696a-4522-8256-38278864b910 admin admin] PATH_INFO: `/v3/users` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:31.449525 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2671a252-696a-4522-8256-38278864b910 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:31.451516 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2671a252-696a-4522-8256-38278864b910 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:31.472053 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1436/2867] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 09:26:31 2022] POST /identity/v3/users => generated 297 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:26:31.476171 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c359b9-44f0-4c8d-baaf-b7fe4c2fa8a7 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:31.488003 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c359b9-44f0-4c8d-baaf-b7fe4c2fa8a7 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:31.492709 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f4e65c-7b06-422b-989d-c22e3d429a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:31.493376 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f4e65c-7b06-422b-989d-c22e3d429a74 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:31.493656 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f4e65c-7b06-422b-989d-c22e3d429a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:31.493930 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f4e65c-7b06-422b-989d-c22e3d429a74 admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:31.494692 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f4e65c-7b06-422b-989d-c22e3d429a74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:31.496404 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f4e65c-7b06-422b-989d-c22e3d429a74 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:31.508450 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1432/2868] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 09:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:26:31.512789 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2671a252-696a-4522-8256-38278864b910 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:31.524745 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2671a252-696a-4522-8256-38278864b910 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:31.535787 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6da6db-6836-4e73-9b56-b082a92f73e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:31.536686 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6da6db-6836-4e73-9b56-b082a92f73e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:31.536970 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6da6db-6836-4e73-9b56-b082a92f73e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:31.537277 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6da6db-6836-4e73-9b56-b082a92f73e2 admin admin] PATH_INFO: `/v3/projects/736ee4d69ec4443dac6e02487ba14402/users/01a44aef179a4989b124f639a689f9a6/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:31.554556 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6da6db-6836-4e73-9b56-b082a92f73e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=736ee4d69ec4443dac6e02487ba14402, user_id=01a44aef179a4989b124f639a689f9a6, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:31.557225 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6da6db-6836-4e73-9b56-b082a92f73e2 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:31.571540 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1437/2869] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 09:26:31 2022] PUT /identity/v3/projects/736ee4d69ec4443dac6e02487ba14402/users/01a44aef179a4989b124f639a689f9a6/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:26:31.575704 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f4e65c-7b06-422b-989d-c22e3d429a74 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:31.586306 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f4e65c-7b06-422b-989d-c22e3d429a74 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:31.642714 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a3a07-be34-4954-9559-6b324b3bbcaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:31.643299 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a3a07-be34-4954-9559-6b324b3bbcaa admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:31.643581 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a3a07-be34-4954-9559-6b324b3bbcaa admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:31.643866 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a3a07-be34-4954-9559-6b324b3bbcaa admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:31.644593 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a3a07-be34-4954-9559-6b324b3bbcaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:31.646211 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a3a07-be34-4954-9559-6b324b3bbcaa admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:31.657149 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1433/2870] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 09:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:26:31.661414 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6da6db-6836-4e73-9b56-b082a92f73e2 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:31.672869 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6da6db-6836-4e73-9b56-b082a92f73e2 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:31.677578 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da131fd-2f03-44ad-829c-22f8b7160b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:31.679103 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da131fd-2f03-44ad-829c-22f8b7160b86 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:31.679409 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da131fd-2f03-44ad-829c-22f8b7160b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:31.679689 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da131fd-2f03-44ad-829c-22f8b7160b86 admin admin] PATH_INFO: `/v3/projects/736ee4d69ec4443dac6e02487ba14402/users/01a44aef179a4989b124f639a689f9a6/roles/c7518e0f532945af80c33860f2ac506d` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:31.682480 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da131fd-2f03-44ad-829c-22f8b7160b86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=736ee4d69ec4443dac6e02487ba14402, user_id=01a44aef179a4989b124f639a689f9a6, role_id=c7518e0f532945af80c33860f2ac506d)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:31.686317 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da131fd-2f03-44ad-829c-22f8b7160b86 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:31.698946 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1438/2871] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 09:26:31 2022] PUT /identity/v3/projects/736ee4d69ec4443dac6e02487ba14402/users/01a44aef179a4989b124f639a689f9a6/roles/c7518e0f532945af80c33860f2ac506d => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:26:31.709053 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1b17e-c0bf-4c21-942e-dc18cb90aba8 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:31.709376 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1b17e-c0bf-4c21-942e-dc18cb90aba8 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:31.710247 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1b17e-c0bf-4c21-942e-dc18cb90aba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:31.737768 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-6ab1b17e-c0bf-4c21-942e-dc18cb90aba8 None None] MFA Rules not processed for user `01a44aef179a4989b124f639a689f9a6`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:26:31.739007 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-6ab1b17e-c0bf-4c21-942e-dc18cb90aba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:26:31.743102 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:26:31.810562 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1434/2872] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:26:31 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:26:31.823126 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da131fd-2f03-44ad-829c-22f8b7160b86 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:31.825118 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-9da131fd-2f03-44ad-829c-22f8b7160b86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:26:31.885943 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da131fd-2f03-44ad-829c-22f8b7160b86 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:31.889732 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd9e1a-b01a-4094-8981-30442fd028fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:31.890479 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd9e1a-b01a-4094-8981-30442fd028fb service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:31.890765 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd9e1a-b01a-4094-8981-30442fd028fb service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:31.891041 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd9e1a-b01a-4094-8981-30442fd028fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:31.901232 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dd9e1a-b01a-4094-8981-30442fd028fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:31.902644 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dd9e1a-b01a-4094-8981-30442fd028fb service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:31.912663 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1439/2873] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:26:31 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:26:32.238232 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab1b17e-c0bf-4c21-942e-dc18cb90aba8 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:32.248681 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab1b17e-c0bf-4c21-942e-dc18cb90aba8 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:32.257550 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a94553-ef63-44a2-b0fe-d2665895089b tempest-VolumeQuotaClassesTest-1681199322 tempest-VolumeQuotaClassesTest-1681199322-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a44aef179a4989b124f639a689f9a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736ee4d69ec4443dac6e02487ba14402', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:32.258270 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a94553-ef63-44a2-b0fe-d2665895089b tempest-VolumeQuotaClassesTest-1681199322 tempest-VolumeQuotaClassesTest-1681199322-project-admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:32.258562 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a94553-ef63-44a2-b0fe-d2665895089b tempest-VolumeQuotaClassesTest-1681199322 tempest-VolumeQuotaClassesTest-1681199322-project-admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:32.258845 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a94553-ef63-44a2-b0fe-d2665895089b tempest-VolumeQuotaClassesTest-1681199322 tempest-VolumeQuotaClassesTest-1681199322-project-admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:32.259596 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a94553-ef63-44a2-b0fe-d2665895089b tempest-VolumeQuotaClassesTest-1681199322 tempest-VolumeQuotaClassesTest-1681199322-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:26:32.259911 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a94553-ef63-44a2-b0fe-d2665895089b tempest-VolumeQuotaClassesTest-1681199322 tempest-VolumeQuotaClassesTest-1681199322-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:32.261664 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a94553-ef63-44a2-b0fe-d2665895089b tempest-VolumeQuotaClassesTest-1681199322 tempest-VolumeQuotaClassesTest-1681199322-project-admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:32.274677 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1435/2874] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Jun 22 09:26:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:26:32.278785 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd9e1a-b01a-4094-8981-30442fd028fb service cinder] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:32.288036 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd9e1a-b01a-4094-8981-30442fd028fb service cinder] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:32.294808 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a2cff0-5975-4c46-8a6f-2c2120e3b5ff tempest-VolumeQuotaClassesTest-1681199322 tempest-VolumeQuotaClassesTest-1681199322-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a44aef179a4989b124f639a689f9a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736ee4d69ec4443dac6e02487ba14402', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:32.295751 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2cff0-5975-4c46-8a6f-2c2120e3b5ff tempest-VolumeQuotaClassesTest-1681199322 tempest-VolumeQuotaClassesTest-1681199322-project-admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:32.296209 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2cff0-5975-4c46-8a6f-2c2120e3b5ff tempest-VolumeQuotaClassesTest-1681199322 tempest-VolumeQuotaClassesTest-1681199322-project-admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:32.296542 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2cff0-5975-4c46-8a6f-2c2120e3b5ff tempest-VolumeQuotaClassesTest-1681199322 tempest-VolumeQuotaClassesTest-1681199322-project-admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:32.297486 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a2cff0-5975-4c46-8a6f-2c2120e3b5ff tempest-VolumeQuotaClassesTest-1681199322 tempest-VolumeQuotaClassesTest-1681199322-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:32.300093 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a2cff0-5975-4c46-8a6f-2c2120e3b5ff tempest-VolumeQuotaClassesTest-1681199322 tempest-VolumeQuotaClassesTest-1681199322-project-admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:32.333584 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1440/2875] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 09:26:32 2022] POST /identity/v3/projects => generated 354 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:26:32.336344 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a94553-ef63-44a2-b0fe-d2665895089b tempest-VolumeQuotaClassesTest-1681199322 tempest-VolumeQuotaClassesTest-1681199322-project-admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:32.346396 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a94553-ef63-44a2-b0fe-d2665895089b tempest-VolumeQuotaClassesTest-1681199322 tempest-VolumeQuotaClassesTest-1681199322-project-admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:32.404566 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df3af96-e327-4a41-a953-134c4f08606e tempest-VolumeQuotaClassesTest-1681199322 tempest-VolumeQuotaClassesTest-1681199322-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a44aef179a4989b124f639a689f9a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736ee4d69ec4443dac6e02487ba14402', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:32.405271 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3af96-e327-4a41-a953-134c4f08606e tempest-VolumeQuotaClassesTest-1681199322 tempest-VolumeQuotaClassesTest-1681199322-project-admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:32.405562 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3af96-e327-4a41-a953-134c4f08606e tempest-VolumeQuotaClassesTest-1681199322 tempest-VolumeQuotaClassesTest-1681199322-project-admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:32.405842 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3af96-e327-4a41-a953-134c4f08606e tempest-VolumeQuotaClassesTest-1681199322 tempest-VolumeQuotaClassesTest-1681199322-project-admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:32.406613 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df3af96-e327-4a41-a953-134c4f08606e tempest-VolumeQuotaClassesTest-1681199322 tempest-VolumeQuotaClassesTest-1681199322-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:26:32.406926 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df3af96-e327-4a41-a953-134c4f08606e tempest-VolumeQuotaClassesTest-1681199322 tempest-VolumeQuotaClassesTest-1681199322-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:32.408527 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df3af96-e327-4a41-a953-134c4f08606e tempest-VolumeQuotaClassesTest-1681199322 tempest-VolumeQuotaClassesTest-1681199322-project-admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:32.421056 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1436/2876] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Jun 22 09:26:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:26:32.457615 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a2cff0-5975-4c46-8a6f-2c2120e3b5ff tempest-VolumeQuotaClassesTest-1681199322 tempest-VolumeQuotaClassesTest-1681199322-project-admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:32.468718 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a2cff0-5975-4c46-8a6f-2c2120e3b5ff tempest-VolumeQuotaClassesTest-1681199322 tempest-VolumeQuotaClassesTest-1681199322-project-admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:32.480981 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6283aa-74e3-49cc-8c07-f84f8bf789b9 tempest-VolumeQuotaClassesTest-1681199322 tempest-VolumeQuotaClassesTest-1681199322-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a44aef179a4989b124f639a689f9a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '736ee4d69ec4443dac6e02487ba14402', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:32.481874 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6283aa-74e3-49cc-8c07-f84f8bf789b9 tempest-VolumeQuotaClassesTest-1681199322 tempest-VolumeQuotaClassesTest-1681199322-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:32.482192 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6283aa-74e3-49cc-8c07-f84f8bf789b9 tempest-VolumeQuotaClassesTest-1681199322 tempest-VolumeQuotaClassesTest-1681199322-project-admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:32.482468 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6283aa-74e3-49cc-8c07-f84f8bf789b9 tempest-VolumeQuotaClassesTest-1681199322 tempest-VolumeQuotaClassesTest-1681199322-project-admin] PATH_INFO: `/v3/projects/a3f9351e9ede4586bcec3a9db48ad22a` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:32.483689 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6283aa-74e3-49cc-8c07-f84f8bf789b9 tempest-VolumeQuotaClassesTest-1681199322 tempest-VolumeQuotaClassesTest-1681199322-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a3f9351e9ede4586bcec3a9db48ad22a)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:32.485647 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6283aa-74e3-49cc-8c07-f84f8bf789b9 tempest-VolumeQuotaClassesTest-1681199322 tempest-VolumeQuotaClassesTest-1681199322-project-admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:32.507710 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:26:32.538622 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-de6283aa-74e3-49cc-8c07-f84f8bf789b9 tempest-VolumeQuotaClassesTest-1681199322 tempest-VolumeQuotaClassesTest-1681199322-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3f9351e9ede4586bcec3a9db48ad22a', 'request_id': 'req-de6283aa-74e3-49cc-8c07-f84f8bf789b9'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:32.544031 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-de6283aa-74e3-49cc-8c07-f84f8bf789b9 tempest-VolumeQuotaClassesTest-1681199322 tempest-VolumeQuotaClassesTest-1681199322-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3f9351e9ede4586bcec3a9db48ad22a', 'request_id': 'req-de6283aa-74e3-49cc-8c07-f84f8bf789b9'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:32.550362 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-de6283aa-74e3-49cc-8c07-f84f8bf789b9 tempest-VolumeQuotaClassesTest-1681199322 tempest-VolumeQuotaClassesTest-1681199322-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3f9351e9ede4586bcec3a9db48ad22a', 'request_id': 'req-de6283aa-74e3-49cc-8c07-f84f8bf789b9'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:32.564737 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-de6283aa-74e3-49cc-8c07-f84f8bf789b9 tempest-VolumeQuotaClassesTest-1681199322 tempest-VolumeQuotaClassesTest-1681199322-project-admin] The token cache is being invalidate because project a3f9351e9ede4586bcec3a9db48ad22a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:26:32.565026 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-de6283aa-74e3-49cc-8c07-f84f8bf789b9 tempest-VolumeQuotaClassesTest-1681199322 tempest-VolumeQuotaClassesTest-1681199322-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:32.565650 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-de6283aa-74e3-49cc-8c07-f84f8bf789b9 tempest-VolumeQuotaClassesTest-1681199322 tempest-VolumeQuotaClassesTest-1681199322-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:32.567239 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1441/2877] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 09:26:32 2022] DELETE /identity/v3/projects/a3f9351e9ede4586bcec3a9db48ad22a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:26:32.761561 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df3af96-e327-4a41-a953-134c4f08606e tempest-VolumeQuotaClassesTest-1681199322 tempest-VolumeQuotaClassesTest-1681199322-project-admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:32.763425 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-6df3af96-e327-4a41-a953-134c4f08606e tempest-VolumeQuotaClassesTest-1681199322 tempest-VolumeQuotaClassesTest-1681199322-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:26:32.830663 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df3af96-e327-4a41-a953-134c4f08606e tempest-VolumeQuotaClassesTest-1681199322 tempest-VolumeQuotaClassesTest-1681199322-project-admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:32.857183 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=100 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:26:32.888341 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c03171a-3fff-4d42-8462-f959327ccdf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:32.889246 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c03171a-3fff-4d42-8462-f959327ccdf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:32.889533 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c03171a-3fff-4d42-8462-f959327ccdf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:32.889812 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c03171a-3fff-4d42-8462-f959327ccdf9 admin admin] PATH_INFO: `/v3/users/61b0408f954e4704b7e5159276351584` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:32.891084 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c03171a-3fff-4d42-8462-f959327ccdf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61b0408f954e4704b7e5159276351584)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:32.893024 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c03171a-3fff-4d42-8462-f959327ccdf9 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:32.946612 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-5c03171a-3fff-4d42-8462-f959327ccdf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61b0408f954e4704b7e5159276351584'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:32.954856 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-5c03171a-3fff-4d42-8462-f959327ccdf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61b0408f954e4704b7e5159276351584'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:32.955568 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-5c03171a-3fff-4d42-8462-f959327ccdf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61b0408f954e4704b7e5159276351584'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:32.963825 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-5c03171a-3fff-4d42-8462-f959327ccdf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61b0408f954e4704b7e5159276351584'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:32.964477 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-5c03171a-3fff-4d42-8462-f959327ccdf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61b0408f954e4704b7e5159276351584'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:32.983698 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1437/2878] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 09:26:32 2022] DELETE /identity/v3/users/61b0408f954e4704b7e5159276351584 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:26:32.993534 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e67ab-0bed-4a8e-bff9-5484627c7ecf None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:32.994095 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e67ab-0bed-4a8e-bff9-5484627c7ecf None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:32.994095 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e67ab-0bed-4a8e-bff9-5484627c7ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:33.011986 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-c42e67ab-0bed-4a8e-bff9-5484627c7ecf None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:26:33.013222 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-c42e67ab-0bed-4a8e-bff9-5484627c7ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:26:33.075470 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1442/2879] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:26:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:26:33.085563 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c03171a-3fff-4d42-8462-f959327ccdf9 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:33.087033 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-5c03171a-3fff-4d42-8462-f959327ccdf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:26:33.144961 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c03171a-3fff-4d42-8462-f959327ccdf9 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:33.148763 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c96e3-a349-46c9-aa4f-58c64a1a8d5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:33.149425 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c96e3-a349-46c9-aa4f-58c64a1a8d5a service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:33.149712 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c96e3-a349-46c9-aa4f-58c64a1a8d5a service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:33.149996 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c96e3-a349-46c9-aa4f-58c64a1a8d5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:33.159762 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97c96e3-a349-46c9-aa4f-58c64a1a8d5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:33.161266 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97c96e3-a349-46c9-aa4f-58c64a1a8d5a service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:33.171929 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1438/2880] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:26:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:26:33.455414 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e67ab-0bed-4a8e-bff9-5484627c7ecf None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:33.456947 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-c42e67ab-0bed-4a8e-bff9-5484627c7ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:26:33.472859 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e67ab-0bed-4a8e-bff9-5484627c7ecf None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:33.479532 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b00a21f-d09f-4396-b99b-030d9928af41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:33.480448 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00a21f-d09f-4396-b99b-030d9928af41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:33.480679 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00a21f-d09f-4396-b99b-030d9928af41 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:33.480978 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00a21f-d09f-4396-b99b-030d9928af41 admin admin] PATH_INFO: `/v3/projects/934e81749b054739b291e18ee976ba7f` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:33.482408 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b00a21f-d09f-4396-b99b-030d9928af41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=934e81749b054739b291e18ee976ba7f)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:33.484481 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b00a21f-d09f-4396-b99b-030d9928af41 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:33.541174 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-5b00a21f-d09f-4396-b99b-030d9928af41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '934e81749b054739b291e18ee976ba7f', 'request_id': 'req-5b00a21f-d09f-4396-b99b-030d9928af41'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:33.546759 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-5b00a21f-d09f-4396-b99b-030d9928af41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '934e81749b054739b291e18ee976ba7f', 'request_id': 'req-5b00a21f-d09f-4396-b99b-030d9928af41'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:33.553275 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-5b00a21f-d09f-4396-b99b-030d9928af41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '934e81749b054739b291e18ee976ba7f', 'request_id': 'req-5b00a21f-d09f-4396-b99b-030d9928af41'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:33.566690 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-5b00a21f-d09f-4396-b99b-030d9928af41 admin admin] The token cache is being invalidate because project 934e81749b054739b291e18ee976ba7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:26:33.566690 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-5b00a21f-d09f-4396-b99b-030d9928af41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:33.566971 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-5b00a21f-d09f-4396-b99b-030d9928af41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:33.568483 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1443/2881] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 09:26:33 2022] DELETE /identity/v3/projects/934e81749b054739b291e18ee976ba7f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:26:33.573392 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c96e3-a349-46c9-aa4f-58c64a1a8d5a service neutron] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:33.583325 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c96e3-a349-46c9-aa4f-58c64a1a8d5a service neutron] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:33.631862 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:26:33.642604 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8abeb48-0e39-4d55-9666-978f32462c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:33.643476 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8abeb48-0e39-4d55-9666-978f32462c5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:33.643758 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8abeb48-0e39-4d55-9666-978f32462c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:33.644031 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8abeb48-0e39-4d55-9666-978f32462c5d admin admin] PATH_INFO: `/v3/users/01a44aef179a4989b124f639a689f9a6` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:33.645225 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8abeb48-0e39-4d55-9666-978f32462c5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=01a44aef179a4989b124f639a689f9a6)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:33.647836 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8abeb48-0e39-4d55-9666-978f32462c5d admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:33.696120 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-a8abeb48-0e39-4d55-9666-978f32462c5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01a44aef179a4989b124f639a689f9a6'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:33.703814 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-a8abeb48-0e39-4d55-9666-978f32462c5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01a44aef179a4989b124f639a689f9a6'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:33.704602 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-a8abeb48-0e39-4d55-9666-978f32462c5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01a44aef179a4989b124f639a689f9a6'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:33.714420 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-a8abeb48-0e39-4d55-9666-978f32462c5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01a44aef179a4989b124f639a689f9a6'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:33.715179 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-a8abeb48-0e39-4d55-9666-978f32462c5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01a44aef179a4989b124f639a689f9a6'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:33.733476 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1439/2882] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 09:26:33 2022] DELETE /identity/v3/users/01a44aef179a4989b124f639a689f9a6 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:26:34.046743 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b00a21f-d09f-4396-b99b-030d9928af41 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:34.048828 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-5b00a21f-d09f-4396-b99b-030d9928af41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:26:34.069642 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b00a21f-d09f-4396-b99b-030d9928af41 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:34.101610 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:26:34.135001 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea07a74f-30b5-4b83-b538-6710fd20166e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:34.135874 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07a74f-30b5-4b83-b538-6710fd20166e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:34.136160 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07a74f-30b5-4b83-b538-6710fd20166e admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:34.136435 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07a74f-30b5-4b83-b538-6710fd20166e admin admin] PATH_INFO: `/v3/projects/736ee4d69ec4443dac6e02487ba14402` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:34.137629 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea07a74f-30b5-4b83-b538-6710fd20166e admin admin] RBAC: Authorizing `identity:delete_project(project_id=736ee4d69ec4443dac6e02487ba14402)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:34.139581 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea07a74f-30b5-4b83-b538-6710fd20166e admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:34.188353 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-ea07a74f-30b5-4b83-b538-6710fd20166e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '736ee4d69ec4443dac6e02487ba14402', 'request_id': 'req-ea07a74f-30b5-4b83-b538-6710fd20166e'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:34.194475 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-ea07a74f-30b5-4b83-b538-6710fd20166e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '736ee4d69ec4443dac6e02487ba14402', 'request_id': 'req-ea07a74f-30b5-4b83-b538-6710fd20166e'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:34.200887 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-ea07a74f-30b5-4b83-b538-6710fd20166e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '736ee4d69ec4443dac6e02487ba14402', 'request_id': 'req-ea07a74f-30b5-4b83-b538-6710fd20166e'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:34.215309 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-ea07a74f-30b5-4b83-b538-6710fd20166e admin admin] The token cache is being invalidate because project 736ee4d69ec4443dac6e02487ba14402 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:26:34.215600 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-ea07a74f-30b5-4b83-b538-6710fd20166e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:34.216274 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-ea07a74f-30b5-4b83-b538-6710fd20166e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:34.217836 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1444/2883] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 09:26:34 2022] DELETE /identity/v3/projects/736ee4d69ec4443dac6e02487ba14402 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:26:34.222772 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c273d-1a35-4826-9838-4e7e3680f695 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:34.223288 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c273d-1a35-4826-9838-4e7e3680f695 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:34.223384 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c273d-1a35-4826-9838-4e7e3680f695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:34.243431 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-616c273d-1a35-4826-9838-4e7e3680f695 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:26:34.244670 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-616c273d-1a35-4826-9838-4e7e3680f695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:26:34.439029 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1440/2884] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:26:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:26:34.448575 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a09ee6-7878-4f86-986e-cc6628893b68 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:34.448865 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a09ee6-7878-4f86-986e-cc6628893b68 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:34.449140 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a09ee6-7878-4f86-986e-cc6628893b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:34.468081 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-f5a09ee6-7878-4f86-986e-cc6628893b68 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:26:34.470970 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-f5a09ee6-7878-4f86-986e-cc6628893b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:26:34.477471 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1445/2885] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:26:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:26:34.481824 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c273d-1a35-4826-9838-4e7e3680f695 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:34.491656 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c273d-1a35-4826-9838-4e7e3680f695 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:34.496246 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6fc73a-0131-47c4-aad1-7aeaaff96368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:34.497179 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6fc73a-0131-47c4-aad1-7aeaaff96368 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:34.497506 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6fc73a-0131-47c4-aad1-7aeaaff96368 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:34.497764 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6fc73a-0131-47c4-aad1-7aeaaff96368 admin admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:34.498535 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6fc73a-0131-47c4-aad1-7aeaaff96368 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:26:34.498857 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6fc73a-0131-47c4-aad1-7aeaaff96368 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:34.500443 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6fc73a-0131-47c4-aad1-7aeaaff96368 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:34.515198 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1441/2886] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Jun 22 09:26:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:26:34.519723 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a09ee6-7878-4f86-986e-cc6628893b68 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:34.529930 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a09ee6-7878-4f86-986e-cc6628893b68 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:34.534575 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af47f1-7b8e-40d8-8eb6-e5cdb032e1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:34.535229 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af47f1-7b8e-40d8-8eb6-e5cdb032e1d7 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:34.535514 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af47f1-7b8e-40d8-8eb6-e5cdb032e1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:34.535798 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af47f1-7b8e-40d8-8eb6-e5cdb032e1d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:34.536505 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af47f1-7b8e-40d8-8eb6-e5cdb032e1d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:34.538483 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af47f1-7b8e-40d8-8eb6-e5cdb032e1d7 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:34.564513 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1446/2887] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 09:26:34 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:26:34.568558 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6fc73a-0131-47c4-aad1-7aeaaff96368 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:34.579449 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6fc73a-0131-47c4-aad1-7aeaaff96368 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:34.631649 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:26:34.638729 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1fa603-c077-413d-a6d8-44a29665ea97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:34.639428 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1fa603-c077-413d-a6d8-44a29665ea97 admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:34.640177 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1fa603-c077-413d-a6d8-44a29665ea97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:34.640542 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1fa603-c077-413d-a6d8-44a29665ea97 admin admin] PATH_INFO: `/v3/users` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:34.641767 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1fa603-c077-413d-a6d8-44a29665ea97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:34.644150 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1fa603-c077-413d-a6d8-44a29665ea97 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:34.665192 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1442/2888] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 09:26:34 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:26:34.669284 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af47f1-7b8e-40d8-8eb6-e5cdb032e1d7 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:34.680930 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af47f1-7b8e-40d8-8eb6-e5cdb032e1d7 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:34.685641 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c79713-6c5d-4d1c-9b6c-988a72981a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:34.686341 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c79713-6c5d-4d1c-9b6c-988a72981a47 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:34.686631 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c79713-6c5d-4d1c-9b6c-988a72981a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:34.686920 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c79713-6c5d-4d1c-9b6c-988a72981a47 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:34.687653 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c79713-6c5d-4d1c-9b6c-988a72981a47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:34.689323 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c79713-6c5d-4d1c-9b6c-988a72981a47 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:34.700605 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1447/2889] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 09:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:26:34.704678 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1fa603-c077-413d-a6d8-44a29665ea97 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:34.715595 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1fa603-c077-413d-a6d8-44a29665ea97 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:34.720428 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cd46b6-d223-41b8-ae82-ac1aaa492c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:34.721121 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd46b6-d223-41b8-ae82-ac1aaa492c6c admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:34.721411 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd46b6-d223-41b8-ae82-ac1aaa492c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:34.721689 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd46b6-d223-41b8-ae82-ac1aaa492c6c admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:34.722465 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cd46b6-d223-41b8-ae82-ac1aaa492c6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:34.724046 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cd46b6-d223-41b8-ae82-ac1aaa492c6c admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:34.735040 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1443/2890] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 09:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:26:34.739415 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c79713-6c5d-4d1c-9b6c-988a72981a47 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:34.750040 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c79713-6c5d-4d1c-9b6c-988a72981a47 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:34.755007 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eff727-49e4-4251-836f-97cd5ad30d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:34.755880 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eff727-49e4-4251-836f-97cd5ad30d08 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:34.756215 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eff727-49e4-4251-836f-97cd5ad30d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:34.756494 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eff727-49e4-4251-836f-97cd5ad30d08 admin admin] PATH_INFO: `/v3/projects/d43c30f3ce1a4bea9b60e0f98e240785/users/55bf1dd9cb504ea68e86254c224a8ac3/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:34.775804 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eff727-49e4-4251-836f-97cd5ad30d08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d43c30f3ce1a4bea9b60e0f98e240785, user_id=55bf1dd9cb504ea68e86254c224a8ac3, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:34.779119 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eff727-49e4-4251-836f-97cd5ad30d08 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:34.797529 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1448/2891] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 09:26:34 2022] PUT /identity/v3/projects/d43c30f3ce1a4bea9b60e0f98e240785/users/55bf1dd9cb504ea68e86254c224a8ac3/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:26:34.814949 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e0de7-9cc3-407d-87f6-1a1138919f7c None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:34.815411 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e0de7-9cc3-407d-87f6-1a1138919f7c None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:34.815872 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e0de7-9cc3-407d-87f6-1a1138919f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:34.850744 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-b76e0de7-9cc3-407d-87f6-1a1138919f7c None None] MFA Rules not processed for user `55bf1dd9cb504ea68e86254c224a8ac3`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:26:34.851978 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-b76e0de7-9cc3-407d-87f6-1a1138919f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:26:34.923653 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1444/2892] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:26:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:26:34.940236 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eff727-49e4-4251-836f-97cd5ad30d08 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:34.941915 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-27eff727-49e4-4251-836f-97cd5ad30d08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:26:35.004148 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eff727-49e4-4251-836f-97cd5ad30d08 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:35.008490 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd293861-8958-4e20-82ca-6aeefd07ea37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:35.009142 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd293861-8958-4e20-82ca-6aeefd07ea37 service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:35.009427 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd293861-8958-4e20-82ca-6aeefd07ea37 service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:35.009707 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd293861-8958-4e20-82ca-6aeefd07ea37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:35.018690 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd293861-8958-4e20-82ca-6aeefd07ea37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:35.020163 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd293861-8958-4e20-82ca-6aeefd07ea37 service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:35.024949 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:26:35.030334 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1449/2893] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:26:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:26:35.050400 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e0de7-9cc3-407d-87f6-1a1138919f7c None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:35.116311 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e0de7-9cc3-407d-87f6-1a1138919f7c None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:35.120929 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730e7f4c-e476-4c5b-84ad-16150850838b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:35.122061 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e7f4c-e476-4c5b-84ad-16150850838b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:35.122372 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e7f4c-e476-4c5b-84ad-16150850838b admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:35.122652 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e7f4c-e476-4c5b-84ad-16150850838b admin admin] PATH_INFO: `/v3/users/55bf1dd9cb504ea68e86254c224a8ac3` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:35.123908 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730e7f4c-e476-4c5b-84ad-16150850838b admin admin] RBAC: Authorizing `identity:delete_user(user_id=55bf1dd9cb504ea68e86254c224a8ac3)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:35.125829 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730e7f4c-e476-4c5b-84ad-16150850838b admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:35.177853 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-730e7f4c-e476-4c5b-84ad-16150850838b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55bf1dd9cb504ea68e86254c224a8ac3'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:35.185309 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-730e7f4c-e476-4c5b-84ad-16150850838b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55bf1dd9cb504ea68e86254c224a8ac3'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:35.186000 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-730e7f4c-e476-4c5b-84ad-16150850838b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55bf1dd9cb504ea68e86254c224a8ac3'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:35.194610 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-730e7f4c-e476-4c5b-84ad-16150850838b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55bf1dd9cb504ea68e86254c224a8ac3'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:35.195208 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-730e7f4c-e476-4c5b-84ad-16150850838b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55bf1dd9cb504ea68e86254c224a8ac3'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:35.199995 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:26:35.216520 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1445/2894] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 09:26:35 2022] DELETE /identity/v3/users/55bf1dd9cb504ea68e86254c224a8ac3 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:26:35.221086 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abcf927-fff4-4d5a-a4c2-8fb6ef5b29e8 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:35.221594 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abcf927-fff4-4d5a-a4c2-8fb6ef5b29e8 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:35.221688 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abcf927-fff4-4d5a-a4c2-8fb6ef5b29e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:35.239862 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-0abcf927-fff4-4d5a-a4c2-8fb6ef5b29e8 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:26:35.241708 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-0abcf927-fff4-4d5a-a4c2-8fb6ef5b29e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:26:35.311122 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1450/2895] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:26:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:26:35.323769 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730e7f4c-e476-4c5b-84ad-16150850838b admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:35.325962 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-730e7f4c-e476-4c5b-84ad-16150850838b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:26:35.387252 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730e7f4c-e476-4c5b-84ad-16150850838b admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:35.391159 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de16a4-5c0a-4c0e-9794-fe422256ee9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:35.391815 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de16a4-5c0a-4c0e-9794-fe422256ee9f service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:35.392096 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de16a4-5c0a-4c0e-9794-fe422256ee9f service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:35.392372 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de16a4-5c0a-4c0e-9794-fe422256ee9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:35.403021 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69de16a4-5c0a-4c0e-9794-fe422256ee9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:35.404498 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69de16a4-5c0a-4c0e-9794-fe422256ee9f service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:35.414743 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1446/2896] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:26:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:26:35.685731 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abcf927-fff4-4d5a-a4c2-8fb6ef5b29e8 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:35.687563 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-0abcf927-fff4-4d5a-a4c2-8fb6ef5b29e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:26:35.703875 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abcf927-fff4-4d5a-a4c2-8fb6ef5b29e8 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:35.708711 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba67744a-42f0-42e0-9bab-4d68a2e4c194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:35.710195 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67744a-42f0-42e0-9bab-4d68a2e4c194 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:35.710455 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67744a-42f0-42e0-9bab-4d68a2e4c194 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:35.710730 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67744a-42f0-42e0-9bab-4d68a2e4c194 admin admin] PATH_INFO: `/v3/projects/d43c30f3ce1a4bea9b60e0f98e240785` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:35.712157 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba67744a-42f0-42e0-9bab-4d68a2e4c194 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d43c30f3ce1a4bea9b60e0f98e240785)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:35.714134 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba67744a-42f0-42e0-9bab-4d68a2e4c194 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:35.762631 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-ba67744a-42f0-42e0-9bab-4d68a2e4c194 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd43c30f3ce1a4bea9b60e0f98e240785', 'request_id': 'req-ba67744a-42f0-42e0-9bab-4d68a2e4c194'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:35.768080 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-ba67744a-42f0-42e0-9bab-4d68a2e4c194 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd43c30f3ce1a4bea9b60e0f98e240785', 'request_id': 'req-ba67744a-42f0-42e0-9bab-4d68a2e4c194'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:35.775071 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-ba67744a-42f0-42e0-9bab-4d68a2e4c194 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd43c30f3ce1a4bea9b60e0f98e240785', 'request_id': 'req-ba67744a-42f0-42e0-9bab-4d68a2e4c194'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:35.787831 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-ba67744a-42f0-42e0-9bab-4d68a2e4c194 admin admin] The token cache is being invalidate because project d43c30f3ce1a4bea9b60e0f98e240785 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:26:35.788616 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-ba67744a-42f0-42e0-9bab-4d68a2e4c194 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:35.789261 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-ba67744a-42f0-42e0-9bab-4d68a2e4c194 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:35.790906 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1451/2897] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 09:26:35 2022] DELETE /identity/v3/projects/d43c30f3ce1a4bea9b60e0f98e240785 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:26:35.796043 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92138496-acb9-4b0e-90df-c8e4b9d4cb2d None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:35.796337 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92138496-acb9-4b0e-90df-c8e4b9d4cb2d None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:35.796618 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92138496-acb9-4b0e-90df-c8e4b9d4cb2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:35.815067 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-92138496-acb9-4b0e-90df-c8e4b9d4cb2d None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:26:35.816307 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-92138496-acb9-4b0e-90df-c8e4b9d4cb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:26:35.880968 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1447/2898] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:26:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:26:35.889117 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925cfc87-1649-4528-9dba-08194f66c7dc None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:35.889410 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925cfc87-1649-4528-9dba-08194f66c7dc None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:35.889692 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925cfc87-1649-4528-9dba-08194f66c7dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:35.909006 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-925cfc87-1649-4528-9dba-08194f66c7dc None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:26:35.910267 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-925cfc87-1649-4528-9dba-08194f66c7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:26:35.918941 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1452/2899] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:26:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:26:35.923257 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92138496-acb9-4b0e-90df-c8e4b9d4cb2d None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:35.933751 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92138496-acb9-4b0e-90df-c8e4b9d4cb2d None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:35.938415 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a232c8db-ae0b-48fa-9941-9940f6fdd398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:35.939077 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a232c8db-ae0b-48fa-9941-9940f6fdd398 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:35.939364 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a232c8db-ae0b-48fa-9941-9940f6fdd398 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:35.939646 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a232c8db-ae0b-48fa-9941-9940f6fdd398 admin admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:35.940384 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a232c8db-ae0b-48fa-9941-9940f6fdd398 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:26:35.940696 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a232c8db-ae0b-48fa-9941-9940f6fdd398 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:35.942315 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a232c8db-ae0b-48fa-9941-9940f6fdd398 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:35.954513 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1448/2900] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Jun 22 09:26:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:26:35.959113 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925cfc87-1649-4528-9dba-08194f66c7dc None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:35.968661 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925cfc87-1649-4528-9dba-08194f66c7dc None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:35.973375 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc3fb64-df11-43d6-b264-bc89c8bbbc90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:35.974033 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3fb64-df11-43d6-b264-bc89c8bbbc90 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:35.974344 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3fb64-df11-43d6-b264-bc89c8bbbc90 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:35.974624 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3fb64-df11-43d6-b264-bc89c8bbbc90 admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:35.975918 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc3fb64-df11-43d6-b264-bc89c8bbbc90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:35.977824 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc3fb64-df11-43d6-b264-bc89c8bbbc90 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:36.006617 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1453/2901] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 09:26:35 2022] POST /identity/v3/projects => generated 359 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:26:36.011150 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a232c8db-ae0b-48fa-9941-9940f6fdd398 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:36.021566 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a232c8db-ae0b-48fa-9941-9940f6fdd398 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:36.082948 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f148ccb2-6145-4258-86b6-e58c004cfa0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:36.083627 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148ccb2-6145-4258-86b6-e58c004cfa0a admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:36.083919 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148ccb2-6145-4258-86b6-e58c004cfa0a admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:36.084197 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148ccb2-6145-4258-86b6-e58c004cfa0a admin admin] PATH_INFO: `/v3/users` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:36.084928 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f148ccb2-6145-4258-86b6-e58c004cfa0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:36.086881 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f148ccb2-6145-4258-86b6-e58c004cfa0a admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:36.107459 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1449/2902] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 09:26:36 2022] POST /identity/v3/users => generated 280 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:26:36.111557 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc3fb64-df11-43d6-b264-bc89c8bbbc90 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:36.122908 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc3fb64-df11-43d6-b264-bc89c8bbbc90 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:36.127590 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf085a-6bc6-4528-988d-c68804729001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:36.128247 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf085a-6bc6-4528-988d-c68804729001 admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:36.128533 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf085a-6bc6-4528-988d-c68804729001 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:36.128810 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf085a-6bc6-4528-988d-c68804729001 admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:36.129566 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bf085a-6bc6-4528-988d-c68804729001 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:36.131721 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bf085a-6bc6-4528-988d-c68804729001 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:36.142752 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1454/2903] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 09:26:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:26:36.147536 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f148ccb2-6145-4258-86b6-e58c004cfa0a admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:36.153934 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:26:36.158583 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f148ccb2-6145-4258-86b6-e58c004cfa0a admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:36.165132 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dc5000-1011-499a-832b-1b3f745afcb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:36.165846 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc5000-1011-499a-832b-1b3f745afcb7 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:36.166214 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc5000-1011-499a-832b-1b3f745afcb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:36.166507 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc5000-1011-499a-832b-1b3f745afcb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:36.167432 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dc5000-1011-499a-832b-1b3f745afcb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:36.169608 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dc5000-1011-499a-832b-1b3f745afcb7 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:36.180940 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1450/2904] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 09:26:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:26:36.185169 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf085a-6bc6-4528-988d-c68804729001 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:36.196004 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf085a-6bc6-4528-988d-c68804729001 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:36.200675 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da6fb5c-e520-413f-95b9-03ba74041821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:36.201561 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6fb5c-e520-413f-95b9-03ba74041821 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:36.201846 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6fb5c-e520-413f-95b9-03ba74041821 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:36.202155 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6fb5c-e520-413f-95b9-03ba74041821 admin admin] PATH_INFO: `/v3/projects/d8e32871935540fd9f64f719685a5a33/users/94f9c6d5e3fd49288b4a4f6469279277/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:36.223813 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da6fb5c-e520-413f-95b9-03ba74041821 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8e32871935540fd9f64f719685a5a33, user_id=94f9c6d5e3fd49288b4a4f6469279277, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:36.227090 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da6fb5c-e520-413f-95b9-03ba74041821 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:36.241292 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1455/2905] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 09:26:36 2022] PUT /identity/v3/projects/d8e32871935540fd9f64f719685a5a33/users/94f9c6d5e3fd49288b4a4f6469279277/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:26:36.254206 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f244baf-366d-4d64-8ed2-7d46bd928574 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:36.254515 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f244baf-366d-4d64-8ed2-7d46bd928574 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:36.254790 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f244baf-366d-4d64-8ed2-7d46bd928574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:36.281845 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-9f244baf-366d-4d64-8ed2-7d46bd928574 None None] MFA Rules not processed for user `94f9c6d5e3fd49288b4a4f6469279277`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:26:36.283013 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-9f244baf-366d-4d64-8ed2-7d46bd928574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:26:36.352281 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1451/2906] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:26:36 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:26:36.384990 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da6fb5c-e520-413f-95b9-03ba74041821 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:36.386790 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-4da6fb5c-e520-413f-95b9-03ba74041821 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:26:36.409250 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:26:36.447288 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da6fb5c-e520-413f-95b9-03ba74041821 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:36.450952 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a111ded4-5a25-4381-8b2e-ebb713cd8fbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:36.451597 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a111ded4-5a25-4381-8b2e-ebb713cd8fbf service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:36.451884 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a111ded4-5a25-4381-8b2e-ebb713cd8fbf service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:36.452161 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a111ded4-5a25-4381-8b2e-ebb713cd8fbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:36.460443 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a111ded4-5a25-4381-8b2e-ebb713cd8fbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:36.461888 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a111ded4-5a25-4381-8b2e-ebb713cd8fbf service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:36.471115 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1456/2907] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:26:36 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:26:36.485423 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f244baf-366d-4d64-8ed2-7d46bd928574 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:36.550242 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f244baf-366d-4d64-8ed2-7d46bd928574 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:36.558686 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b532a1d-b1d9-4863-8762-a871e4357cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:36.558686 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b532a1d-b1d9-4863-8762-a871e4357cc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:36.558686 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b532a1d-b1d9-4863-8762-a871e4357cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:36.558686 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b532a1d-b1d9-4863-8762-a871e4357cc2 admin admin] PATH_INFO: `/v3/users/94f9c6d5e3fd49288b4a4f6469279277` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:36.559174 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b532a1d-b1d9-4863-8762-a871e4357cc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94f9c6d5e3fd49288b4a4f6469279277)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:36.560375 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b532a1d-b1d9-4863-8762-a871e4357cc2 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:36.608616 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-3b532a1d-b1d9-4863-8762-a871e4357cc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94f9c6d5e3fd49288b4a4f6469279277'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:36.616293 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-3b532a1d-b1d9-4863-8762-a871e4357cc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94f9c6d5e3fd49288b4a4f6469279277'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:36.616997 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-3b532a1d-b1d9-4863-8762-a871e4357cc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94f9c6d5e3fd49288b4a4f6469279277'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:36.625113 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-3b532a1d-b1d9-4863-8762-a871e4357cc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94f9c6d5e3fd49288b4a4f6469279277'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:36.625772 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-3b532a1d-b1d9-4863-8762-a871e4357cc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94f9c6d5e3fd49288b4a4f6469279277'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:36.643202 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1452/2908] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 09:26:36 2022] DELETE /identity/v3/users/94f9c6d5e3fd49288b4a4f6469279277 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:26:36.647895 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e9c31-532a-4bbd-aca2-f44723f510ac None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:36.648179 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e9c31-532a-4bbd-aca2-f44723f510ac None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:36.648456 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e9c31-532a-4bbd-aca2-f44723f510ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:36.666321 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-007e9c31-532a-4bbd-aca2-f44723f510ac None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:26:36.667548 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-007e9c31-532a-4bbd-aca2-f44723f510ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:26:36.728226 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1457/2909] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:26:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:26:36.737823 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b532a1d-b1d9-4863-8762-a871e4357cc2 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:36.739283 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-3b532a1d-b1d9-4863-8762-a871e4357cc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:26:36.744662 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:26:36.800424 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b532a1d-b1d9-4863-8762-a871e4357cc2 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:36.804246 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3becb488-5f0f-4da1-a100-8dc1649f9c48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:36.804897 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3becb488-5f0f-4da1-a100-8dc1649f9c48 service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:36.805179 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3becb488-5f0f-4da1-a100-8dc1649f9c48 service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:36.805454 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3becb488-5f0f-4da1-a100-8dc1649f9c48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:36.815731 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3becb488-5f0f-4da1-a100-8dc1649f9c48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:36.817163 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3becb488-5f0f-4da1-a100-8dc1649f9c48 service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:36.827721 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1453/2910] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:26:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:26:37.105219 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e9c31-532a-4bbd-aca2-f44723f510ac None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:37.106736 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-007e9c31-532a-4bbd-aca2-f44723f510ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:26:37.119085 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e9c31-532a-4bbd-aca2-f44723f510ac None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:37.124013 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f86bd4-56f7-40de-b60c-cbb34b1ae187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:37.124884 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f86bd4-56f7-40de-b60c-cbb34b1ae187 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:37.125174 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f86bd4-56f7-40de-b60c-cbb34b1ae187 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:37.125453 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f86bd4-56f7-40de-b60c-cbb34b1ae187 admin admin] PATH_INFO: `/v3/projects/d8e32871935540fd9f64f719685a5a33` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:37.126894 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f86bd4-56f7-40de-b60c-cbb34b1ae187 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8e32871935540fd9f64f719685a5a33)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:37.128656 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f86bd4-56f7-40de-b60c-cbb34b1ae187 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:37.179625 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-68f86bd4-56f7-40de-b60c-cbb34b1ae187 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8e32871935540fd9f64f719685a5a33', 'request_id': 'req-68f86bd4-56f7-40de-b60c-cbb34b1ae187'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:37.185178 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-68f86bd4-56f7-40de-b60c-cbb34b1ae187 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8e32871935540fd9f64f719685a5a33', 'request_id': 'req-68f86bd4-56f7-40de-b60c-cbb34b1ae187'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:37.192143 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-68f86bd4-56f7-40de-b60c-cbb34b1ae187 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8e32871935540fd9f64f719685a5a33', 'request_id': 'req-68f86bd4-56f7-40de-b60c-cbb34b1ae187'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:37.205584 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-68f86bd4-56f7-40de-b60c-cbb34b1ae187 admin admin] The token cache is being invalidate because project d8e32871935540fd9f64f719685a5a33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:26:37.206003 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-68f86bd4-56f7-40de-b60c-cbb34b1ae187 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:37.206773 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-68f86bd4-56f7-40de-b60c-cbb34b1ae187 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:37.208407 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1458/2911] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 09:26:37 2022] DELETE /identity/v3/projects/d8e32871935540fd9f64f719685a5a33 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:26:37.213847 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378cc39-5d8e-4ac3-9c92-358eff8ef443 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:37.214167 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378cc39-5d8e-4ac3-9c92-358eff8ef443 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:37.214451 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378cc39-5d8e-4ac3-9c92-358eff8ef443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:37.233504 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-c378cc39-5d8e-4ac3-9c92-358eff8ef443 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:26:37.234839 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-c378cc39-5d8e-4ac3-9c92-358eff8ef443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:26:37.313016 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1454/2912] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:26:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:26:37.321275 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007695f8-1deb-49ef-8b62-0d46dd2c67fc None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:37.321987 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007695f8-1deb-49ef-8b62-0d46dd2c67fc None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:37.321987 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007695f8-1deb-49ef-8b62-0d46dd2c67fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:37.341336 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-007695f8-1deb-49ef-8b62-0d46dd2c67fc None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:26:37.342499 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-007695f8-1deb-49ef-8b62-0d46dd2c67fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:26:37.351880 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1459/2913] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:26:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:26:37.356268 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378cc39-5d8e-4ac3-9c92-358eff8ef443 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:37.366814 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378cc39-5d8e-4ac3-9c92-358eff8ef443 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:37.373232 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c771da-fbb6-424e-b3e4-16657cd6c601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:37.373906 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c771da-fbb6-424e-b3e4-16657cd6c601 admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:37.374251 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c771da-fbb6-424e-b3e4-16657cd6c601 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:37.374532 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c771da-fbb6-424e-b3e4-16657cd6c601 admin admin] PATH_INFO: `/v3/domains` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:37.375300 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c771da-fbb6-424e-b3e4-16657cd6c601 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:26:37.375609 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c771da-fbb6-424e-b3e4-16657cd6c601 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:37.377476 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c771da-fbb6-424e-b3e4-16657cd6c601 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:37.390203 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1455/2914] 10.222.0.42 () {58 vars in 1152 bytes} [Wed Jun 22 09:26:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:26:37.394559 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007695f8-1deb-49ef-8b62-0d46dd2c67fc None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:37.404544 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007695f8-1deb-49ef-8b62-0d46dd2c67fc None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:37.416653 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd0843f-1bc3-4cde-8bb0-7f2f97e505b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:37.417319 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd0843f-1bc3-4cde-8bb0-7f2f97e505b4 admin admin] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:37.417602 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd0843f-1bc3-4cde-8bb0-7f2f97e505b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:37.417879 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd0843f-1bc3-4cde-8bb0-7f2f97e505b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:37.418628 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd0843f-1bc3-4cde-8bb0-7f2f97e505b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:37.420544 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd0843f-1bc3-4cde-8bb0-7f2f97e505b4 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:37.446813 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1460/2915] 10.222.0.42 () {60 vars in 1152 bytes} [Wed Jun 22 09:26:37 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:26:37.451002 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c771da-fbb6-424e-b3e4-16657cd6c601 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:37.461864 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c771da-fbb6-424e-b3e4-16657cd6c601 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:37.519147 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df49633-6460-4706-b814-6ceef47d7cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:37.519813 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df49633-6460-4706-b814-6ceef47d7cb9 admin admin] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:37.520093 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df49633-6460-4706-b814-6ceef47d7cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:37.520367 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df49633-6460-4706-b814-6ceef47d7cb9 admin admin] PATH_INFO: `/v3/users` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:37.521061 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df49633-6460-4706-b814-6ceef47d7cb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:37.523019 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df49633-6460-4706-b814-6ceef47d7cb9 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:37.543962 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1456/2916] 10.222.0.42 () {60 vars in 1143 bytes} [Wed Jun 22 09:26:37 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:26:37.548044 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd0843f-1bc3-4cde-8bb0-7f2f97e505b4 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:37.559036 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd0843f-1bc3-4cde-8bb0-7f2f97e505b4 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:37.563739 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd67e9cd-3227-467f-8989-8e2034e4053d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:37.564411 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd67e9cd-3227-467f-8989-8e2034e4053d admin admin] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:37.564681 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd67e9cd-3227-467f-8989-8e2034e4053d admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:37.564986 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd67e9cd-3227-467f-8989-8e2034e4053d admin admin] PATH_INFO: `/v3/roles` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:37.565714 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd67e9cd-3227-467f-8989-8e2034e4053d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:37.567351 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd67e9cd-3227-467f-8989-8e2034e4053d admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:37.578288 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1461/2917] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 09:26:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:26:37.582401 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df49633-6460-4706-b814-6ceef47d7cb9 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:37.593332 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df49633-6460-4706-b814-6ceef47d7cb9 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:37.598031 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c462ce-2ba4-4e08-ac94-8da75f1701be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:37.598725 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c462ce-2ba4-4e08-ac94-8da75f1701be admin admin] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:37.599014 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c462ce-2ba4-4e08-ac94-8da75f1701be admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:37.599293 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c462ce-2ba4-4e08-ac94-8da75f1701be admin admin] PATH_INFO: `/v3/roles` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:37.600054 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c462ce-2ba4-4e08-ac94-8da75f1701be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:37.601640 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c462ce-2ba4-4e08-ac94-8da75f1701be admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:37.612008 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1457/2918] 10.222.0.42 () {58 vars in 1121 bytes} [Wed Jun 22 09:26:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:26:37.616130 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd67e9cd-3227-467f-8989-8e2034e4053d admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:37.626519 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd67e9cd-3227-467f-8989-8e2034e4053d admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:37.631653 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf12d8-0073-41c7-b157-f545196fe622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:37.632532 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf12d8-0073-41c7-b157-f545196fe622 admin admin] REQUEST_METHOD: `PUT` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:37.632811 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf12d8-0073-41c7-b157-f545196fe622 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:37.633082 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf12d8-0073-41c7-b157-f545196fe622 admin admin] PATH_INFO: `/v3/projects/3b8b12f8589648caaec4b98bf1bb1be4/users/d22b75223f554804af40be829d3a48ae/roles/5ea101070f734fa59995615179f2eff2` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:37.635428 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:26:37.651394 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cf12d8-0073-41c7-b157-f545196fe622 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b8b12f8589648caaec4b98bf1bb1be4, user_id=d22b75223f554804af40be829d3a48ae, role_id=5ea101070f734fa59995615179f2eff2)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:37.654054 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cf12d8-0073-41c7-b157-f545196fe622 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:37.667938 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1462/2919] 10.222.0.42 () {60 vars in 1482 bytes} [Wed Jun 22 09:26:37 2022] PUT /identity/v3/projects/3b8b12f8589648caaec4b98bf1bb1be4/users/d22b75223f554804af40be829d3a48ae/roles/5ea101070f734fa59995615179f2eff2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:26:37.678806 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f359e-a343-4846-bbf0-88a859b7a857 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:37.679096 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f359e-a343-4846-bbf0-88a859b7a857 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:37.679373 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f359e-a343-4846-bbf0-88a859b7a857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:37.699660 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:26:37.708517 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-d36f359e-a343-4846-bbf0-88a859b7a857 None None] MFA Rules not processed for user `d22b75223f554804af40be829d3a48ae`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:26:37.710372 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-d36f359e-a343-4846-bbf0-88a859b7a857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:26:37.779263 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1458/2920] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:26:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:26:37.790503 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf12d8-0073-41c7-b157-f545196fe622 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:37.792219 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-64cf12d8-0073-41c7-b157-f545196fe622 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:26:37.853479 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf12d8-0073-41c7-b157-f545196fe622 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:37.857159 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f132d5f-4dd7-4525-a6c3-42af1fbbff94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a2701c65144851ad87ac77fccb686f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:37.857809 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f132d5f-4dd7-4525-a6c3-42af1fbbff94 service cinder] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:37.858115 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f132d5f-4dd7-4525-a6c3-42af1fbbff94 service cinder] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:37.858398 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f132d5f-4dd7-4525-a6c3-42af1fbbff94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:37.867619 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f132d5f-4dd7-4525-a6c3-42af1fbbff94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:37.869095 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f132d5f-4dd7-4525-a6c3-42af1fbbff94 service cinder] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:37.879993 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1463/2921] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:26:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:26:39.237559 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c5600-d239-419f-80aa-d3ee64b55513 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:39.238120 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c5600-d239-419f-80aa-d3ee64b55513 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:39.238215 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c5600-d239-419f-80aa-d3ee64b55513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:39.257713 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-b16c5600-d239-419f-80aa-d3ee64b55513 None None] MFA Rules not processed for user `d22b75223f554804af40be829d3a48ae`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:26:39.259267 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-b16c5600-d239-419f-80aa-d3ee64b55513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:26:39.266333 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1459/2922] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:26:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:26:47.878568 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=33,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:26:49.251586 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=30 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:26:52.964733 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96c97c-ddc9-47bd-b249-59e5c031e6e6 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:52.965179 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96c97c-ddc9-47bd-b249-59e5c031e6e6 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:52.965404 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96c97c-ddc9-47bd-b249-59e5c031e6e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:52.984099 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-ec96c97c-ddc9-47bd-b249-59e5c031e6e6 None None] MFA Rules not processed for user `2bf91272d78b4e8f854c760622465af9`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:26:52.985318 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-ec96c97c-ddc9-47bd-b249-59e5c031e6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:26:53.047651 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1464/2923] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Jun 22 09:26:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:26:53.102340 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c5600-d239-419f-80aa-d3ee64b55513 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:53.103819 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-b16c5600-d239-419f-80aa-d3ee64b55513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:26:53.178021 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c5600-d239-419f-80aa-d3ee64b55513 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:53.183058 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04efaf86-17ea-4eb1-b828-3c9667a86fe4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4403cea84ff646b88cdb785975b20346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:53.183709 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04efaf86-17ea-4eb1-b828-3c9667a86fe4 service swift] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:53.183996 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04efaf86-17ea-4eb1-b828-3c9667a86fe4 service swift] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:53.184278 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04efaf86-17ea-4eb1-b828-3c9667a86fe4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:53.193297 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04efaf86-17ea-4eb1-b828-3c9667a86fe4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:53.194953 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04efaf86-17ea-4eb1-b828-3c9667a86fe4 service swift] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:53.203364 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1460/2924] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Jun 22 09:26:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 22 09:26:53.745744 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46494b-ef15-471a-96ee-11ff1ff40b0f None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:53.746034 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46494b-ef15-471a-96ee-11ff1ff40b0f None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:53.746348 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46494b-ef15-471a-96ee-11ff1ff40b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:53.768245 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-bd46494b-ef15-471a-96ee-11ff1ff40b0f None None] MFA Rules not processed for user `2bf91272d78b4e8f854c760622465af9`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:26:53.769476 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-bd46494b-ef15-471a-96ee-11ff1ff40b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:26:53.777625 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1465/2925] 10.222.0.42 () {58 vars in 967 bytes} [Wed Jun 22 09:26:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:26:53.791818 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04efaf86-17ea-4eb1-b828-3c9667a86fe4 service swift] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:53.803941 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04efaf86-17ea-4eb1-b828-3c9667a86fe4 service swift] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:53.809964 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa8b4f6-c56d-46de-a3aa-17d0f5296546 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4403cea84ff646b88cdb785975b20346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:53.810656 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8b4f6-c56d-46de-a3aa-17d0f5296546 service swift] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:53.811000 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8b4f6-c56d-46de-a3aa-17d0f5296546 service swift] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:53.811279 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8b4f6-c56d-46de-a3aa-17d0f5296546 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:53.821109 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa8b4f6-c56d-46de-a3aa-17d0f5296546 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:53.822767 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa8b4f6-c56d-46de-a3aa-17d0f5296546 service swift] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:53.831565 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1461/2926] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Jun 22 09:26:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 09:26:54.057634 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35804dcf-bcf8-4128-be66-c9587fea40f1 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:54.058145 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35804dcf-bcf8-4128-be66-c9587fea40f1 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:54.058262 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35804dcf-bcf8-4128-be66-c9587fea40f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:54.083959 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-35804dcf-bcf8-4128-be66-c9587fea40f1 None None] MFA Rules not processed for user `2bf91272d78b4e8f854c760622465af9`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:26:54.085210 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-35804dcf-bcf8-4128-be66-c9587fea40f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:26:54.095268 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1466/2927] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Jun 22 09:26:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:26:54.108272 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa8b4f6-c56d-46de-a3aa-17d0f5296546 service swift] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:54.119568 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa8b4f6-c56d-46de-a3aa-17d0f5296546 service swift] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:54.125315 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c772222-0de9-46c8-8eb7-34b0b5357940 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4403cea84ff646b88cdb785975b20346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:54.125958 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c772222-0de9-46c8-8eb7-34b0b5357940 service swift] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:54.126365 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c772222-0de9-46c8-8eb7-34b0b5357940 service swift] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:54.126646 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c772222-0de9-46c8-8eb7-34b0b5357940 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:54.136409 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c772222-0de9-46c8-8eb7-34b0b5357940 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:54.138020 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c772222-0de9-46c8-8eb7-34b0b5357940 service swift] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:54.147766 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1462/2928] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Jun 22 09:26:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 09:26:54.492961 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f6ef3a-6da2-4565-aa2c-b53f4777b192 None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:54.493251 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f6ef3a-6da2-4565-aa2c-b53f4777b192 None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:54.493528 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f6ef3a-6da2-4565-aa2c-b53f4777b192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:54.512515 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-69f6ef3a-6da2-4565-aa2c-b53f4777b192 None None] MFA Rules not processed for user `2bf91272d78b4e8f854c760622465af9`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:26:54.513738 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-69f6ef3a-6da2-4565-aa2c-b53f4777b192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:26:54.521835 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1467/2929] 10.222.0.42 () {58 vars in 967 bytes} [Wed Jun 22 09:26:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:26:54.534107 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c772222-0de9-46c8-8eb7-34b0b5357940 service swift] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:54.545810 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c772222-0de9-46c8-8eb7-34b0b5357940 service swift] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:54.550927 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7fd8d5-d61c-400f-bbb0-78c3f096d52b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4403cea84ff646b88cdb785975b20346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:54.551572 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7fd8d5-d61c-400f-bbb0-78c3f096d52b service swift] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:54.551870 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7fd8d5-d61c-400f-bbb0-78c3f096d52b service swift] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:54.552200 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7fd8d5-d61c-400f-bbb0-78c3f096d52b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:54.560836 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7fd8d5-d61c-400f-bbb0-78c3f096d52b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:54.562456 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7fd8d5-d61c-400f-bbb0-78c3f096d52b service swift] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:54.573535 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1463/2930] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Jun 22 09:26:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 09:26:56.670135 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f6ef3a-6da2-4565-aa2c-b53f4777b192 None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:56.735101 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f6ef3a-6da2-4565-aa2c-b53f4777b192 None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:56.739622 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c5ba9-cca5-4390-8560-f8176338edce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:56.740492 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c5ba9-cca5-4390-8560-f8176338edce admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:56.740775 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c5ba9-cca5-4390-8560-f8176338edce admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:56.741058 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c5ba9-cca5-4390-8560-f8176338edce admin admin] PATH_INFO: `/v3/users/d22b75223f554804af40be829d3a48ae` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:56.742290 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468c5ba9-cca5-4390-8560-f8176338edce admin admin] RBAC: Authorizing `identity:delete_user(user_id=d22b75223f554804af40be829d3a48ae)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:56.744225 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468c5ba9-cca5-4390-8560-f8176338edce admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:56.793416 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-468c5ba9-cca5-4390-8560-f8176338edce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd22b75223f554804af40be829d3a48ae'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:56.800953 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-468c5ba9-cca5-4390-8560-f8176338edce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd22b75223f554804af40be829d3a48ae'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:56.801665 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-468c5ba9-cca5-4390-8560-f8176338edce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd22b75223f554804af40be829d3a48ae'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:56.810885 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-468c5ba9-cca5-4390-8560-f8176338edce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd22b75223f554804af40be829d3a48ae'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:56.816336 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-468c5ba9-cca5-4390-8560-f8176338edce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd22b75223f554804af40be829d3a48ae'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:56.835609 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1468/2931] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 09:26:56 2022] DELETE /identity/v3/users/d22b75223f554804af40be829d3a48ae => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:26:56.840173 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a3e4c-6c1a-4e4e-96c8-e7b27aad3634 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:56.840651 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a3e4c-6c1a-4e4e-96c8-e7b27aad3634 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:56.840744 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a3e4c-6c1a-4e4e-96c8-e7b27aad3634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:56.858778 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-bc2a3e4c-6c1a-4e4e-96c8-e7b27aad3634 None None] MFA Rules not processed for user `6ca353121b49417da331c92ca4f0c767`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:26:56.859994 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-bc2a3e4c-6c1a-4e4e-96c8-e7b27aad3634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:26:56.919268 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1464/2932] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:26:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:26:56.929550 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c5ba9-cca5-4390-8560-f8176338edce admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:56.931059 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-468c5ba9-cca5-4390-8560-f8176338edce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:26:56.937633 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:26:56.998433 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c5ba9-cca5-4390-8560-f8176338edce admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:57.002146 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bedf66f-3b86-4d3b-92a1-c03ce948dd06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:57.002805 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bedf66f-3b86-4d3b-92a1-c03ce948dd06 service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:57.003102 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bedf66f-3b86-4d3b-92a1-c03ce948dd06 service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:57.003377 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bedf66f-3b86-4d3b-92a1-c03ce948dd06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:57.013273 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bedf66f-3b86-4d3b-92a1-c03ce948dd06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:57.014760 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bedf66f-3b86-4d3b-92a1-c03ce948dd06 service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:57.025213 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1469/2933] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:26:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:26:57.205975 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a3e4c-6c1a-4e4e-96c8-e7b27aad3634 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:26:57.207464 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-bc2a3e4c-6c1a-4e4e-96c8-e7b27aad3634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:26:57.219885 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a3e4c-6c1a-4e4e-96c8-e7b27aad3634 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:26:57.225813 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a67e2d-e3db-44a6-b914-0d3103736385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:26:57.226710 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a67e2d-e3db-44a6-b914-0d3103736385 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:26:57.226995 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a67e2d-e3db-44a6-b914-0d3103736385 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:26:57.227276 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a67e2d-e3db-44a6-b914-0d3103736385 admin admin] PATH_INFO: `/v3/projects/3b8b12f8589648caaec4b98bf1bb1be4` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:26:57.228505 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a67e2d-e3db-44a6-b914-0d3103736385 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b8b12f8589648caaec4b98bf1bb1be4)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:26:57.230665 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a67e2d-e3db-44a6-b914-0d3103736385 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:26:57.278314 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:26:57.281448 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-f8a67e2d-e3db-44a6-b914-0d3103736385 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b8b12f8589648caaec4b98bf1bb1be4', 'request_id': 'req-f8a67e2d-e3db-44a6-b914-0d3103736385'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:57.288465 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-f8a67e2d-e3db-44a6-b914-0d3103736385 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b8b12f8589648caaec4b98bf1bb1be4', 'request_id': 'req-f8a67e2d-e3db-44a6-b914-0d3103736385'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:57.295215 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-f8a67e2d-e3db-44a6-b914-0d3103736385 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b8b12f8589648caaec4b98bf1bb1be4', 'request_id': 'req-f8a67e2d-e3db-44a6-b914-0d3103736385'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:57.308692 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-f8a67e2d-e3db-44a6-b914-0d3103736385 admin admin] The token cache is being invalidate because project 3b8b12f8589648caaec4b98bf1bb1be4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:26:57.308984 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-f8a67e2d-e3db-44a6-b914-0d3103736385 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:57.313642 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-f8a67e2d-e3db-44a6-b914-0d3103736385 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:26:57.315334 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1465/2934] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 09:26:57 2022] DELETE /identity/v3/projects/3b8b12f8589648caaec4b98bf1bb1be4 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:27:07.020934 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=24 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:27:07.305145 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:DELETE=4,keystone:SELECT=7,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:28:03.041531 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bedf66f-3b86-4d3b-92a1-c03ce948dd06 service neutron] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:28:03.042973 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-7bedf66f-3b86-4d3b-92a1-c03ce948dd06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:28:03.110598 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bedf66f-3b86-4d3b-92a1-c03ce948dd06 service neutron] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:28:03.168746 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c130392-43d5-47e6-9ac5-4080c772bb4f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec2627e3cdc94ec38d7cc3b1bc670ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:28:03.169394 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c130392-43d5-47e6-9ac5-4080c772bb4f service placement] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:28:03.169683 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c130392-43d5-47e6-9ac5-4080c772bb4f service placement] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:28:03.169965 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c130392-43d5-47e6-9ac5-4080c772bb4f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:28:03.171799 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-5c130392-43d5-47e6-9ac5-4080c772bb4f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:28:03.182901 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c130392-43d5-47e6-9ac5-4080c772bb4f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:28:03.184479 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c130392-43d5-47e6-9ac5-4080c772bb4f service placement] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:28:03.194367 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1470/2935] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:28:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:28:07.121622 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a67e2d-e3db-44a6-b914-0d3103736385 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:28:07.123608 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-f8a67e2d-e3db-44a6-b914-0d3103736385 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:28:07.229336 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a67e2d-e3db-44a6-b914-0d3103736385 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:28:07.236302 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878bc24c-6d44-490e-b272-b42ac1ba862f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f1809a35b244c1db7a185d82859369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:28:07.237402 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878bc24c-6d44-490e-b272-b42ac1ba862f service nova] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:28:07.237936 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878bc24c-6d44-490e-b272-b42ac1ba862f service nova] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:28:07.238311 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878bc24c-6d44-490e-b272-b42ac1ba862f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:28:07.240225 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-878bc24c-6d44-490e-b272-b42ac1ba862f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:28:07.259411 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878bc24c-6d44-490e-b272-b42ac1ba862f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:28:07.262296 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878bc24c-6d44-490e-b272-b42ac1ba862f service nova] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:28:07.276058 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1466/2936] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:28:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:28:08.011521 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba94ca-507b-4e02-866e-770eba9a8faf None None] REQUEST_METHOD: `POST` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:28:08.012016 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba94ca-507b-4e02-866e-770eba9a8faf None None] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:28:08.012113 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba94ca-507b-4e02-866e-770eba9a8faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:28:08.030202 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.auth.core [None req-8dba94ca-507b-4e02-866e-770eba9a8faf None None] MFA Rules not processed for user `b49bd088bb264263a6735365e880611b`. Rule list: `[]` (Enabled: `True`). {{(pid=86702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:28:08.031424 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-8dba94ca-507b-4e02-866e-770eba9a8faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:28:08.092277 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1471/2937] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:28:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:28:09.840293 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878bc24c-6d44-490e-b272-b42ac1ba862f service nova] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:28:09.841777 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-878bc24c-6d44-490e-b272-b42ac1ba862f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:28:09.855637 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878bc24c-6d44-490e-b272-b42ac1ba862f service nova] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:28:09.860536 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e35e14-eeca-4d67-8eca-17661815e597 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec2627e3cdc94ec38d7cc3b1bc670ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:28:09.861163 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e35e14-eeca-4d67-8eca-17661815e597 service placement] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:28:09.861444 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e35e14-eeca-4d67-8eca-17661815e597 service placement] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:28:09.861720 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e35e14-eeca-4d67-8eca-17661815e597 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:28:09.863430 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-46e35e14-eeca-4d67-8eca-17661815e597 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:28:09.875127 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e35e14-eeca-4d67-8eca-17661815e597 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:28:09.876671 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e35e14-eeca-4d67-8eca-17661815e597 service placement] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:28:09.888367 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1467/2938] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:28:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:28:18.083837 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=83 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:28:19.882985 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=40 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:28:25.788623 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba94ca-507b-4e02-866e-770eba9a8faf None None] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:28:25.803379 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba94ca-507b-4e02-866e-770eba9a8faf None None] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:28:25.808911 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd1e876-a085-41cd-a73a-0fa24480a1f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f1809a35b244c1db7a185d82859369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:28:25.809568 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1e876-a085-41cd-a73a-0fa24480a1f8 service nova] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:28:25.809858 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1e876-a085-41cd-a73a-0fa24480a1f8 service nova] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:28:25.810169 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1e876-a085-41cd-a73a-0fa24480a1f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:28:25.812020 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-4bd1e876-a085-41cd-a73a-0fa24480a1f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:28:25.825196 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd1e876-a085-41cd-a73a-0fa24480a1f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:28:25.827456 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd1e876-a085-41cd-a73a-0fa24480a1f8 service nova] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:28:25.841084 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1472/2939] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:28:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:28:35.836006 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=6 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:30:05.581354 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88aabc9-b4bb-4ca5-9455-7daea817db41 None None] REQUEST_METHOD: `POST` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:30:05.581871 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88aabc9-b4bb-4ca5-9455-7daea817db41 None None] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:30:05.582062 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88aabc9-b4bb-4ca5-9455-7daea817db41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:30:05.600309 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.auth.core [None req-c88aabc9-b4bb-4ca5-9455-7daea817db41 None None] MFA Rules not processed for user `b49bd088bb264263a6735365e880611b`. Rule list: `[]` (Enabled: `True`). {{(pid=86701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:30:05.601507 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-c88aabc9-b4bb-4ca5-9455-7daea817db41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:30:05.608328 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1468/2940] 10.222.0.42 () {58 vars in 957 bytes} [Wed Jun 22 09:30:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:30:05.922239 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd1e876-a085-41cd-a73a-0fa24480a1f8 service nova] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:30:05.923683 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-4bd1e876-a085-41cd-a73a-0fa24480a1f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:30:05.979975 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd1e876-a085-41cd-a73a-0fa24480a1f8 service nova] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:30:05.983520 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b32cac-5b9a-4a7b-b97a-7b8a3fe826cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:30:05.984211 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b32cac-5b9a-4a7b-b97a-7b8a3fe826cc service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:30:05.984435 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b32cac-5b9a-4a7b-b97a-7b8a3fe826cc service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:30:05.984708 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b32cac-5b9a-4a7b-b97a-7b8a3fe826cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:30:05.986480 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-e2b32cac-5b9a-4a7b-b97a-7b8a3fe826cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:30:05.996514 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b32cac-5b9a-4a7b-b97a-7b8a3fe826cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:30:05.997923 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b32cac-5b9a-4a7b-b97a-7b8a3fe826cc service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:30:06.006541 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1473/2941] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:30:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:30:15.595581 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=3 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:30:16.002242 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=26 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:30:24.717120 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88aabc9-b4bb-4ca5-9455-7daea817db41 None None] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:30:24.718695 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-c88aabc9-b4bb-4ca5-9455-7daea817db41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:30:24.767182 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88aabc9-b4bb-4ca5-9455-7daea817db41 None None] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:30:24.772648 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c99da-0797-4473-a568-47cce6e55874 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f1809a35b244c1db7a185d82859369e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:30:24.773293 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c99da-0797-4473-a568-47cce6e55874 service nova] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:30:24.773576 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c99da-0797-4473-a568-47cce6e55874 service nova] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:30:24.773850 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c99da-0797-4473-a568-47cce6e55874 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:30:24.775680 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-6a7c99da-0797-4473-a568-47cce6e55874 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:30:24.788944 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7c99da-0797-4473-a568-47cce6e55874 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:30:24.791016 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7c99da-0797-4473-a568-47cce6e55874 service nova] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:30:24.804925 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1469/2942] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:30:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:30:34.798464 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=18 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:31:03.115467 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b32cac-5b9a-4a7b-b97a-7b8a3fe826cc service neutron] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:31:03.117216 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-e2b32cac-5b9a-4a7b-b97a-7b8a3fe826cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:31:03.127761 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b32cac-5b9a-4a7b-b97a-7b8a3fe826cc service neutron] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:31:03.131337 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9d52c6-9900-402a-831d-b2bfa08d146c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:31:03.131976 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d52c6-9900-402a-831d-b2bfa08d146c service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:31:03.132258 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d52c6-9900-402a-831d-b2bfa08d146c service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:31:03.132533 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d52c6-9900-402a-831d-b2bfa08d146c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:31:03.134282 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-ca9d52c6-9900-402a-831d-b2bfa08d146c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:31:03.144073 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9d52c6-9900-402a-831d-b2bfa08d146c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:31:03.145509 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9d52c6-9900-402a-831d-b2bfa08d146c service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:31:03.154511 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1474/2943] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:31:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:31:13.150751 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=6 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:31:52.458633 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c99da-0797-4473-a568-47cce6e55874 service nova] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:31:52.468640 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c99da-0797-4473-a568-47cce6e55874 service nova] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:31:52.473902 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77fdc00-c5bc-42ca-9b93-816de283b810 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:31:52.475179 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77fdc00-c5bc-42ca-9b93-816de283b810 service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:31:52.475179 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77fdc00-c5bc-42ca-9b93-816de283b810 service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:31:52.475179 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77fdc00-c5bc-42ca-9b93-816de283b810 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:31:52.476932 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-f77fdc00-c5bc-42ca-9b93-816de283b810 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:31:52.488359 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77fdc00-c5bc-42ca-9b93-816de283b810 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:31:52.489774 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77fdc00-c5bc-42ca-9b93-816de283b810 service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:31:52.499479 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1470/2944] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:31:52 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:31:53.734636 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9d52c6-9900-402a-831d-b2bfa08d146c service neutron] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:31:53.745169 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9d52c6-9900-402a-831d-b2bfa08d146c service neutron] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:31:53.750635 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8726aee0-f31f-4198-96a0-a756891cef20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:31:53.751667 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726aee0-f31f-4198-96a0-a756891cef20 service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:31:53.752436 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726aee0-f31f-4198-96a0-a756891cef20 service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:31:53.752436 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726aee0-f31f-4198-96a0-a756891cef20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:31:53.754684 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-8726aee0-f31f-4198-96a0-a756891cef20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:31:53.769709 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8726aee0-f31f-4198-96a0-a756891cef20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:31:53.771316 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8726aee0-f31f-4198-96a0-a756891cef20 service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:31:53.783836 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1475/2945] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:31:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:31:54.962926 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77fdc00-c5bc-42ca-9b93-816de283b810 service neutron] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:31:54.972121 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77fdc00-c5bc-42ca-9b93-816de283b810 service neutron] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:31:54.975797 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4af00f-bdc4-4859-8bfe-9ee6c53d14fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:31:54.976430 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4af00f-bdc4-4859-8bfe-9ee6c53d14fd service neutron] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:31:54.976721 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4af00f-bdc4-4859-8bfe-9ee6c53d14fd service neutron] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:31:54.977003 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4af00f-bdc4-4859-8bfe-9ee6c53d14fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:31:54.978786 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-6a4af00f-bdc4-4859-8bfe-9ee6c53d14fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:31:54.992944 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4af00f-bdc4-4859-8bfe-9ee6c53d14fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:31:54.994389 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4af00f-bdc4-4859-8bfe-9ee6c53d14fd service neutron] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:31:55.005330 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1471/2946] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:31:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:32:03.777814 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=6 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:32:05.000474 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=12 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:32:05.879527 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8726aee0-f31f-4198-96a0-a756891cef20 service neutron] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:32:05.888255 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8726aee0-f31f-4198-96a0-a756891cef20 service neutron] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:32:05.892013 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6597ca2f-2117-410c-a529-39ac55d19080 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751f037ff70d4eb8acb4e8d4c5c487ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:32:05.892770 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597ca2f-2117-410c-a529-39ac55d19080 service neutron] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:32:05.892919 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597ca2f-2117-410c-a529-39ac55d19080 service neutron] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:32:05.893189 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597ca2f-2117-410c-a529-39ac55d19080 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:32:05.895126 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-6597ca2f-2117-410c-a529-39ac55d19080 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:32:05.979857 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6597ca2f-2117-410c-a529-39ac55d19080 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:32:05.981312 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6597ca2f-2117-410c-a529-39ac55d19080 service neutron] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:32:06.003367 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1476/2947] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:32:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:32:09.106434 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4af00f-bdc4-4859-8bfe-9ee6c53d14fd service neutron] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:32:09.136456 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4af00f-bdc4-4859-8bfe-9ee6c53d14fd service neutron] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:32:09.143160 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0764347-8341-4292-ad1d-3f94456bc929 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec2627e3cdc94ec38d7cc3b1bc670ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:32:09.144150 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0764347-8341-4292-ad1d-3f94456bc929 service placement] REQUEST_METHOD: `GET` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:32:09.145007 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0764347-8341-4292-ad1d-3f94456bc929 service placement] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:32:09.145637 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0764347-8341-4292-ad1d-3f94456bc929 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:32:09.150402 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-f0764347-8341-4292-ad1d-3f94456bc929 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:32:09.192068 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0764347-8341-4292-ad1d-3f94456bc929 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:32:09.194233 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0764347-8341-4292-ad1d-3f94456bc929 service placement] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:32:09.209826 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1472/2948] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:32:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:32:12.115466 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6597ca2f-2117-410c-a529-39ac55d19080 service neutron] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:32:12.117522 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-6597ca2f-2117-410c-a529-39ac55d19080 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:32:12.142048 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6597ca2f-2117-410c-a529-39ac55d19080 service neutron] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:32:12.147142 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715778ca-14a9-43e7-888a-e8d45a01ff61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:32:12.147995 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715778ca-14a9-43e7-888a-e8d45a01ff61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:32:12.148280 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715778ca-14a9-43e7-888a-e8d45a01ff61 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:32:12.148555 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715778ca-14a9-43e7-888a-e8d45a01ff61 admin admin] PATH_INFO: `/v3/users/b49bd088bb264263a6735365e880611b` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:32:12.149796 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715778ca-14a9-43e7-888a-e8d45a01ff61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b49bd088bb264263a6735365e880611b)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:32:12.152029 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715778ca-14a9-43e7-888a-e8d45a01ff61 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:32:12.202272 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-715778ca-14a9-43e7-888a-e8d45a01ff61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b49bd088bb264263a6735365e880611b'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:32:12.209471 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-715778ca-14a9-43e7-888a-e8d45a01ff61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b49bd088bb264263a6735365e880611b'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:32:12.210187 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-715778ca-14a9-43e7-888a-e8d45a01ff61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b49bd088bb264263a6735365e880611b'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:32:12.217207 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-715778ca-14a9-43e7-888a-e8d45a01ff61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b49bd088bb264263a6735365e880611b'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:32:12.217819 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-715778ca-14a9-43e7-888a-e8d45a01ff61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b49bd088bb264263a6735365e880611b'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:32:12.234706 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1477/2949] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 09:32:12 2022] DELETE /identity/v3/users/b49bd088bb264263a6735365e880611b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:32:12.412464 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0764347-8341-4292-ad1d-3f94456bc929 service placement] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:32:12.423838 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0764347-8341-4292-ad1d-3f94456bc929 service placement] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:32:12.485350 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c751d6-24f2-4b61-a6e6-f4792eb970e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:32:12.486257 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c751d6-24f2-4b61-a6e6-f4792eb970e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:32:12.486544 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c751d6-24f2-4b61-a6e6-f4792eb970e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:32:12.486821 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c751d6-24f2-4b61-a6e6-f4792eb970e1 admin admin] PATH_INFO: `/v3/projects/45a2a5a4107140a9a17ddf196a1f2b95` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:32:12.488022 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c751d6-24f2-4b61-a6e6-f4792eb970e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45a2a5a4107140a9a17ddf196a1f2b95)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:32:12.489916 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c751d6-24f2-4b61-a6e6-f4792eb970e1 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:32:12.535042 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-03c751d6-24f2-4b61-a6e6-f4792eb970e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45a2a5a4107140a9a17ddf196a1f2b95', 'request_id': 'req-03c751d6-24f2-4b61-a6e6-f4792eb970e1'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:32:12.540555 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-03c751d6-24f2-4b61-a6e6-f4792eb970e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45a2a5a4107140a9a17ddf196a1f2b95', 'request_id': 'req-03c751d6-24f2-4b61-a6e6-f4792eb970e1'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:32:12.547161 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-03c751d6-24f2-4b61-a6e6-f4792eb970e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45a2a5a4107140a9a17ddf196a1f2b95', 'request_id': 'req-03c751d6-24f2-4b61-a6e6-f4792eb970e1'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:32:12.559050 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-03c751d6-24f2-4b61-a6e6-f4792eb970e1 admin admin] The token cache is being invalidate because project 45a2a5a4107140a9a17ddf196a1f2b95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:32:12.559344 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-03c751d6-24f2-4b61-a6e6-f4792eb970e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:32:12.559989 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-03c751d6-24f2-4b61-a6e6-f4792eb970e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:32:12.562179 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1473/2950] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 09:32:12 2022] DELETE /identity/v3/projects/45a2a5a4107140a9a17ddf196a1f2b95 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:32:12.566262 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715778ca-14a9-43e7-888a-e8d45a01ff61 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:32:12.567644 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-715778ca-14a9-43e7-888a-e8d45a01ff61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:32:12.584784 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715778ca-14a9-43e7-888a-e8d45a01ff61 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:32:12.622268 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:32:12.647239 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2690533-d05a-466b-8f20-77c877691b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:32:12.648106 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2690533-d05a-466b-8f20-77c877691b62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:32:12.648388 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2690533-d05a-466b-8f20-77c877691b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:32:12.648661 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2690533-d05a-466b-8f20-77c877691b62 admin admin] PATH_INFO: `/v3/users/694c70cdbbe84ce08be58bb2474b0b18` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:32:12.649836 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2690533-d05a-466b-8f20-77c877691b62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=694c70cdbbe84ce08be58bb2474b0b18)` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:32:12.651810 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2690533-d05a-466b-8f20-77c877691b62 admin admin] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:32:12.697381 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-f2690533-d05a-466b-8f20-77c877691b62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '694c70cdbbe84ce08be58bb2474b0b18'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:32:12.704179 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-f2690533-d05a-466b-8f20-77c877691b62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '694c70cdbbe84ce08be58bb2474b0b18'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:32:12.704834 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-f2690533-d05a-466b-8f20-77c877691b62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '694c70cdbbe84ce08be58bb2474b0b18'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:32:12.712234 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-f2690533-d05a-466b-8f20-77c877691b62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '694c70cdbbe84ce08be58bb2474b0b18'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:32:12.712868 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.notifications [None req-f2690533-d05a-466b-8f20-77c877691b62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '694c70cdbbe84ce08be58bb2474b0b18'} {{(pid=86702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:32:12.730336 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1478/2951] 10.222.0.42 () {58 vars in 1223 bytes} [Wed Jun 22 09:32:12 2022] DELETE /identity/v3/users/694c70cdbbe84ce08be58bb2474b0b18 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:32:12.898384 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c751d6-24f2-4b61-a6e6-f4792eb970e1 admin admin] Authenticating user token {{(pid=86701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:32:12.900510 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.fernet_utils [None req-03c751d6-24f2-4b61-a6e6-f4792eb970e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:32:12.914650 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c751d6-24f2-4b61-a6e6-f4792eb970e1 admin admin] Validating token access rules against request {{(pid=86701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:32:12.972265 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd612698-a602-454a-bbbc-80de19090718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca353121b49417da331c92ca4f0c767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '272f01980f584e4888194eeac35f8209', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:32:12.973050 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd612698-a602-454a-bbbc-80de19090718 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:32:12.973331 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd612698-a602-454a-bbbc-80de19090718 admin admin] SCRIPT_NAME: `/identity` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:32:12.973609 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd612698-a602-454a-bbbc-80de19090718 admin admin] PATH_INFO: `/v3/projects/c0a6002afad64f37b55d524e7a2c91ab` {{(pid=86701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:32:12.974825 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd612698-a602-454a-bbbc-80de19090718 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0a6002afad64f37b55d524e7a2c91ab)` {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:32:12.976732 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd612698-a602-454a-bbbc-80de19090718 admin admin] RBAC: Authorization granted {{(pid=86701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:32:12.984536 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:32:13.023781 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-dd612698-a602-454a-bbbc-80de19090718 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0a6002afad64f37b55d524e7a2c91ab', 'request_id': 'req-dd612698-a602-454a-bbbc-80de19090718'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:32:13.029229 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-dd612698-a602-454a-bbbc-80de19090718 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0a6002afad64f37b55d524e7a2c91ab', 'request_id': 'req-dd612698-a602-454a-bbbc-80de19090718'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:32:13.035248 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-dd612698-a602-454a-bbbc-80de19090718 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0a6002afad64f37b55d524e7a2c91ab', 'request_id': 'req-dd612698-a602-454a-bbbc-80de19090718'} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:32:13.047211 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-dd612698-a602-454a-bbbc-80de19090718 admin admin] The token cache is being invalidate because project c0a6002afad64f37b55d524e7a2c91ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:32:13.047500 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-dd612698-a602-454a-bbbc-80de19090718 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:32:13.048121 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG keystone.notifications [None req-dd612698-a602-454a-bbbc-80de19090718 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:32:13.049647 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: [pid: 86701|app: 0|req: 1474/2952] 10.222.0.42 () {58 vars in 1232 bytes} [Wed Jun 22 09:32:12 2022] DELETE /identity/v3/projects/c0a6002afad64f37b55d524e7a2c91ab => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:32:22.726821 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=36,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:32:23.044210 dv-cinder-845178-8-iscsi devstack@keystone.service[86701]: DEBUG dbcounter [-] [86701] Writing DB stats keystone:SELECT=21,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:33:08.377956 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2690533-d05a-466b-8f20-77c877691b62 admin admin] Authenticating user token {{(pid=86702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:33:08.379382 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-f2690533-d05a-466b-8f20-77c877691b62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:33:08.505247 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2690533-d05a-466b-8f20-77c877691b62 admin admin] Validating token access rules against request {{(pid=86702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:33:08.563712 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b3f46a-387a-42e4-8869-5fc3ad1dc74a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec2627e3cdc94ec38d7cc3b1bc670ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1f161193cb440fa8c4a9d23820a5c28', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:33:08.564364 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3f46a-387a-42e4-8869-5fc3ad1dc74a service placement] REQUEST_METHOD: `GET` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:33:08.564647 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3f46a-387a-42e4-8869-5fc3ad1dc74a service placement] SCRIPT_NAME: `/identity` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:33:08.564925 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3f46a-387a-42e4-8869-5fc3ad1dc74a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:33:08.566742 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.fernet_utils [None req-39b3f46a-387a-42e4-8869-5fc3ad1dc74a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:33:08.578133 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b3f46a-387a-42e4-8869-5fc3ad1dc74a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:33:08.580220 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b3f46a-387a-42e4-8869-5fc3ad1dc74a service placement] RBAC: Authorization granted {{(pid=86702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:33:08.590023 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: [pid: 86702|app: 0|req: 1479/2953] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Jun 22 09:33:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:33:18.585939 dv-cinder-845178-8-iscsi devstack@keystone.service[86702]: DEBUG dbcounter [-] [86702] Writing DB stats keystone:SELECT=84 {{(pid=86702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}